Responsibilities

- Translate application storyboards and use cases into functional applications.
- Design, build, and maintain efficient, reusable, and reliable Python and Scala code.
- Develop high-performance and low-latency components for Spark clusters.
- Tune application performance, identify bottlenecks and bugs, and devise solutions.
- Interpret functional requirements into designs for big data platforms.
- Process and analyze large datasets using Hive, Impala, and HBase.
- Test software prototypes and transfer them to operational teams.
- Propose engineering best practices and standards and collaborate with global teams.

Requirements

- 8 to 12 years of experience.
- Robust experience with one or more programming languages, including Python and Spark.
- Experience with application performance tuning, troubleshooting, and big data implementation.




- Experience with HDFS, MapReduce, YARN, Apache Spark, and Hive.
- Familiarity with Avro, Parquet, CSV, and JSON data formats.
- Strong systems analysis, design, architecture, scalable application design, and software development lifecycle fundamentals.
- Experience with UNIX/Linux and shell scripting.
- Good knowledge of database principles and SQL.
- Experience with Agile/Scrum, Git, and Jira.
- Experience with NoSQL databases and build or continuous integration tools such as Maven, Jenkins, or TeamCity.
- Familiarity with cloud and container technologies.
- Experience with real-time data processing using Kafka.

📌 Python and Apache Spark Big (Pune)
🏢 Citi
📍 Pune