Required Skills

- Strong hands-on experience with Apache Spark

- Proficiency in Scala and/or Python (PySpark)

- Good understanding of Spark internals (RDD, DataFrame, Dataset APIs)

- Experience with data formats like Parquet, Avro, JSON

- Familiarity with distributed systems and big data concepts

- Strong SQL skills

- Experience with cloud platforms (AWS preferred S3, EMR, Glue, Kinesis, Firehose, Hive)

- Knowledge of performance tuning and optimization techniques

- Experience with CI/CD pipelines

- Exposure to streaming frameworks (Spark Streaming)

- Familiarity with workflow orchestration tools like Apache Airflow

Preferred Skills

- Familiarity with Agile development practices.

- Solid analytical and problem-solving skills.

- Good communication and stakeholder collaboration abilities.

- Ability to work independently in a fast-paced environment.

- Ownership mindset with attention to data quality and reliability.

Additional Information

- Team player.

- Effective communication skills.

- Readiness to broaden skills (or enhance existing skills) to GoLang or any other technology related to Java/J2EE.

- Mandatory requirement to work from the Customer Office in Pune location.

📌 Data Engineer-Quest Global-Pune
🏢 Quest Global
📍 Pune