Required Skills

- Strong hands-on experience with Apache Spark
- Proficiency in Scala and/or Python (PySpark)
- Positive understanding of Spark internals (RDD, DataFrame, Dataset APIs)
- Experience with data formats like Parquet, Avro, JSON
- Familiarity with distributed systems and big data concepts
- Strong SQL skills
- Experience with cloud platforms (AWS preferred S3, EMR, Glue, Kinesis, Firehose, Hive)
- Knowledge of performance tuning and optimization techniques
- Experience with CI/CD pipelines
- Exposure to streaming frameworks (Spark Streaming)
- Familiarity with workflow orchestration tools like Apache Airflow

Preferred Skills

- Familiarity with Agile development practices.
- Strong analytical and problem-solving skills.
- Good communication and stakeholder collaboration abilities.
- Ability to work independently in a fast-paced environment.
- Ownership mindset with attention to data quality and reliability.

Additional Information

- Team player.
- Effective communication skills.
- Readiness to broaden skills (or enhance existing skills) to GoLang or any other technology related to Java/J2EE.
- Mandatory requirement to work from the Customer Office in Pune location.

📌 Data Engineer-Quest Global-Pune
🏢 Quest Global
📍 Pune