Required Skills
Robust hands-on experience with Apache Spark
Proficiency in Scala and/or Python (PySpark)
Positive understanding of Spark internals (RDD, DataFrame, Dataset APIs)
Experience with data formats like Parquet, Avro, JSON
Familiarity with distributed systems and big data concepts
Strong SQL skills
Experience with cloud platforms (AWS preferred S3, EMR, Glue, Kinesis, Firehose, Hive)
Knowledge of performance tuning and optimization techniques
Experience with CI/CD pipelines
Exposure to streaming frameworks (Spark Streaming)
Familiarity with workflow orchestration tools like Apache Airflow

Preferred Skills
Familiarity with Agile development practices.
Strong analytical and problem-solving skills.
Good communication and stakeholder collaboration abilities.
Ability to work independently in a rapid-paced environment.
Ownership mindset with attention to data quality and reliability.

Additional Information
Team player.
Effective communication skills.
Readiness to broaden skills (or enhance existing skills) to GoLang or any other technology related to Java/J2EE.
Mandatory requirement to work from the Customer Office in Pune location.

📌 Data Engineer Quest Global Pune
🏢 Quest Global
📍 Pune