? We're Hiring: Senior Data Engineer (7+ Years) We are looking for an experienced Senior Data Engineer with strong hands-on expertise in Spark, Scala, Hive, and Kafka to join our team. The ideal candidate should have experience building and optimizing large-scale data pipelines, working with distributed data processing systems, and handling complex production environments. Candidates should be comfortable taking ownership of deliverables and contributing independently with minimal supervision. ?

Key Responsibilities
• Design, develop, and optimize large-scale data pipelines using Spark and Scala.
• Work on high-volume batch and real-time data processing.
• Develop and maintain ETL workflows and data orchestration pipelines.
• Troubleshoot complex data and performance issues in production environments.
• Perform Spark job tuning and optimization.
• Contribute to cloud migration and data platform modernization initiatives.
• Implement CI/CD pipelines and automated deployment processes.
• Collaborate with cross-functional teams to deliver scalable data solutions. ? Required

Skills:
• 7+ years of experience in Data Engineering / Big Data Development.
• Strong hands-on experience with Apache Spark, Scala, and Hive.




• Experience with Kafka and distributed data processing.
• Robust programming skills in Scala and/or Python.
• Hands-on experience building and troubleshooting large-scale ETL pipelines.
• Experience with at least one cloud platform: GCP, AWS, or Azure.
• Knowledge of Git, Jenkins, CI/CD, and workflow orchestration tools such as Oozie. ? Good to Have:
• GCP services – BigQuery, GCS, Dataproc, and Pub/Sub.
• Experience with cloud migration of on-premise Spark/Hive workloads.
• Experience with large-scale data migration and reconciliation.
• Knowledge of data quality and observability frameworks. ? What We're Looking For: Someone who can ramp up quickly, independently troubleshoot complex issues, take end-to-end ownership, and deliver production-ready solutions with minimal handholding. ? Interested or know someone who would be a good fit? Share

your profile
or connect with me to explore this opportunity Share you resume in [email protected] #Hiring #SeniorDataEngineer #DataEngineering #BigData #ApacheSpark #Scala #Hive #Kafka #GCP #AWS #Azure #ETL #Python #Jenkins #CloudComputing #TechHiring

📌 Senior Data Engineer (Bengaluru)
🏢 Andor Tech
📍 Bengaluru