02 Oct
|
Consult Asia
|
Chennai
02 Oct
Consult Asia
Chennai
Develop and migrate data pipelines using Spark, Python/Scala. Move Hive and Control-M jobs to Airflow/DBT. Integrate with Kafka, Solace, S3, MinIO, and deploy on Kubernetes ensuring scalable, automated, production-ready solutions.
Required Candidate profile
Experienced Data Engineer (6–9 yrs) with robust Spark, Python/Scala, and SQL skills. Hands-on in Airflow, DBT, Kafka, Kubernetes, and data lakehouse tools.Capable of independent delivery and migration
📌 Senior Data Engineer (Chennai)
🏢 Consult Asia
📍 Chennai