08 Sep
|
Michael Page International
|
India
08 Sep
Michael Page International
India
About the Role :
We are looking for a hands-on Senior Data Engineer who is passionate about building scalable data solutions and actively codes on a daily basis. The ideal candidate will have deep expertise in Python, Advanced SQL, Apache Airflow, GCP Dataflow/Apache Beam, and ETL/ELT development, along with experience leveraging AI tools such as GitHub Copilot, ChatGPT, Claude, and Cursor to improve engineering productivity.
Total Experience : 5-8 years
Role &
responsibilities :
- Design, develop, and maintain scalable ETL/ELT pipelines.
- Build and support Apache Airflow DAGs from scratch.
- Develop data processing solutions using Python, Dataflow, Apache Beam, and Spark.
- Write highly optimized SQL queries, transformations, and analytical datasets.
- Troubleshoot production issues and perform code-level fixes.
- Build reusable Python libraries, frameworks, and data components.
- Integrate data from multiple sources and support data activation initiatives.
- Utilize AI-powered coding assistants to accelerate development and improve code quality.
Mandatory Skills :
- 5 years of Data Engineering experience.
- Advanced Python coding experience.
- Advanced SQL (Window Functions, CTEs, Query Optimization, Performance Tuning).
- Hands-on Apache Airflow DAG development.
- GCP experience with Dataflow, BigQuery, Dataproc, or Apache Beam.
- ETL/ELT and Data Pipeline development.
- Data Integration experience.
- Production support and troubleshooting.
- Experience using GitHub Copilot, ChatGPT, Claude, or Cursor in development activities.
Preferred candidate profile :
A highly technical Senior Data Engineer who spends the majority of their time coding, building Airflow workflows, developing ETL pipelines, optimizing complex SQL, and leveraging AI tools to deliver scalable and reliable data solutions.
📌 Senior Data Engineer - GCP/Airflow (India)
🏢 Michael Page International
📍 India