12 Sep
|
Michael Page
|
Hyderabad
12 Sep
Michael Page
Hyderabad
About the Role
We are looking for a hands-on Senior Data Engineer who is passionate about building scalable data solutions and actively codes on a daily basis. The ideal candidate will have deep expertise in Python, Advanced SQL, Apache Airflow, GCP Dataflow/Apache Beam, and ETL/ELT development, along with experience leveraging AI tools such as GitHub Copilot, ChatGPT, Claude, and Cursor to improve engineering productivity
Role & responsibilities
Design, develop, and maintain scalable ETL/ELT pipelines.
Build and support Apache Airflow DAGs from scratch.
Develop data processing solutions using Python, Dataflow, Apache Beam, and Spark
Write highly optimized SQL queries, transformations, and analytical datasets.
Troubleshoot production issues and perform code-level fixes.
Build reusable Python libraries, frameworks, and data components.
Integrate data from multiple sources and support data activation initiatives.
Utilize AI-powered coding assistants to accelerate development and improve code quality.
Mandatory Skills
5+ years of Data Engineering experience.
Advanced Python coding experience.
Advanced SQL (Window Functions, CTEs, Query Optimization, Performance Tuning).
Hands-on Apache Airflow DAG development.
GCP experience with Dataflow, BigQuery, Dataproc, or Apache Beam.
ETL/ELT and Data Pipeline development.
Data Integration experience.
Production support and troubleshooting.
Experience using GitHub Copilot, ChatGPT, Claude, or Cursor in development activities.
Preferred candidate profile
A highly technical Senior Data Engineer who spends the majority of their time coding, building Airflow workflows, developing ETL pipelines, optimizing complex SQL, and leveraging AI tools to deliver scalable and reliable data solutions.
📌 Gcp Data Engineer Hyderabad
🏢 Michael Page
📍 Hyderabad