We are looking for a skilled Python Data Engineer with hands-on experience in Apache Airflow and ETL/ELT pipeline development. The candidate will design, develop, and maintain reliable data pipelines, manage workflow orchestration, and troubleshoot data processing issues.
Key Responsibilities:
Develop reusable Python code and Apache Airflow DAGs.
Build and optimize ETL/ELT data pipelines.
Integrate data from APIs, databases, files, Kafka, and Message Queues.
Monitor workflows, troubleshoot failures, and improve pipeline performance.
Support Git version control, CI/CD, automated testing, and deployments.
Collaborate with cross-functional teams in an Agile workplace.
Required Skills:
Robust Python programming skills.
Hands-on experience with Apache Airflow and DAG development.
Experience in ETL/ELT pipelines and data integration.
Knowledge of APIs, databases, Kafka, and Message Queues.
Familiarity with Git, CI/CD, debugging, and automated testing.
Solid problem-solving and troubleshooting skills.
Pay: ₹1,500,000.00 - ₹2,000,000.00 per year
Work Location: Hybrid remote in Mumbai, Maharashtra