28 Sep
|
ZecData Technology
|
Bengaluru
28 Sep
ZecData Technology
Bengaluru
Position: Data Engineer – Apache Airflow
Experience: 4+ YearsT echnology: Apache AirflowRole
We are looking for an experienced Data Engineer with robust hands-on expertise in Apache Airflow to design, develop, and maintain reliable data pipelines and workflows. The ideal candidate should have solid experience in DAG development, workflow orchestration, and production support.
Key Responsibilities
Design, develop, and maintain Apache Airflow DAGs for data pipeline orchestration.
Build and manage scalable and reliable ETL/ELT workflows.
Monitor, troubleshoot, and optimize Airflow DAGs and pipeline performance.
Implement scheduling, dependencies, retries, alerts, and error-handling mechanisms.
Work with data engineering teams to integrate Airflow with various data sources and processing platforms.
Follow best practices for DAG development, testing, deployment, and maintenance.
Troubleshoot production issues and ensure timely resolution of pipeline failures.
Maintain proper documentation for workflows, DAGs, and operational processes.
Required Skills
4+ years of experience in Data Engineering.
Solid hands-on experience with Apache Airflow.
Good knowledge of DAG development and workflow orchestration.
Experience developing and managing production-grade data pipelines.
Understanding of ETL/ELT concepts and data integration.
Solid troubleshooting and problem-solving skills.
Knowledge of Python and SQL is preferred.
Certifications
Tier 1 – Required for DAG Authors:
Astronomer Certification for Apache Airflow Fundamentals
Tier 2 – Preferred:
Astronomer Certification for DAG Author
Pay: ₹509,436.64 - ₹1,568,808.54 per year
Work Location: In person
📌 Data Engineer – Apache Airflow +yrs Bengaluru
🏢 ZecData Technology
📍 Bengaluru