Job Title: Data Engineer Consultant - Airflow / Astronomer Migration
Experience: 3 to 5 years
Location / Shift:
- Location: Pune, India / Remote / Hybrid as per project need
- Working Mode: Full-time assignment
Client working hours may apply
Role Summary:
You will work as a Data Engineer Consultant .
You will support the migration of orchestration workflows from Azure Data Factory (ADF) to Astronomer / Apache Airflow .
You will design, build, test, and document data workflows.
You will work closely with the Principal Data Engineer and the Data Engineering team.
You will also suggest improvements for performance, cost, reliability, and maintainability.
Primary Skills:
Must Have
- Apache Airflow / Astronomer
- Airflow DAG design and development
- Python and SQL
- dbt
- Snowflake
- Azure Blob Storage
- Data pipeline orchestration
- Workflow testing and validation
Secondary Skills:
Valuable to Have
- Azure Data Factory (ADF)
- ADF to Airflow migration experience
- Data pipeline modernization experience
- Snowflake performance tuning
- dbt model and flow optimization
- Git / Azure DevOps
- CI/CD for data pipelines
Monitoring and alerting for data workflows
Key Responsibilities:
1) Requirement Understanding
- Understand existing ADF pipelines and orchestration flows.
- Analyze current workflow schedules, triggers, parameters, and dependencies.
- Understand ingestion steps, transformation logic, and downstream impact.
- Work with the Principal Data Engineer and team to clarify open points.
Identify risks, blockers, assumptions, and dependencies early.
2) Solution Design
- Design the migration approach from ADF to Astronomer / Airflow .
- Convert existing orchestration logic into clean Airflow DAG design.
- Defin
📌 Application Developer (Pune)
🏢 Fujitsu
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.