We are looking for a hands-on Data Engineer to help build, modernize, and maintain scalable cloud-based data pipelines.
The ideal candidate is strong in Python, Apache Airflow, SQL, Docker, Azure, and modern data processing with Polars. A key part of this role will be modernizing existing data pipelines and migrating orchestration from Azure Synapse Analytics to Apache Airflow-based frameworks.
We also encourage the use of Claude and Claude Code to improve engineering productivity and delivery.

? Key Responsibilities

• Design, develop, and maintain reliable and scalable data pipelines using Python, Polars, and Apache Airflow
• Modernize existing data pipelines and migrate workloads from Azure Synapse Analytics to Airflow-based orchestration
• Build and maintain Dockerized Airflow deployments
• Deploy and manage data solutions across Microsoft Azure
• Work with Azure services such as Azure Storage, Azure SQL, Data Factory, and Key Vault
• Optimize data pipeline performance, reliability, scalability, and cloud costs
• Implement data quality checks, monitoring, alerting, and validation




• Follow engineering best practices around Git, CI/CD, testing, and Infrastructure as Code
• Develop infrastructure using Terraform
• Collaborate with Data Science, Analytics, and BI teams to deliver high-quality data
• Document data pipelines, architecture, and operational procedures
• Use Claude / Claude Code as part of the development and delivery workflow

? Required Skills

✅ Strong hands-on Python experience in data engineering
✅ Robust SQL skills
✅ Hands-on Apache Airflow experience, especially workflow orchestration and DAG development
✅ Practical experience with Polars for data processing and transformation
✅ Strong Docker experience
✅ Experience working with Microsoft Azure
✅ Understanding of ETL/ELT, data modeling, schemas, and distributed data systems
✅ Strong Git and CI/CD experience
✅ Hands-on Terraform / IaC experience
✅ Experience with modern data architecture and engin

📌 Freelance Data Engineer – Python | Airflow | Azure (India)
🏢 IndiTech Consulting
📍 India