We at KPI Partners hiring for Python Airflow Data Engineers
Experince 6+ Years
Hybrid Work Model - Bangalore/Hyderabad and Pune
Key Responsibilities
Design, develop and maintain scalable data pipelines using Python.
Build, schedule and manage workflows using Apache Airflow, including DAG development and orchestration.
Develop complex SQL queries, optimize database performance and manage data transformations.
Build and maintain ETL/ELT processes for large-scale data integration.
Work with AWS cloud services to develop and manage data engineering solutions.
Leverage Azure cloud services for data storage, integration and processing.
Ensure data quality, reliability, performance and scalability across data pipelines.
Troubleshoot pipeline failures and implement monitoring and error-handling mechanisms.
Collaborate with cross-functional teams, data architects and business stakeholders.
Follow coding standards, version control and CI/CD best practices.