We are looking for a highly skilled Senior Data Engineer with 5+ years of experience in designing, developing, and maintaining scalable data pipelines and data platforms. The ideal candidate should have strong expertise in Apache Airflow, DBT, SQL, and Python, with exposure to Snowflake and cloud platforms (AWS/Azure/GCP) being a plus.
The candidate will work closely with data architects, analysts, and business stakeholders to build reliable, high-performance data solutions that support analytics and business intelligence needs.
Key Responsibilities
Design, develop, and maintain scalable ETL/ELT data pipelines using Python, SQL, Airflow, and DBT.
Build and optimize data models and transformation workflows using DBT.
Develop, schedule, monitor, and troubleshoot workflow orchestration using Apache Airflow.
Write productive and optimized SQL queries for large-scale data processing and reporting.
Implement best practices for data quality, testing, monitoring, and performance optimization.
Collaborate with cross-functional teams to understand data requirements and deliver robust solutions.
Develop and maintain data warehouse and data lake solutions.
Support CI/CD processes and deployment automation for data engineering workflows.
Work with cloud-based data platforms and modern data stack technologies.
Troubleshoot production issues and ensure high availability of data pipelines.
Required Skills
5+ years of experience in Data Engineering.
Robust hands-on experience with Apache Airflow.
Strong experience with DBT (Data Build Tool).
Advanced SQL skills, including:
Complex joins
CTEs
Window functions
Query optimization
Performance tuning
Solid programming experience in Python.
Experience designing and implementing ETL/ELT pipelines.
Understanding of data warehousing concepts and dimensional modeling.
Experience with Git and version control systems.
Valuable to Have
Hands-on experience with Snowflake.
Experience with cloud platforms (AWS, Azure, or GCP).
Knowledge of containerization tools such as Docker.
Experience with CI/CD pipelines and DevOps practices.
Exposure to Big Data technologies and modern data architectures.
Preferred Qualifications
Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field.
Strong analytical and problem-solving skills.
Excellent communication and stakeholder management abilities.
Experience working in Agile/Scrum environments.
📌 Data Engineer Pune
🏢 Nitor
📍 Pune