03 Oct
|
NTT DATA Services
|
Bengaluru
03 Oct
NTT DATA Services
Bengaluru
Job Description: Data Engineer (DBT + Airflow + Python) | 5+ Years
Role: Data Engineer
Experience: 5+ Years
Location: Bengaluru/Gurgaon
Employment Type: Full-Time
Job Summary
We are looking for an experienced Data Engineer with strong expertise in DBT, Apache Airflow, and Python to design, develop, and maintain scalable data pipelines and transformation frameworks. The ideal candidate will have hands-on experience in building modern data platforms, workflow orchestration, ETL/ELT development, and cloud-based data warehousing solutions.
Key Responsibilities
• Design, develop, and maintain scalable ETL/ELT data pipelines using Python, DBT, and Apache Airflow.
• Build and manage Airflow DAGs for workflow orchestration, scheduling, monitoring, and dependency management.
• Develop reusable and optimized DBT models, snapshots, tests, and macros for data transformation.
• Implement data quality checks, validation frameworks, and reconciliation processes across data pipelines.
• Develop and optimize Python scripts for data ingestion, transformation, automation,
and exception handling.
• Work with structured and semi-structured data formats such as JSON, CSV, and Parquet.
• Integrate data from multiple sources into enterprise data warehouses and analytics platforms.
• Monitor, troubleshoot, and resolve data pipeline failures and performance bottlenecks.
• Collaborate with Data Architects, Analysts, and Business stakeholders to understand and deliver data requirements.
• Ensure adherence to best practices around coding standards, version control, testing, and deployment.
• Participate in production support, incident resolution, and root cause analysis activities.
Mandatory Skills
• 5+ years of experience in Data Engineering.
• Strong hands-on experience with DBT (Data Build Tool).
• Solid experience with Apache Airflow including DAG development, scheduling, monitoring, and workflow orchestration.
• Proficiency in Python for ETL development, automation, a
📌 Business Intelligence Specialist (Bengaluru)
🏢 NTT DATA Services
📍 Bengaluru