JOB DESCRIPTION
India T&M; Special Bonus:
Req ID: 394500
We are currently seeking a Data Engineer Advisor to join our team in Pune, Mahārāshtra (IN-MH), India (IN).
Databricks Data Engineer
Role Summary
The Databricks Data Engineer will design, build, test, and maintain scalable data pipelines and data products within the Databricks Lakehouse platform. The role will focus on ingesting, transforming, governing, and optimising data while adhering to engineering best practices and platform standards.
The engineer will work closely with architects, analysts, and business stakeholders to deliver high-quality data solutions supporting analytics, reporting, and AI initiatives.
Key Responsibilities
Data Engineering
- Build and maintain data pipelines within Databricks
- Understand the latesta Databricks data processing capabilities
- Develop ingestion frameworks for batch and streaming workloads.
- Create reliable, scalable, and reusable data products.
- Implement medallion architecture patterns.
Databricks Development
- Develop notebooks, workflows, and jobs using Databricks.
- Implement Delta Lake and Lakehouse best practices.
- Optimise performance and cost efficiency.
- Support platform monitoring and troubleshooting.
Cloud and Dev Ops
- Support deployment automation using Terraform and CI/CD pipelines.
- Manage code repositories and release processes.
- Contribute to platform automation and operational improvements.
Quality and Governance
- Implement data quality controls.
- Support data lineage and governance requirements.
- Ensure compliance with security and data management standards.
- Produce technical documentation.
Required Experience
- 3+ years in Data Engineering roles.
- Databricks engineering certification
- Solid hands-on Databricks experience.
- Experience on AWS.
- Experience with Terraform or Infrastructure-as-Code.
- Experience with modern ETL/ELT development.
Technical Skills
Essential
- Databricks
- PySpark
- SQL
- Delta Lake
- AWS
- Terraform
- Git
- CI/CD
Desirable
- Unity Catalog
- Kafka
- Streaming Technologies
- Data Quality Frameworks
- Machine Learning Pipelines
Key Deliverables
- Data Pipelines
- Data Products
- ETL/ELT Frameworks
- Databricks Workflows
- Terraform Modules
- Technical Documentation
- Monitoring and Operational Dashboards
About NTT DATA
NTT DATA is a $30 billion business and technology services leader, serving 75% of the Fortune Global 100. We are committed to accelerating client success and positively impacting society through responsible innovation. We are one of the world's leading AI and digital infrastructure providers, with unmatched capabilities in enterprise-scale AI, cloud, security, connectivity, data centers and application services. our consulting and Industry solutions help organizations and society move confidently and sustainably into the digital future. As a Global Top Employer, we have experts in more than 50 countries. We also offer clients access to a robust ecosystem of innovation centers as well as established and start-up partners. NTT DATA is a part of NTT Group, which invests over $3 billion each year in R&D.;
📌 Data Engineer Advisor (India)
🏢 NTT
📍 India