Job DescriptionJob Title: Data Engineer - Databricks (AWS) | PySpark | Delta Lake
NLocation: Bengaluru, Noida, Gandhi Nagar, Pune, Chennai
NExperience: 4+ Years
NJob Summary
nWe are looking for a talented Data Engineer with robust expertise in Databricks on AWS, PySpark, Delta Lake, and up-to-date data engineering practices. The ideal candidate will be responsible for building scalable data pipelines, implementing data governance frameworks, optimizing platform performance, and supporting enterprise analytics initiatives within the Healthcare/Life Sciences domain.
NKey Responsibilities
n
N
Design, develop, and maintain scalable data pipelines using Databricks on AWS. N
Build and support batchand streaming data ingestion frameworks. N
Implement data quality,governance, lineage, and security controls using Unity Catalog and Databricks best practices. N
Develop and optimize ETL/ELT processes using PySpark and SQL. N
Design and implement Medallion Architecture (Bronze, Silver, Gold) data solutions. N




Build and maintain CDC-based ingestion pipelines using AWS and Databricks services. N
Optimize Spark performance, cluster utilization, and platform costs. N
Implement and support Delta Lake features to ensure data reliability and governance. N
Manage Structured Streaming, Auto Loader, and real-time data processing requirements. N
Develop CI/CD processesusing Git, Databricks Asset Bundles, and deployment automation tools. N
Monitor production environments, troubleshoot issues, and ensure SLA compliance. N
Collaborate with business stakeholders, analysts, and engineering teams to deliver high-quality data solutions. N
Mentor junior engineersand contribute to data engineering best practices. N

nRequired Skills & Qualifications
NTechnical Skills
n
N
4+ years of experience in Data Engineering. N
4+ years of hands-on experience with Databricks on AWS. N
Solid expertise in PySpark and Spark optimization techniques.

📌 Aws Data Engineer Odhav
🏢 Tata Consultancy Services
📍 Odhav