Job DescriptionJob Title: Data Engineer - Databricks (AWS) | PySpark | Delta Lake
NLocation: Bengaluru, Noida, Gandhi Nagar, Pune, Chennai
NExperience: 4+ Years
NJob Summary
nWe are looking for a talented Data Engineer with robust expertise in Databricks on AWS, PySpark, Delta Lake, and modern data engineering practices. The ideal candidate will be responsible for building scalable data pipelines, implementing data governance frameworks, optimizing platform performance, and supporting enterprise analytics initiatives within the Healthcare/Life Sciences domain.
NKey Responsibilities
n
- N
- Design, develop, and maintain scalable data pipelines using Databricks on AWS. N
- Build and support batchand streaming data ingestion frameworks. N
- Implement data quality,governance, lineage, and security controls using Unity Catalog and Databricks best practices. N
- Develop and optimize ETL/ELT processes using PySpark and SQL. N
- Design and implement Medallion Architecture (Bronze, Silver, Gold) data solutions. N




- Build and maintain CDC-based ingestion pipelines using AWS and Databricks services. N
- Optimize Spark performance, cluster utilization, and platform costs. N
- Implement and support Delta Lake features to ensure data reliability and governance. N
- Manage Structured Streaming, Auto Loader, and real-time data processing requirements. N
- Develop CI/CD processesusing Git, Databricks Asset Bundles, and deployment automation tools. N
- Monitor production environments, troubleshoot issues, and ensure SLA compliance. N
- Collaborate with business stakeholders, analysts, and engineering teams to deliver high-quality data solutions. N
- Mentor junior engineersand contribute to data engineering best practices. N

nRequired Skills & Qualifications
NTechnical Skills
n
- N
- 4+ years of experience in Data Engineering. N
- 4+ years of hands-on experience with Databricks on AWS. N
- Strong expertise in PySpark and Spark optimization techniques.

📌 Aws Data Engineer (Odhav)
🏢 Tata Consultancy Services
📍 Odhav