Senior Databricks Developer – 5+ Years ExperienceExperience: 5+ Years
Client: US-Based Client
Position: Senior Databricks Developer / Data Engineer
Job DescriptionWe are seeking an experienced Senior Databricks Developer to join our team and work on challenging data engineering and cloud analytics projects for a US-based client.
The ideal candidate will have robust hands-on experience with Azure Databricks, PySpark, Python, SQL, and Azure Data Factory (ADF), along with expertise in designing and implementing scalable data pipelines and modern data platforms.
Key Responsibilities• Design, develop, and optimize ETL/ELT pipelines using Azure Databricks and PySpark.
• Build scalable data processing solutions using Python, SQL, and Apache Spark.
• Develop and maintain data pipelines using Azure Data Factory.
• Implement Delta Lake architecture and Medallion Architecture (Bronze, Silver, Gold).
• Optimize Databricks jobs, queries, and workflows for performance and cost efficiency.
• Integrate data from multiple sources into Azure Data Lake Storage (ADLS).
• Implement data quality checks,



validation, monitoring, and error handling.
• Collaborate with US-based technical and business teams to deliver reliable data solutions.
• Support production deployments, troubleshooting, and performance improvements.

Required Skills• 5+ years of experience in Data Engineering or ETL development.
• Strong hands-on experience with Azure Databricks and PySpark.
• Advanced SQL and Python programming skills.
• Experience with Azure Data Factory, ADLS Gen2, and Delta Lake.
• Good understanding of data warehousing, dimensional modeling, and ETL/ELT concepts.
• Experience with Git, CI/CD pipelines, and Azure DevOps.
• Strong debugging, problem-solving, and communication skills.

Preferred Qualifications• Experience with Databricks Unity Catalog and Delta Live Tables/Lakeflow.
• Knowledge of Microsoft Fabric, Azure Synapse Analytics, or Power BI.
• Experience with large-scale data migrations and

📌 Senior Databricks Developer (Tiruchirappalli)
🏢 Newdream Data Systems
📍 Tiruchirappalli