Senior Databricks Developer – 5+ Years ExperienceExperience: 5+ Years
Client: US-Based Client
Position: Senior Databricks Developer / Data Engineer
Job DescriptionWe are seeking an experienced Senior Databricks Developer to join our team and work on challenging data engineering and cloud analytics projects for a US-based client.
The ideal candidate will have robust hands-on experience with Azure Databricks, PySpark, Python, SQL, and Azure Data Factory (ADF), along with expertise in designing and implementing scalable data pipelines and up-to-date data platforms.
Key Responsibilities• Design, develop, and optimize ETL/ELT pipelines using Azure Databricks and PySpark.
• Build scalable data processing solutions using Python, SQL, and Apache Spark.
• Develop and maintain data pipelines using Azure Data Factory.
• Implement Delta Lake architecture and Medallion Architecture (Bronze, Silver, Gold).
• Optimize Databricks jobs, queries, and workflows for performance and cost efficiency.
• Integrate data from multiple sources into Azure Data Lake Storage (ADLS).
• Implement data quality checks,



validation, monitoring, and error handling.
• Collaborate with US-based technical and business teams to deliver reliable data solutions.
• Support production deployments, troubleshooting, and performance improvements.

Required Skills• 5+ years of experience in Data Engineering or ETL development.
• Solid hands-on experience with Azure Databricks and PySpark.
• Advanced SQL and Python programming skills.
• Experience with Azure Data Factory, ADLS Gen2, and Delta Lake.
• Good understanding of data warehousing, dimensional modeling, and ETL/ELT concepts.
• Experience with Git, CI/CD pipelines, and Azure DevOps.
• Strong debugging, problem-solving, and communication skills.

Preferred Qualifications• Experience with Databricks Unity Catalog and Delta Live Tables/Lakeflow.
• Knowledge of Microsoft Fabric, Azure Synapse Analytics, or Power BI.
• Experience with large-scale data migrations and

📌 Senior Databricks Developer Tiruchirappalli
🏢 Newdream Data Systems
📍 Tiruchirappalli