Senior Databricks Developer – 5+ Years Experience

Experience: 5+ Years

Client: US-Based Client

Position: Senior Databricks Developer / Data Engineer

We are seeking an experienced Senior Databricks Developer to join our team and work on challenging data engineering and cloud analytics projects for a US-based client.

The ideal candidate will have strong hands-on experience with Azure Databricks, PySpark, Python, SQL, and Azure Data Factory (ADF) , along with expertise in designing and implementing scalable data pipelines and modern data platforms.

Key Responsibilities

- Design, develop, and optimize ETL/ELT pipelines using Azure Databricks and PySpark.
- Build scalable data processing solutions using Python, SQL, and Apache Spark.
- Develop and maintain data pipelines using Azure Data Factory.
- Implement Delta Lake architecture and Medallion Architecture (Bronze, Silver, Gold).
- Optimize Databricks jobs, queries, and workflows for performance and cost efficiency.
- Integrate data from multiple sources into Azure Data Lake Storage (ADLS).
- Implement data quality checks, validation, monitoring, and error handling.
- Collaborate with US-based technical and business teams to deliver reliable data solutions.
- Support production deployments, troubleshooting,



and performance improvements.

Required Skills
- 5+ years of experience in Data Engineering or ETL development.
- Strong hands-on experience with Azure Databricks and PySpark.
- Advanced SQL and Python programming skills.
- Experience with Azure Data Factory, ADLS Gen2, and Delta Lake.
- Positive understanding of data warehousing, dimensional modeling, and ETL/ELT concepts.
- Experience with Git, CI/CD pipelines, and Azure DevOps.
- Strong debugging, problem-solving, and communication skills.

Preferred Qualifications
- Experience with Databricks Unity Catalog and Delta Live Tables/Lakeflow.
- Knowledge of Microsoft Fabric, Azure Synapse Analytics, or Power BI.
- Experience with large-scale data migrations and performance optimization.
- Databricks or Microsoft Azure certifications.
- Prior experience working with US-based clients.

Why Join Us? This is an excellent opportunity to work on modern cloud data platforms, solve complex engineering challenges, collaborate with experienced professionals, and contribute to impactful projects for a US-based client.

Interested candidates can share their updated resumes or reach out directly to discuss this opportunity

📌 Senior Databricks Developer (Tiruchirappalli)
🏢 Newdream Data Systems
📍 Tiruchirappalli