Job Title: Azure Databricks Engineer

Location: Pune (Preferred) / Hybrid / Onsite
Experience: 5–10 Years
Employment Type: Full-Time

Job Summary

We are looking for an experienced Azure Databricks Engineer with solid expertise in Databricks, PySpark, and SQL to design, develop, and optimize scalable data engineering solutions on the Microsoft Azure platform. The ideal candidate should have hands-on experience building ETL/ELT pipelines, processing large datasets, and implementing modern data lake architectures.

Primary Skills

- Azure Databricks
- PySpark
- SQL

Secondary Skills

- Microsoft Azure
- Azure Data Factory (preferred)
- Azure Data Lake Storage (ADLS)
- Azure Synapse Analytics (good to have)

Key Responsibilities

- Design, develop, and maintain scalable data pipelines using Azure Databricks.
- Develop and optimize PySpark applications for large-scale data processing.
- Write efficient SQL queries for data transformation, reporting, and analytics.
- Build ETL/ELT workflows to ingest data from multiple sources.
- Work with Azure cloud services including ADLS, Azure Data Factory, and Synapse.
- Optimize Databricks jobs for performance, scalability, and cost efficiency.
- Collaborate with business analysts, data scientists, and application teams to understand data requirements.
- Ensure data quality, governance, security,



and compliance across data platforms.
- Troubleshoot production issues and provide timely resolutions.
- Follow coding standards, documentation, and best practices.

Required Qualifications

- Bachelor's degree in Computer Science, Information Technology, or a related field.
- 5–10 years of experience in Data Engineering.
- Strong hands-on experience with Azure Databricks.
- Excellent programming skills in PySpark.
- Advanced knowledge of SQL.
- Experience working with Azure cloud services.
- Knowledge of Data Lake architecture and ETL frameworks.
- Experience with Git, CI/CD pipelines, and Agile methodologies is an advantage.

Preferred Skills

- Experience with Delta Lake.
- Knowledge of Azure DevOps.
- Exposure to data warehousing concepts.
- Understanding of performance tuning in Databricks.
- Familiarity with Spark optimization techniques.

Soft Skills

- Excellent analytical and problem-solving skills.
- Strong communication and stakeholder management.
- Ability to work independently and within cross-functional teams.
- Quick learner with a proactive attitude.

Notice Period: Immediate to 30 Days Preferred

Work Location: Hybrid remote in Bengaluru, Karnataka (Bengaluru, Bengaluru Urban District)

📌 Databricks Consultant (India)
🏢 Arrow Point
📍 India