Job Title: Senior Data Engineer

Job Summary

We are looking for a skilled Senior Data Engineer with strong expertise in Azure Databricks, Azure Data Factory (ADF), Python, PySpark, and SQL. The candidate will be responsible for designing, developing, and maintaining scalable data pipelines, managing Azure Data Lake environments, and delivering robust data engineering solutions on the Azure platform.

Role & Responsibilities

- Design, develop, and optimize data pipelines using Azure Databricks and Azure Data Factory (ADF).
- Build and maintain Databricks notebooks using Python, PySpark , and SQL.
- Develop ETL/ELT solutions for data integration, transformation, and loading.
- Work with Azure Data Lake Storage (ADLS) and ensure data platform performance and optimization.
- Collaborate with business and product teams to translate requirements into technical solutions.
- Monitor, troubleshoot, and resolve data pipeline and performance issues.
- Implement CI/CD processes using Azure DevOps and version control best practices.
- Ensure data quality, governance, reliability,



and security standards are maintained.
- Support Databricks platform administration and explore recent capabilities such as AI/BI Dashboards and Databricks Apps.
- Provide technical guidance for enhancements, projects, and best practices.

Preferred Candidate Profile

- B.Tech/B.E. in Computer Science, IT, or equivalent qualification.
- Strong hands-on experience with Azure Databricks, Azure Data Factory (ADF), Python, PySpark, and SQL.
- Experience in designing and developing large-scale data pipelines and ETL workflows.
- Good understanding of Azure Cloud services and Data Lake architecture.
- Strong SQL knowledge with databases such as SQL Server, MySQL, etc.
- Experience with Azure DevOps, CI/CD pipelines, and Git.
- Knowledge of OOP concepts and implementation in Python.
- Exposure to Scala, Power BI, Delta Lake, Synapse Analytics will be an added advantage.
- Excellent problem-solving, communication, and stakeholder management skills.

📌 Senior Data Engineer (Pune)
🏢 Bajaj Finance
📍 Pune