Work Arrangement: Remote in India.
Type of employment: full time employee.
Notice period: Immediate; 30 days NP maximum
Job Introduction
We are seeking a skilled Sr. Azure Databricks Data Engineer to join our data engineering team. The ideal candidate will have hands-on experience designing and maintaining scalable data pipelines using Azure Databricks and Data Factory, strong technical skills in Python and SQL, and familiarity with machine learning concepts. This role requires a proactive, solution-oriented professional who can collaborate effectively with multicultural teams and contribute to high-quality data solutions.
Job Description
As a Sr. Azure Databricks Data Engineer, your responsibilities include:
• Technical Requirements Gathering and Development of Functional Specifications.
• Designing, developing, and maintaining scalable data pipelines and ETL processes using Azure Databricks, Data Factory, and other Azure services.
• Implementing and optimizing Spark jobs, data transformations, and data processing workflows in Databricks.
• Developing and integrating custom machine learning models using Azure Machine Learning, MLflow, and other relevant libraries.
• Leveraging Azure DevOps and CI/CD best practices to automate the deployment and management of data pipelines and infrastructure.
• Conducting troubleshooting on data models.
• Working with Agile multicultural teams in Asia, the EU, Canada, and the USA.
Profile Requirements
For this position of Sr. Azure Databricks Data Engineer, we are looking for someone with:
• (Required) At least 6 years of experience in developing and maintaining data pipelines using Azure Databricks, Azure Data Factory, and Spark.
• (Required) Hands-on experience with Unity Catalog.
• (Required) Fluent English communication and soft skills.
• (Required) Knowledge and experience in CI/CD using tools such as Terraform, ARM, and Bicep Script.
• (Required) Solid technical skills in Python and SQL.
• (Required) Familiarity with m
📌 Senior Azure Databricks Data Engineer (India)
🏢 AdAstra
📍 India