06 Sep
|
Sparix Global
|
India
06 Sep
Sparix Global
India
Position: Azure Databricks Data Engineer (L3)
Experience: 5 – 8 Years
Qualification: BE / B.Tech (Mandatory)
Location: Bangalore, Pune, Chennai, Kolkata, Gurugram
Employment Type: Full-Time
CTC: Up to ₹23.5 LPA
Required Skills
- Azure Databricks
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS)
- PySpark
- Spark SQL
- Azure Synapse Analytics
- SQL
- Python
- ETL/ELT Development
- Delta Lake
- Data Warehousing Concepts
We are looking for a skilled Azure Databricks Data Engineer to design, build, and optimize large-scale data processing solutions on the Microsoft Azure platform. The ideal candidate should have strong experience in Azure Databricks, data engineering, and big data technologies.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure services.
- Build ETL/ELT solutions using PySpark, Spark SQL, Python, and Azure Data Factory.
- Develop and optimize data transformation workflows for structured and unstructured data.
- Implement and manage Delta Lake architecture for reliable and high-performance data processing.
- Work with Azure Data Lake Storage (ADLS) for data ingestion and storage.
- Create and optimize data models and reporting layers using Azure Synapse Analytics.
- Monitor, troubleshoot,
and enhance data pipeline performance and reliability.
- Collaborate with business stakeholders, analysts, and data scientists to deliver data-driven solutions.
- Ensure data quality, security, governance, and compliance standards.
Required Qualifications
- 5–8 years of experience in Data Engineering.
- Robust hands-on experience with Azure Databricks and PySpark.
- Expertise in Azure Data Factory (ADF), ADLS, and Azure Synapse.
- Strong programming skills in Python and SQL.
- Experience with Spark optimization, partitioning, and performance tuning.
- Good understanding of Delta Lake, data warehousing, and data modeling concepts.
- Experience working with large-scale data processing and cloud-native architectures.
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication and stakeholder management skills.
Preferred Qualifications
- Microsoft Azure Data Engineer Associate Certification.
- Experience with CI/CD pipelines and Azure DevOps.
- Knowledge of streaming technologies and real-time data processing.
- Exposure to Kubernetes, Docker, or cloud-native deployment practices.
- Experience with Power BI integration is an added advantage.
📌 Azure Databricks Data Engineer (India)
🏢 Sparix Global
📍 India