30 Jul
|
Sparix Global
|
Uttar Pradesh
30 Jul
Sparix Global
Uttar Pradesh
Position: Azure Databricks Data Engineer (L3)
Experience: 5 8 Years
Qualification: BE / B.Tech (Mandatory)
Location: Bangalore, Pune, Chennai, Kolkata, Gurugram
Employment Type: Full-Time
CTC: Up to 23.5 LPA
Required Skills
- Azure Databricks
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS)
- PySpark
- Spark SQL
- Azure Synapse Analytics
- SQL
- Python
- ETL/ELT Development
- Delta Lake
- Data Warehousing Concepts
Job Description
We are looking for a skilled Azure Databricks Data Engineer to design, build, and optimize large-scale data processing solutions on the Microsoft Azure platform. The ideal candidate should have strong experience in Azure Databricks, data engineering, and big data technologies.
Key Responsibilities
- Design, develop, and maintain scalable data pipelines using Azure Databricks and Azure services.
- Build ETL/ELT solutions using PySpark, Spark SQL, Python, and Azure Data Factory.
- Develop and optimize data transformation workflows for structured and unstructured data.
- Implement and manage Delta Lake architecture for reliable and high-performance data processing.
- Work with Azure Data Lake Storage (ADLS) for data ingestion and storage.
- Create and optimize data models and reporting layers using Azure Synapse Analytics.
- Monitor, troubleshoot, and enhance data pipeline performance and reliability.
- Collaborate with business stakeholders, analysts,
and data scientists to deliver data-driven solutions.
- Ensure data quality, security, governance, and compliance standards.
Required Qualifications
- 5 8 years of experience in Data Engineering.
- Strong hands-on experience with Azure Databricks and PySpark.
- Expertise in Azure Data Factory (ADF), ADLS, and Azure Synapse.
- Solid programming skills in Python and SQL.
- Experience with Spark optimization, partitioning, and performance tuning.
- Good understanding of Delta Lake, data warehousing, and data modeling concepts.
- Experience working with large-scale data processing and cloud-native architectures.
- Strong analytical, troubleshooting, and problem-solving skills.
- Excellent communication and stakeholder management skills.
Preferred Qualifications
- Microsoft Azure Data Engineer Associate Certification.
- Experience with CI/CD pipelines and Azure DevOps.
- Knowledge of streaming technologies and real-time data processing.
- Exposure to Kubernetes, Docker, or cloud-native deployment practices.
- Experience with Power BI integration is an added advantage.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Azure Databricks Data Engineer (Uttar Pradesh)
🏢 Sparix Global
📍 Uttar Pradesh