06 Sep
|
Persistent Systems
|
Ludhiana
06 Sep
Persistent Systems
Ludhiana
About Position:
We are looking for an Azure Data Engineer with 4 to 8 years of experience and strong expertise in Azure Databricks, ETL, and PySpark. The candidate will be responsible for designing and building scalable, high-performance data solutions on Azure to support analytics and business use cases. The ideal candidate will collaborate with cross-functional teams to develop reliable data pipelines and ensure high standards of performance, data quality, security, and scalability across the Azure ecosystem.
- Role: Azure Data Engineer
- Location: Bangalore, Pune & Chennai
- Experience: 4 to 8 Years
- Job Type: Full Time Employment
What You'll Do:
- Design, develop, and optimize scalable data pipelines using Azure Databricks and PySpark
- Build and maintain robust ETL/ELT workflows for batch and large-scale data processing
- Develop reusable Databricks notebooks and PySpark components for data ingestion, transformation, and validation
- Integrate data from multiple structured and unstructured sources into the Azure data platform
- Design and implement Delta Lake and medallion architecture for reliable and efficient data processing
- Orchestrate and monitor data pipelines using Azure Data Factory (ADF), Azure Data Lake Storage (ADLS), and related Azure services
- Implement data quality, governance, security, monitoring, and performance-tuning mechanisms
- Collaborate with business, analytics, and engineering teams to translate requirements into production-ready data solutions
- Troubleshoot and resolve ETL pipeline, Databricks, PySpark, and production issues
Expertise You'll Bring:
- 4 to 8 years of experience in Data Engineering
- Strong hands-on experience with Azure Databricks, Apache Spark, PySpark, and Delta Lake
- Strong experience in designing, developing, and optimizing ETL/ELT pipelines
- Positive proficiency in SQL, data transformation, and query optimization
- Experience with Azure services such as Data Factory (ADF), Data Lake Storage (ADLS), and Synaps
📌 Azure Data Engineer (Ludhiana)
🏢 Persistent Systems
📍 Ludhiana