07 Aug
|
Nisum
|
Bhubaneswar
Senior Data Engineer Azure | 6+ Years
Location: Bhubaneswar / Hyderabad
Experience: 6+ Years
Job Summary
We are looking for a highly skilled Senior Data Engineer with strong expertise in Azure Data Engineering to design, develop, and maintain scalable data solutions. The ideal candidate should have hands-on experience with Azure Data Factory (ADF), Azure Databricks, PySpark, Azure Functions, Python, and SQL, along with a solid understanding of modern data platforms and ETL processes.
Key Responsibilities
Design, develop, and maintain scalable ETL and data ingestion pipelines.
Build and optimize data solutions using Azure Data Factory, Azure Databricks, PySpark, and Azure Functions.
Develop robust data pipelines for Data Lake, Data Warehouse, and Lakehouse architectures.
Collaborate with business stakeholders, analysts, and engineering teams to build high-quality data models.
Perform data analysis, troubleshoot production data issues, and ensure data accuracy and availability.
Develop Spark, Spark SQL, and Hive SQL jobs to support business reporting and analytics.
Design end-to-end data engineering solutions following industry best practices and design patterns.
Implement data governance, security, and access control policies.
Optimize data processing for performance, scalability, and cost efficiency.
Write clean, maintainable code along with unit and integration tests.
Contribute to technical documentation and knowledge sharing.
Required Skills
6+ years of experience in Data Engineering and ETL development.
Solid hands-on experience with Azure Data Factory (ADF).
Experience with Azure Databricks and PySpark.
Experience in Azure Functions and Azure Data Services.
Solid programming skills in Python (Scala is a plus).
Excellent knowledge of SQL, query optimization, and relational databases.
Experience with Spark, Spark SQL, and Hive SQL.
Knowledge of Data Lake, Data Warehouse, and Lakehouse architectures.
Experience with relational and NoSQL databases.
Understanding of data governance, data modeling, and data quality practices.
Experience working on batch and streaming data processing.
Preferred Skills
Teradata or Ab Initio
Azure Synapse Analytics
Delta Lake
Azure Data Lake Storage (ADLS)
CI/CD and Azure DevOps
Education
Bachelor's degree in Computer Science, Information Technology, Engineering, MCA, or a related field.
📌 Senior Data Engineer Bhubaneswar
🏢 Nisum
📍 Bhubaneswar