Senior Data Engineer Azure | 6+ Years

Location: Bhubaneswar / Hyderabad
Experience: 6+ Years

Job Summary

We are looking for a highly skilled Senior Data Engineer with strong expertise in Azure Data Engineering to design, develop, and maintain scalable data solutions. The ideal candidate should have hands-on experience with Azure Data Factory (ADF), Azure Databricks, PySpark, Azure Functions, Python, and SQL, along with a solid understanding of modern data platforms and ETL processes.

Key Responsibilities

- Design, develop, and maintain scalable ETL and data ingestion pipelines.
- Build and optimize data solutions using Azure Data Factory, Azure Databricks, PySpark, and Azure Functions.
- Develop robust data pipelines for Data Lake, Data Warehouse, and Lakehouse architectures.
- Collaborate with business stakeholders, analysts, and engineering teams to build high-quality data models.
- Perform data analysis, troubleshoot production data issues, and ensure data accuracy and availability.
- Develop Spark, Spark SQL, and Hive SQL jobs to support business reporting and analytics.
- Design end-to-end data engineering solutions following industry best practices and design patterns.
- Implement data governance, security, and access control policies.




- Optimize data processing for performance, scalability, and cost efficiency.
- Write clean, maintainable code along with unit and integration tests.
- Contribute to technical documentation and knowledge sharing.

Required Skills

- 6+ years of experience in Data Engineering and ETL development.
- Strong hands-on experience with Azure Data Factory (ADF).
- Experience with Azure Databricks and PySpark.
- Experience in Azure Functions and Azure Data Services.
- Strong programming skills in Python (Scala is a plus).
- Excellent knowledge of SQL, query optimization, and relational databases.
- Experience with Spark, Spark SQL, and Hive SQL.
- Knowledge of Data Lake, Data Warehouse, and Lakehouse architectures.
- Experience with relational and NoSQL databases.
- Understanding of data governance, data modeling, and data quality practices.
- Experience working on batch and streaming data processing.

Preferred Skills

- Teradata or Ab Initio
- Azure Synapse Analytics
- Delta Lake
- Azure Data Lake Storage (ADLS)
- CI/CD and Azure DevOps

Education

Bachelor's degree in Computer Science, Information Technology, Engineering, MCA, or a related field.

📌 Senior Data Engineer (Bhubaneswar)
🏢 Nisum
📍 Bhubaneswar