05 Oct
|
HORIGINE CONSULTING
|
India
05 Oct
HORIGINE CONSULTING
India
Description:
Azure Data Engineer / Senior Azure Data Engineer About the Role We are looking for experienced Azure Data Engineers to design, build, and maintain scalable data pipelines and cloud-based data solutions that support enterprise data storage, processing, analytics, and reporting requirements. The ideal candidate will have strong hands-on experience with Azure Databricks, Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage (ADLS), PySpark, and SQL. Python development experience would be advantageous. Depending on experience and capability, candidates will be considered for either the Azure Data Engineer (4-6 years) or Senior Azure Data Engineer (6-10 years) position. Key Responsibilities Design, develop, test, and maintain scalable data pipelines using Azure Databricks and Azure Data Factory. Build and optimize data processing solutions using PySpark and Spark SQL. Develop data ingestion, transformation,
and integration processes across multiple source systems. Implement solutions leveraging Azure Synapse Analytics and Azure Data Lake Storage (ADLS Gen2). Troubleshoot and resolve data pipeline and processing issues. Contribute to code reviews, technical documentation, and engineering best practices. Support CI/CD implementation and automated deployment of data solutions. Required Skills Experience Essential o Hands-on experience with Azure Databricks (ADB), Azure Data Factory (ADF), Azure Synapse Analytics, Azure Data Lake Storage (ADLS Gen2), PySpark, SQL o Strong understanding of ETL/ELT development, Data integration and transformation, up-to-date data platforms, Cloud-based data engineering practices, CI/CD pipelines Desirable - Python programming experience
Local Skills
adb;PySpark;SQL;Azure Databricks
📌 INVENT_DFRC_DATASUB_230926 (India)
🏢 HORIGINE CONSULTING
📍 India