29 Aug
|
NetConnectGlobal
|
Bengaluru
29 Aug
NetConnectGlobal
Bengaluru
Role : Azure Data Engineer
Location : Gurgaon / Bangalore (Gurgaon Preferred)
Experience : 4-5 Years
Duration : 12 Months
Work Mode : Hybrid
Employment Type : FTE
Role Overview
We are looking for a skilled Azure Data Engineer with strong hands-on experience in Azure Data Services, Databricks, PySpark, Azure Data Factory, Data Lakes, and enterprise data integration. The role involves designing, developing, and optimizing scalable data platforms and pipelines that support analytics, AI, and Agentic AI use cases. The ideal candidate should be comfortable working independently on enterprise-scale data engineering and Lakehouse solutions.
Key Responsibilities
Design, develop, and maintain scalable Azure-based data platforms and pipelines.
Build data engineering solutions using Azure Data Factory, ADLS Gen2, Azure Databricks, PySpark, and Apache Spark.
Design and implement Medallion Architecture across Bronze, Silver, and Gold layers.
Develop robust ETL/ELT pipelines and enterprise data integration solutions.
Implement batch, streaming, and event-driven data ingestion pipelines.
Design and implement CDC, incremental processing, upsert/merge, and idempotent processing mechanisms.
Integrate data from SAP, CRM systems, Microsoft platforms, REST APIs, SaaS applications, and third-party systems.
Design and implement Lakehouse and ODS architectures.
Work with Azure Synapse Analytics, Azure SQL, and Microsoft Fabric.
Develop effective data models to support analytics, AI, and downstream applications.
Implement CI/CD pipelines using Azure DevOps and/or GitHub Actions.
Ensure high standards of data quality, governance, metadata management, and data lineage.
Optimize data pipelines and workloads for performance, scalability, reliability, and cost efficiency.
Collaborate with data scientists, AI engineers, architects, and application teams to deliver data solutions for contemporary analytics and AI workloads.
Must-Have Skills & Experience
4-5 years of experience in Data Enginee
📌 Azure Data Engineer (Bengaluru)
🏢 NetConnectGlobal
📍 Bengaluru