Apply on Kit Job: kitjob.in/job/4871q0
Data Engineer Azure
n
Experience:
n
4-6 years of IT experience, with a minimum of 4-5 years specifically focused on Azure data Services .
n
Location:
n
Gurugram
n
About the Role:
n
We are seeking a highly skilled Senior Azure Data Engineer to lead the design, development, and optimization of our enterprise-grade cloud data platform. You will be responsible for building scalable, resilient data pipelines that transform raw data from diverse sources into high-quality, actionable insights. As a senior member of the team, you will drive architectural decisions, mentor junior engineers, and ensure our data infrastructure aligns with the latest industry standards for performance, security, and cost-efficiency.
n
Key Responsibilities-->
n
Architecture & Design: Design end-to-end cloud data architectures using the Medallion (Bronze/Silver/Gold) architecture and Lakehouse patterns to support both batch and real-time processing.
n
Data Integration (ETL/ELT): Build complex, metadata-driven pipelines using Azure Data Factory (ADF) and Synapse Pipelines. Implement event-based and tumbling window triggers for seamless ingestion.
n
Big Data Processing: Develop high-performance data transformation logic using Azure Databricks and PySpark. Optimize Spark jobs through efficient partitioning, caching, and shuffle tuning.
n
Microsoft Fabric Implementation: Lead the transition or integration of existing workloads into Microsoft Fabric, leveraging OneLake, Dataflows Gen2, and Fabric Notebooks.
n
Data Modeling: Create robust dimensional models (Star/Snowflake schemas)
within Azure Synapse SQL Pools and Fabric Data Warehouses to empower Power BI reporting.
n
Governance & Security: Implement strict RBAC, data masking, and encryption. Utilize Azure Purview for data lineage, cataloging, and compliance.
n
DevOps & Automation: Establish CI/CD pipelines using Azure DevOps or GitHub Actions for automated deployment of infrastructure (Terraform/Bicep) and code.
n
Performance Tuning: Monitor and optimize cloud spend and query performance across Synapse, Databricks, and Azure SQL databases.
n
Technical Requirements - Must-Have Skills
n
Core Azure Services - Azure Data Factory, Azure Databricks, Azure Synapse Analytics, ADLS Gen2.
n
Languages - Expert-level SQL and Python (PySpark, Pandas).
n
Emerging Tech Hands-on experience with Microsoft Fabric and OneLake.
n
Storage - Delta Lake, Parquet, Avro, Azure SQL, Cosmos DB.
n
Streaming - Azure Event Hubs, Stream Analytics, or Spark Structured Streaming.
n
Tools/DevOps - Git, Azure DevOps, Terraform/ARM, Power BI (Semantic Models).
n
Qualifications
n
Experience: 4-6 years in Data Engineering, with at least 2+ years focused specifically on the Azure ecosystem.
n
Education: Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.
n
Certifications: (Preferred) DP-203 (Azure Data Engineer Associate) or Microsoft Certified: Fabric Analytics Engineer Associate.
n
Soft Skills: Robust ability to translate complex business requirements into technical roadmaps; experience mentoring junior staff.
n
Skills
n
Data InterpretationData Mining
Apply on Kit Job: kitjob.in/job/4871q0
📌 Data Engineer (Chennai)
🏢 Minfy
📍 Chennai