Data Engineer (Chennai)

Data Engineer (Chennai)

11 Apr
|
Minfy
|
Chennai

11 Apr

Minfy

Chennai

Data Engineer Azure

n

Experience:

n

4-6 years of IT experience, with a minimum of 4-5 years specifically focused on Azure data Services .

n

Location:

n

Gurugram

n

About the Role:

n

We are seeking a highly skilled Senior Azure Data Engineer to lead the design, development, and optimization of our enterprise-grade cloud data platform. You will be responsible for building scalable, resilient data pipelines that transform raw data from diverse sources into high-quality, actionable insights. As a senior member of the team, you will drive architectural decisions, mentor junior engineers, and ensure our data infrastructure aligns with the latest industry standards for performance, security, and cost-efficiency.

n

Key Responsibilities-->

n

Architecture & Design: Design end-to-end cloud data architectures using the Medallion (Bronze/Silver/Gold) architecture and Lakehouse patterns to support both batch and real-time processing.

n

Data Integration (ETL/ELT): Build complex, metadata-driven pipelines using Azure Data Factory (ADF) and Synapse Pipelines. Implement event-based and tumbling window triggers for seamless ingestion.

n

Big Data Processing: Develop high-performance data transformation logic using Azure Databricks and PySpark. Optimize Spark jobs through efficient partitioning, caching, and shuffle tuning.

n

Microsoft Fabric Implementation: Lead the transition or integration of existing workloads into Microsoft Fabric, leveraging OneLake, Dataflows Gen2, and Fabric Notebooks.

n

Data Modeling: Create robust dimensional models (Star/Snowflake schemas)



within Azure Synapse SQL Pools and Fabric Data Warehouses to empower Power BI reporting.

n

Governance & Security: Implement strict RBAC, data masking, and encryption. Utilize Azure Purview for data lineage, cataloging, and compliance.

n

DevOps & Automation: Establish CI/CD pipelines using Azure DevOps or GitHub Actions for automated deployment of infrastructure (Terraform/Bicep) and code.

n

Performance Tuning: Monitor and optimize cloud spend and query performance across Synapse, Databricks, and Azure SQL databases.

n

Technical Requirements - Must-Have Skills

n

Core Azure Services - Azure Data Factory, Azure Databricks, Azure Synapse Analytics, ADLS Gen2.

n

Languages - Expert-level SQL and Python (PySpark, Pandas).

n

Emerging Tech Hands-on experience with Microsoft Fabric and OneLake.

n

Storage - Delta Lake, Parquet, Avro, Azure SQL, Cosmos DB.

n

Streaming - Azure Event Hubs, Stream Analytics, or Spark Structured Streaming.

n

Tools/DevOps - Git, Azure DevOps, Terraform/ARM, Power BI (Semantic Models).

n

Qualifications

n

Experience: 4-6 years in Data Engineering, with at least 2+ years focused specifically on the Azure ecosystem.

n

Education: Bachelor’s or Master’s degree in Computer Science, Data Science, or a related field.

n

Certifications: (Preferred) DP-203 (Azure Data Engineer Associate) or Microsoft Certified: Fabric Analytics Engineer Associate.

n

Soft Skills: Robust ability to translate complex business requirements into technical roadmaps; experience mentoring junior staff.

n

Skills

n

Data InterpretationData Mining

📌 Data Engineer (Chennai)
🏢 Minfy
📍 Chennai

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: data engineer (chennai) / chennai
Subscribe to this job alert:
Enter Your E-mail address to receive the latest job offers for: data engineer (chennai) / chennai