Experience: 10+ Years
Location: Kochi / Coimbatore / Chennai / Mumbai / Pune
LinkedIn Profile: Mandatory
About the Role
We are looking for an experienced Lead Data Engineer to design, develop, and support enterprise-grade data platforms and pipelines. The ideal candidate should have strong expertise in Azure Data Engineering, Databricks/Microsoft Fabric, PySpark, SQL, data migration, and contemporary data architecture, along with hands-on experience in production and L2/L3 support.
Key Responsibilities
Design and develop scalable enterprise data pipelines using Azure data technologies.
Build and optimize data solutions using Azure Data Factory, Azure Databricks/Microsoft Fabric, PySpark, and Delta Lake.
Implement Medallion Architecture and up-to-date data engineering best practices.
Lead data migration initiatives and ensure data quality, reliability, and performance.
Develop effective data models and optimize complex SQL queries and data workloads.
Perform performance tuning, job monitoring, troubleshooting, and failure recovery.
Provide L2/L3 production support, including RCA, incident resolution, and job failure troubleshooting.
Participate in on-call support and Hypercare activities during critical releases and migrations.
Ensure data governance, security, documentation, and compliance standards.
Mentor data engineers and provide technical guidance across projects.
Mandatory Skills
Advanced SQL
Azure Data Factory (ADF)
Azure Databricks / Microsoft Fabric
PySpark
Delta Lake
Medallion Architecture
Data Migration
Data Modeling
Production Support / L2-L3 Support
RCA & Job Failure Troubleshooting
On-call Support & Hypercare
Qualification
Bachelor’s or Master’s degree in Computer Science, Information Technology, Engineering, or a related field.
Ideal Candidate
10+ years of experience in Data Engineering with strong Azure expertise.
Proven experience handling enterprise-scale data platforms and production environments.
Solid problem-solving, troubleshooting, communication, and mentoring skills.
Pay: ₹500,000.00 - ₹1,100,000.00 per year
Benefits:
Provident Fund
Work Location: In person
📌 Lead Data Engineer Kochi
🏢 AVISOFT
📍 Kochi