– Azure Data Engineer

Job Title: Azure Data Engineer

Experience: 6+ Years

Location: Chennai

Employment Type: Full-Time / FTE

Job Summary

We are looking for an experienced Azure Data Engineer with 6+ years of hands-on experience in designing, developing, and maintaining scalable data engineering solutions using Python, Apache Spark, Azure Databricks, and Snowflake. The ideal candidate should have strong expertise in data processing, ETL/ELT pipelines, data transformation, and cloud-based data platforms.

Key Responsibilities

- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on Azure. - Develop data processing and transformation solutions using Python and Apache Spark. - Build and optimize data engineering workloads using Azure Databricks. - Develop PySpark applications for large-scale data processing and transformation. - Design and implement data ingestion pipelines from multiple structured and unstructured sources. - Work with Snowflake for data loading, transformation, data modeling, and performance optimization. - Implement data integration between Azure Databricks and Snowflake. - Perform data cleansing, validation, transformation,



and quality checks. - Optimize Spark jobs, Databricks notebooks, SQL queries, and data pipelines for performance and scalability. - Develop reusable frameworks and components for data processing and ingestion. - Troubleshoot data pipeline failures, performance issues, and data quality problems. - Collaborate with Data Architects, Analysts, Developers, and business stakeholders to understand data requirements. - Follow best practices for data security, governance, monitoring, and operational support. - Participate in code reviews, technical documentation, testing, and deployment activities.

Mandatory Skills

- 6+ years of experience in Data Engineering - Python – Strong - Apache Spark / PySpark – Strong - Azure Databricks – Solid - Snowflake – Strong - Strong experience in ETL/ELT and data pipeline development - Strong SQL and data transformation skills - Experience working with large-scale datasets and distributed data processing - Positive understanding of Azure cloud data engineering concepts

📌 Data Engineer (Chennai)
🏢 Lorven Technologies
📍 Chennai