09 Sep
|
Lorven Technologies
|
Chennai
09 Sep
Lorven Technologies
Chennai
– Azure Data Engineer /n Job Title: Azure Data Engineer /n Experience: 6+ Years /n Location: Chennai /n Employment Type: Full time / FTE /n Job Summary /n We are looking for an experienced Azure Data Engineer with 6+ years of hands-on experience in designing, developing, and maintaining scalable data engineering solutions using Python, Apache Spark, Azure Databricks, and Snowflake . The ideal candidate should have strong expertise in data processing, ETL/ELT pipelines, data transformation, and cloud-based data platforms. /n Key Responsibilities /n /n
Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on Azure.
/n
Develop data processing and transformation solutions using Python and Apache Spark .
/n
Build and optimize data engineering workloads using Azure Databricks .
/n
Develop PySpark applications for large-scale data processing and transformation.
/n
Design and implement data ingestion pipelines from multiple structured and unstructured sources.
/n
Work with Snowflake for data loading, transformation, data modeling, and performance optimization.
/n
Implement data integration between Azure Databricks and Snowflake .
/n
Perform data cleansing, validation, transformation,
and quality checks.
/n
Optimize Spark jobs, Databricks notebooks, SQL queries, and data pipelines for performance and scalability.
/n
Develop reusable frameworks and components for data processing and ingestion.
/n
Troubleshoot data pipeline failures, performance issues, and data quality problems.
/n
Collaborate with Data Architects, Analysts, Developers, and business stakeholders to understand data requirements.
/n
Follow best practices for data security, governance, monitoring, and operational support.
/n
Participate in code reviews, technical documentation, testing, and deployment activities.
/n /n Mandatory Skills /n /n
6+ years of experience in Data Engineering
/n
Python – Strong
/n
Apache Spark / PySpark – Strong
/n
Azure Databricks – Strong
/n
Snowflake – Strong
/n
Robust experience in ETL/ELT and data pipeline development
/n
Strong SQL and data transformation skills
/n
Experience working with large-scale datasets and distributed data processing
/n
Valuable understanding of Azure cloud data engineering concepts
/n
📌 Data Engineer Chennai
🏢 Lorven Technologies
📍 Chennai