06 Sep
|
Lorven Technologies
|
Tamil Nadu
06 Sep
Lorven Technologies
Tamil Nadu
Job Description
Job Description – Azure Data Engineer
nJob Title: Azure Data Engineer
nExperience: 6+ Years
nLocation: Chennai
nEmployment Type: Full-Time / FTE
nJob Summary
nWe are looking for an experienced Azure Data Engineer with 6+ years of hands-on experience in designing, developing, and maintaining scalable data engineering solutions using Python, Apache Spark, Azure Databricks, and Snowflake. The ideal candidate should have strong expertise in data processing, ETL/ELT pipelines, data transformation, and cloud-based data platforms.
nKey Responsibilities
n
- n
- Design, develop, and maintain scalable data pipelines and ETL/ELT workflows on Azure.n
- Develop data processing and transformation solutions using Python and Apache Spark.n
- Build and optimize data engineering workloads using Azure Databricks.n
- Develop PySpark applications for large-scale data processing and transformation.n
- Design and implement data ingestion pipelines from multiple structured and unstructured sources.n
- Work with Snowflake for data loading, transformation, data modeling,
and performance optimization.n
- Implement data integration between Azure Databricks and Snowflake.n
- Perform data cleansing, validation, transformation, and quality checks.n
- Optimize Spark jobs, Databricks notebooks, SQL queries, and data pipelines for performance and scalability.n
- Develop reusable frameworks and components for data processing and ingestion.n
- Troubleshoot data pipeline failures, performance issues, and data quality problems.n
- Collaborate with Data Architects, Analysts, Developers, and business stakeholders to understand data requirements.n
- Follow best practices for data security, governance, monitoring, and operational support.n
- Participate in code reviews, technical documentation, testing, and deployment activities.n
nMandatory Skills
n
- n
- 6+ years of experience in Data Engineeringn
- Python – Solidn
- Apache Spark / PySpark – Strongn
- Azure D
📌 Data Engineer (Tamil Nadu)
🏢 Lorven Technologies
📍 Tamil Nadu