03 Sep
|
Lorven Technologies
|
India
03 Sep
Lorven Technologies
India
Job Type: Full-time
Job Description – Azure Data EngineerJob Title: Azure Data Engineer Experience: 6+ Years Location: Chennai Employment Type: Full time / FTEJob SummaryWe are looking for an experienced Azure Data Engineer with 6+ years of hands-on experience in designing, developing, and maintaining scalable data engineering solutions using Python, Apache Spark, Azure Databricks, and Snowflake. The ideal candidate should have strong expertise in data processing, ETL/ELT pipelines, data transformation, and cloud-based data platforms.Key ResponsibilitiesDesign, develop, and maintain scalable data pipelines and ETL/ELT workflows on Azure.Develop data processing and transformation solutions using Python and Apache Spark.Build and optimize data engineering workloads using Azure Databricks.Develop PySpark applications for large-scale data processing and transformation.Design and implement data ingestion pipelines from multiple structured and unstructured sources.Work with Snowflake for data loading, transformation, data modeling, and performance optimization.Implement data integration between Azure Databricks and Snowflake.Perform data cleansing,
validation, transformation, and quality checks.Optimize Spark jobs, Databricks notebooks, SQL queries, and data pipelines for performance and scalability.Develop reusable frameworks and components for data processing and ingestion.Troubleshoot data pipeline failures, performance issues, and data quality problems.Collaborate with Data Architects, Analysts, Developers, and business stakeholders to understand data requirements.Follow best practices for data security, governance, monitoring, and operational support.Participate in code reviews, technical documentation, testing, and deployment activities.Mandatory Skills6+ years of experience in Data EngineeringPython – StrongApache Spark / PySpark – StrongAzure Databricks – StrongSnowflake – StrongStrong experience in ETL/ELT and data pipeline developmentStrong SQL and data transformation skillsExperience working with large-scale datasets and distributed data processingGood understanding of Azure cloud data engineering concepts
📌 Data Engineer (India)
🏢 Lorven Technologies
📍 India