Education: BE/B.Tech/ME/M.Tech/MCA/M.Sc graduates only
Job Summary
We are looking for an experienced Data Engineer with robust hands-on expertise in Azure Services, Python, PySpark, ETL development, and SQL. The ideal candidate should have experience building and optimizing data pipelines, managing large datasets, and implementing data governance and data quality solutions using tools such as Soda and Alation.
Key Responsibilities
• Design, develop, and maintain scalable data pipelines using Azure services, Python, and PySpark.
• Build and optimize ETL/ELT processes for data extraction, transformation, and loading.
• Write complex SQL queries and optimize database performance.
• Develop data processing solutions using PySpark for large-scale datasets.
• Implement data quality checks, monitoring, and validation using Soda.
• Support data cataloging, metadata management, data lineage, and governance using Alation.
• Ensure data accuracy, consistency, security, and compliance with governance standards.
• Troubleshoot data pipeline failures and improve performance and reliability.
• Collaborate with data analysts, architects, and business stakeholders to deliver reliable data solutions.
Essential Skills
• Azure Services
• Python programming
• PySpark
• ETL/ELT development
• SQL
• Data governance and data quality tools such as Soda and Alation
📌 Data Engineer (Chennai)
🏢 SWITS DIGITAL Private
📍 Chennai
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.