Key Responsibilities:
• Develop and maintain scalable and efficient data pipelines to ensure seamless data flow across various systems adddress any issues or bottlenecks in existing pipelines.
• Implement robust data checks to ensure the accuracy and integrity of data. Summarize and validate large datasets to ensure they meet quality standards.
• Monitor data jobs for successful completion. Troubleshoot and resolve any issues that arise to minimize downtime and ensure continuity of data processes.
• Regularly review and audit data processes and pipelines to ensure compliance with internal standards and regulatory requirements
• Familiar with working on Agile methodologies - scrum, sprint planning, backlog refinement etc. Candidate Profile:
• 4-9 years experience on Data Engineering role working with Databricks & Azure Cloud technologies.
• Bachelors degree in computer science, Information Technology, or related field.
• Solid proficiency in PySpark, Python, SQL.
• Strong experience in data modeling, ETL/ELT pipeline development, and automation
• Hands-on experience with performance tuning of data pipelines and workflows • Proficient in working on Azure cloud components Azure Data Factory, Azure DataBricks, Azure Data Lake etc.
• Experience with data modeling, ETL processes, Delta Lake and data warehousing.
📌 Azure Databricks Data Engineer -Immediate Joiner (Gurugram)
🏢 EXL
📍 Gurugram