Key Responsibilities:
- Develop and maintain scalable and efficient data pipelines to ensure seamless data flow across various systems adddress any issues or bottlenecks in existing pipelines.
- Implement robust data checks to ensure the accuracy and integrity of data. Summarize and validate large datasets to ensure they meet quality standards.
- Monitor data jobs for successful completion. Troubleshoot and resolve any issues that arise to minimize downtime and ensure continuity of data processes.
- Regularly review and audit data processes and pipelines to ensure compliance with internal standards and regulatory requirements
- Familiar with working on Agile methodologies - scrum, sprint planning, backlog refinement etc.
Candidate
Profile:
- 4-9 years experience on Data Engineering role working with Databricks & Azure Cloud technologies.
• Bachelors degree in computer science, Information Technology, or related field.
- Solid proficiency in PySpark, Python, SQL.
- Strong experience in data modeling, ETL/ELT pipeline development, and automation
- Hands-on experience with performance tuning of data pipelines and workflows • Proficient in working on Azure cloud components Azure Data Factory, Azure DataBricks, Azure Data Lake etc.
- Experience with data modeling, ETL processes, Delta Lake and data warehousing.
📌 Azure Databricks Data Engineer -Immediate Joiner (Bengaluru)
🏢 EXL
📍 Bengaluru