Role Description

- Strong expertise in SQL for complex query development, data extraction, transformation, analysis, and performance optimization.
- Proficient in Python programming for data processing, automation, data cleansing, transformation, and aggregation tasks.
- Hands-on experience with Microsoft Azure, including Azure Data Factory (ADF) and Azure Databricks for building scalable data solutions.
- Experience developing and managing ETL/ELT pipelines to integrate data from databases, APIs, and other structured and unstructured sources.
- Robust knowledge of Databricks and Apache Spark for large-scale data processing, engineering workflows, and notebook-based development.
- Skilled in ensuring data quality, integrity, and governance, including troubleshooting and resolving data-related issues across enterprise platforms.
- Proven ability to collaborate with business stakeholders, analysts, and data scientists to deliver data-driven solutions while maintaining and optimizing existing pipelines and reporting platforms.

Skills SQL, Apache Spark, Microsoft Azure, Databricks

📌 Lead I - Data Engineering (Thiruvananthapuram)
🏢 UST
📍 Thiruvananthapuram