Role: Lead Data Engineer
Team: Advanced Analytics
Location: Bangalore
Job Description
We are seeking a highly skilled Azure Data Engineer to join our Advanced Analytics Data Engineering
Team. The ideal candidate will possess a deep understanding of Azure Cloud, including Azure Data Factory (ADF),
Azure Databricks, Unity Catalog, and other Azure resources. This role entails designing and building robust data
pipelines, managing data storage solutions, and implementing data processing and analytics workflows that drive
insights for decision-making. The candidate must be inquisitive of trends in Data Engineering domain like real time
data processing, Data as a Product (DaaP), big data, data governance and security among others.
Responsibilities:
 Design and develop scalable and effective data pipelines using Azure Data Factory (ADF) to ingest, clean,
transform, and distribute data across various Azure services.
 Implement and maintain data lake architectures, ensuring data is structured for ease of access and analysis
using services such as Azure Data Lake Storage.




 Leverage Azure Databricks to perform big data processing and analytics, including batch and stream
processing, machine learning, and data exploration.
 Configure and manage Unity Catalog to organize data assets, enforce governance, and secure data access
across Azure Databricks workspaces.
 Collaborate with business stakeholders to understand data requirements and deliver solutions that align with
organizational goals and data strategies.
 Continuously optimize data engineering processes for performance, reliability, and cost-efficiency.
 Monitor and troubleshoot data pipelines to ensure seamless flow and availability of data.
 Keep oneself exposed to the latest Azure features and technologies, integrating them into solutions when
appropriate.
 Ensure data security and compliance with relevant data protection regulations.
 Document all aspects of the data engineering process, from pipeline design

📌 Lead Data Engineer (Bengaluru)
🏢 Scadea
📍 Bengaluru