16 Nov
|
Capgemini
|
India
Job highlights
6+ years in Data Engineering with expertise in Azure Data Factory, Databricks, Synapse, ADLS Gen2, PySpark, and Delta Lake
Design and implement scalable data pipelines, develop ETL/ELT workflows, optimize data models, ensure data security and compliance, and support CI/CD deployments using Azure DevOps
Key Responsibilities
Design, develop, and implement scalable data pipelines using Azure cloud services.
Build and maintain ETL/ELT workflows using Azure Data Factory (ADF).
Develop and optimize data processing solutions using Azure Databricks and PySpark.
Design and manage data lakes using Azure Data Lake Storage Gen2 (ADLS).
Implement data warehousing solutions using Azure Synapse Analytics.
Develop APIs and data integration solutions for structured and unstructured data sources.
Optimize data models, data flows, and query performance.
Collaborate with business stakeholders, data analysts, and data scientists to understand data requirements.
Ensure data security,
governance, and compliance using Azure best practices.
Implement monitoring, logging, and troubleshooting mechanisms for data pipelines.
Support CI/CD deployments using Azure DevOps. Required Skills Technical Skills
6+ years of experience in Data Engineering and Data Warehousing.
Solid experience in:
Azure Data Factory (ADF)
Azure Databricks
Azure Synapse Analytics
Azure Data Lake Storage (ADLS Gen2)
Azure SQL Database
Azure Blob Storage
Hands-on experience with PySpark, Python, and SQL.
Experience working with Delta Lake and Lakehouse architecture.
Knowledge of data modeling (Star Schema, Snowflake Schema).
Familiarity with real-time data processing and streaming concepts.
Experience with Azure Functions and Logic Apps is preferred.
Working knowledge of Git and Azure DevOps
📌 Azure Data Engineer Delhi (India)
🏢 Capgemini
📍 India