Key Responsibilities

- Design, develop, and implement scalable data pipelines using Azure cloud services.
- Build and maintain ETL/ELT workflows using Azure Data Factory (ADF).
- Develop and optimize data processing solutions using Azure Databricks and PySpark.
- Design and manage data lakes using Azure Data Lake Storage Gen2 (ADLS).
- Implement data warehousing solutions using Azure Synapse Analytics.
- Develop APIs and data integration solutions for structured and unstructured data sources.
- Optimize data models, data flows, and query performance.
- Collaborate with business stakeholders, data analysts, and data scientists to understand data requirements.
- Ensure data security, governance, and compliance using Azure best practices.
- Implement monitoring, logging, and troubleshooting mechanisms for data pipelines.
- Support CI/CD deployments using Azure DevOps.





Required Skills

Technical Skills

- 6+ years of experience in Data Engineering and Data Warehousing.
- Solid experience in:
- Azure Data Factory (ADF)
- Azure Databricks
- Azure Synapse Analytics
- Azure Data Lake Storage (ADLS Gen2)
- Azure SQL Database
- Azure Blob Storage

- Hands-on experience with PySpark, Python, and SQL.
- Experience working with Delta Lake and Lakehouse architecture.
- Knowledge of data modeling (Star Schema, Snowflake Schema).
- Familiarity with real-time data processing and streaming concepts.
- Experience with Azure Functions and Logic Apps is preferred.
- Working knowledge of Git and Azure DevOps

📌 Azure Data Engineer (Chennai)
🏢 Capgemini
📍 Chennai