13 Aug
|
Tata Consultancy Services
|
Bengaluru
13 Aug
Tata Consultancy Services
Bengaluru
We are seeking an experienced Senior Azure Data Engineer with solid expertise in Azure Data Factory (ADF), Data Flows, Azure Databricks, and CI/CD pipeline development. The ideal candidate will be responsible for designing and developing scalable data ingestion and transformation solutions while supporting enterprise data architecture initiatives within a banking environment.
Key Responsibilities
- Design, develop, and maintain enterprise-scale data pipelines using Azure Data Factory (ADF), Data Flows, and Azure Databricks.
- Build and support CI/CD pipelines for data engineering solutions.
- Develop robust data ingestion frameworks to process data from on-premises systems, cloud platforms, APIs, files, and databases.
- Implement data quality validation and monitoring controls across data pipelines.
- Work closely with Business Data Architects and Enterprise Architects to align solutions with target-state architecture.
- Support the design and implementation of data ingestion frameworks following banking and enterprise standards.
- Develop scalable, reusable,
and high-performance data engineering solutions.
- Guide and mentor team members on best practices, coding standards, and solution design principles.
- Collaborate with business and technology teams to gather requirements and deliver high-quality data solutions.
- Participate in Agile ceremonies including sprint planning, estimation, reviews, and retrospectives.
- Ensure compliance with security, governance, and data management standards.
Required Skills
- Strong hands-on experience with Azure Data Factory (ADF).
- Experience with Azure Data Flows and Azure Databricks.
- Expertise in building and maintaining data pipelines and ETL/ELT solutions.
- Experience building CI/CD pipelines for data platforms.
- Strong understanding of data ingestion from APIs, files, databases, and cloud/on-premise systems.
- Experience implementing data quality controls and validation frameworks.
- Knowledge of enterprise data arc
📌 Azure Data Engineer (Bengaluru)
🏢 Tata Consultancy Services
📍 Bengaluru