Job Overview

We are looking for an experienced Senior Data Engineer with strong expertise in Microsoft Azure Data Services, SQL Server, and modern data engineering practices. The ideal candidate will be responsible for designing, developing, and maintaining scalable data pipelines, data warehouse solutions, and data integration frameworks.

The candidate should have hands-on experience with Azure Data Factory, Azure Databricks, Azure SQL, and Azure Data Lake Storage (ADLS), along with strong SQL and data optimization skills.

Experience in the financial services domain, particularly ACH transaction processing, financial data reconciliation, ledger-based systems, and banking integrations, will be highly valuable.

Key Responsibilities

- Design, develop, and maintain scalable and reliable data pipelines using Azure Data Factory, Azure Databricks, and other Azure data services.
- Build and optimize data warehouse solutions using Azure SQL, ADLS, Azure Functions, and related technologies.
- Design and implement efficient ETL/ELT processes to extract, transform, validate, and load data from multiple source systems.
- Analyze existing data architectures and recommend improvements to enhance performance, scalability, and operational efficiency.
- Work with large volumes of structured and unstructured data while ensuring data quality, accuracy, consistency, and integrity.
- Develop and optimize complex SQL queries, database structures, and data processing workflows.
- Perform data mapping, data migration, transformation, and validation across different databases and servers.
- Monitor, troubleshoot, and optimize data pipelines to ensure reliability, performance, and availability.
- Collaborate with onshore teams, product owners, business stakeholders,



and technical teams to understand requirements and translate them into technical solutions.
- Maintain data architecture and engineering practices in alignment with business requirements, security standards, and data governance policies.
- Collaborate with DevOps teams to implement CI/CD pipelines and automation practices for data engineering solutions.
- Participate in data architecture discussions, technical design reviews, and continuous improvement initiatives.
- Perform comprehensive testing and validation of data transformations, including data verification for machine learning and analytics use cases.
- Support financial data processing, reconciliation, and migration activities while ensuring accuracy and consistency across systems.

Required Skills & Qualifications

- 5–7 years of experience in Data Engineering, preferably working with Microsoft Azure data technologies.
- Solid hands-on experience with Azure Data Factory (ADF) and building complex ETL/ELT pipelines.
- Expertise in Azure SQL and advanced SQL programming, including query optimization and performance tuning.
- Strong experience with Azure Data Lake Storage (ADLS).
- Hands-on experience with Azure Databricks for large-scale data processing and transformation.
- Good understanding of data architecture, data modelling, and data design patterns.
- Experience in data ingestion, transformation, loading, migration,



validation, and performance optimization.
- Experience working with relational databases and handling large and complex datasets.
- Knowledge of Azure cloud services and DevOps/CI/CD frameworks.
- Experience working in an offshore-onshore delivery model and collaborating with geographically distributed teams.
- Strong analytical, problem-solving, communication, and stakeholder management skills.
- Ability to work independently, manage ambiguous requirements, and translate business needs into technical deliverables.
- Good understanding of Data Structures and Algorithms.

Good-to-Have Skills

- Experience with Microsoft Fabric and Power BI.
- Experience with Azure Functions.
- Knowledge of Infrastructure as Code (IaC), particularly Terraform.
- Experience implementing automation, configuration management, and CI/CD practices.
- Exposure to machine learning data pipelines and analytics solutions.

Experience in the Financial Services Domain (FSD), particularly:
- ACH transaction lifecycle, including debit, credit, returns, NOC, and settlement.
- Financial data reconciliation and ledger-based systems.
- Banking integrations and multi-bank processing workflows.
- Financial data migration and validation across databases and servers.
- Understanding of data conversions and their impact on financial servicing operations.

Mandatory Technical Skills

- Azure SQL
- Azure Data Factory (ADF)
- Azure Data Lake Storage (ADLS)
- Azure Databricks
- Data Design Patterns
- Advanced SQL and Query Optimization
- Preferred / Additional Skills
- Microsoft Fabric
- Power BI
- Azure DevOps / CI/CD
- Terraform / Infrastructure as Code
- Financial Services Domain Experience

📌 Senior Data Engineer(Azure) (Kerala)
🏢 techvantage.ai
📍 Kerala