Bangalore, Karnataka
Job Summary

Job Title : Technical Lead – ETL / Data Engineering

Experience: 8–12 Years
Location: Bangalore
Domain: Insurance / Finance / Regulatory Data

We are looking for a Technical Lead – Data Engineering to drive technical diagnostics, optimization, and stabilization of enterprise data platforms supporting large-scale ETL and batch processing systems.

The role focuses on analyzing and improving ETL pipelines, batch orchestration, performance, and monitoring frameworks , with strong exposure to Azure data platforms and regulatory data environments.

Key Responsibilities
Lead technical diagnostics and root cause analysis across ETL pipelines, integration layers, batch orchestration, and platform dependencies
Review and optimize ADF pipelines, SSIS packages, and Databricks workflows for performance, scalability, and
Analyze batch scheduling and orchestration frameworks (Control-M / Autosys), including dependencies, triggers, and SLA adherence
Investigate and resolve pipeline failures, job delays, and runtime issues , ensuring faster recovery and minimal business
Evaluate source-to-target integration flows, SQL logic, and transformation layers for efficiency and correctness
Define and improve error handling, retry mechanisms, restart ability, and reprocessing strategies across ETL and batch
Optimize runtime performance of data pipelines , including query tuning and batch execution improvements




Establish and enhance monitoring and alerting frameworks using tools like Azure Monitor, Control-M dashboards, and custom logging solutions
Identify automation opportunities to reduce manual intervention and improve operational efficiency
Ensure data quality, consistency, and reliability across ETL processes and reporting outputs
Support modernization initiatives , including migration from legacy ETL (SSIS) to cloud-based platforms like Databricks
Collaborate with data engineers, architects, business, and support teams to drive improvements and ensure stable production systems
Skill Requirements

Required Skills & Experience: -

Robust expertise in: Azure Data Factory (ADF),Databricks (PySpark / Spark SQL preferred),SSIS and SQL Server
Hands-on experience with: Batch orchestration tools (Control-M / Autosys),ETL/ELT pipeline design and optimization
Strong experience in: SQL development and performance tuning, Troubleshooting and debugging complex data pipelines
Familiarity with: Monitoring and alerting tools (Azure Monitor, Log Analytics)
Experience in Finance / Insurance / Regulatory reporting platforms (IFRS17 preferred)
Exposure to large-scale data processing and batch system

#body.unify div.unify-button-container .unify-apply-now: focus, #body.unify div.unify-button-container .unify-apply-#body.unify div.unify-button-container .unify-apply-now: focus, #body.unify div.unify-button-container .unify-apply-

📌 Senior Technical Lead (India)
🏢 HCLTech
📍 India