Senior Technical Lead Pune

Senior Technical Lead Pune

20 Nov
|
HCLTech
|
Pune

20 Nov

HCLTech

Pune

Job Summary

Data Engineer (Databricks) designs and maintains scalable, reliable data pipelines that transform raw data into analytics‑ready datasets for reporting and decision‑making. The role ensures high data quality, security, and performance across cloud‑based ETL workflows, while collaborating closely with analytics and business teams to enable trusted, data‑driven insights.

Key Responsibilities
Design, develop, and maintain scalable data pipelines and ETL processes
Implement ETL processes to ingest, transform, and load data from various sources
Ensure data quality, security, and compliance
Optimize and fine-tune data systems for performance and scalability
Develop and document data architecture and processes
Collaborate with data scientists and analysts to understand data requirements
Work closely with cross-functional teams to support data-driven decision-making
Monitor and troubleshoot data pipeline issues
Troubleshoot and resolve data-related issues and support users
Monitor ETL processes, proactively identifying and resolving issues or performance bottlenecks to maintain high system reliability.
Review data transformation and ingestion patterns, including CDC, schema evolution, and error handling for robust data operations.
Document ETL workflows,



data mappings, and process changes to ensure transparency and clear communication across technical and non-technical teams.
Stay updated with the latest features and best practices

Skill Requirements
Degree in Computer Science, Data Engineering, Information Technology or a related field
A minimum of 5 years of professional experience in data engineering or a related role
Proven experience as a Data Engineer with a focus on Databricks
Solid programming skills in SQL and Python
Experience with cloud computing platforms (preferably Microsoft Azure)
Ideally Experience with data virtualization tools (Denodo)
Solid problem-solving and analytical skills
Proficiency in CDC ingestion patterns (watermarks, change tables, log-based ingestion).
Advanced error handling & observability
Excellent communication and teamwork abilities
A passion for working with data and a desire to continuously learn and improve
Excellent English skills. German skills are a bonus
Microsoft Azure or Databricks certifications are a plus

Must Have Skill

Azure Databricks,PySpark,Agile Methodology

Positive to Have Skill

Other Requirements

📌 Senior Technical Lead Pune
🏢 HCLTech
📍 Pune

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior technical lead pune / pune

Subscribe to this job alert:

Get the latest job offers by email for: senior technical lead pune / pune