Job Title

Senior Data Lead – Azure Data Factory (ADF), Databricks

Location

Bengaluru, India

Client Industry

Information Technology & Services

Introduction to the Organization

HCLTech is a global leader in technology and IT services, renowned for its innovative solutions and commitment to driving digital transformation across industries. With operations in over 50 countries, HCLTech empowers enterprises through cutting-edge technology, deep industry expertise, and a culture rooted in collaboration, integrity, and excellence. Its award-winning services span IT infrastructure, engineering, digital consulting, and next-generation technologies, positioning HCLTech as a trusted partner for Fortune 500 companies worldwide.

Overview of the Role The Senior Data Lead will play a pivotal role in designing, building, and optimizing scalable data solutions that fuel enterprise analytics and strategic decision-making. This position focuses on leveraging modern cloud platforms, automation, and data governance to ensure high-quality, reliable, and innovative data systems. The successful candidate will drive the evolution of HCLTech's data platforms, directly influencing the company’s ability to deliver advanced analytics and business intelligence capabilities.

Detailed Responsibilities

Build & Model Data Solutions: Design, develop, and maintain scalable data pipelines and models supporting analytics, reporting, and BI initiatives.

Data Ingestion & Transformation: Implement robust solutions for structured and unstructured data, ensuring quality, consistency, and reliability.

Automation & Deployment: Develop and manage fully automated CI/CD pipelines, enabling efficient testing, deployment, and monitoring of data solutions.

Infrastructure-as-Code: Lead deployment automation practices to ensure productive and reliable data delivery.

Innovation & Continuous Improvement:



Apply software engineering best practices to overcome complex data engineering challenges and introduce innovative solutions for large-scale data processing.

Platform Ownership: Optimize data platforms for scalability, performance, security, and reliability; monitor and troubleshoot pipelines, workflows, and platform components.

Data Governance & Compliance: Enforce data governance, compliance, and security standards throughout the data lifecycle.

Collaboration & Documentation: Establish data engineering standards, maintain clear technical documentation, and collaborate with cross-functional teams including Data Scientists, Analysts, Product Owners, and Architects.

Skill Requirement

Technical Skills

Strong proficiency in Python for data engineering and automation.

Extensive hands-on experience with Azure Databricks and modern data processing frameworks.

Deep expertise in Azure Cloud Services and cloud-native data architectures.

Solid understanding of Azure Data Factory (ADF), Snowflake, and related data warehousing platforms.

Proven experience with Azure DevOps, Git, and CI/CD pipeline implementation.

Competency in designing and maintaining scalable data pipelines and models.

Knowledge of ETL/ELT processes, data lifecycle management, and data governance best practices.

Professional Skills

Exceptional analytical and problem-solving abilities.

Software engineering mindset with focus on clean, maintainable, reusable code.

Strong troubleshooting and debugging skills.

Excellent communication and documentation capabilities.

Collaborative approach in agile, cross-functional environments.

Educational Background & Certifications

Bachelor’s or Master’s degree in Computer Science, Engineering, Information Technology, or related field.

Relevant certifications in Azure, Databricks, or data engineering are highly desirable.

Other Requirements (Optional)

Experience with enterprise-scale data platforms and processing large datasets.

Familiarity with Infrastructure-as-Code (IaC) and cloud automation practices.

Knowledge of monitoring, observability, and performance optimization techniques.

Experience in Agile/Scrum delivery models.

📌 Senior Data Consultant (Bengaluru)
🏢 HCLTech
📍 Bengaluru