We use cookies for the best user experience on our website, including to personalize content & offerings, to provide social media features and to analyze traffic. By clicking “Accept All Cookies” you agree to our use of cookies. You can also manage your cookies by clicking on the "Cookie Preferences" and selecting the categories you would like to accept. For more information on how we use cookies please visit our and Modify Cookie Preferences

Reject All Cookies Accept All Cookies

Senior Data Lead - Azure Data Factory (ADF), Databricks

United Arab Emirates

Job Description

Senior Data Lead - Azure Data Factory (ADF), Databricks

Others, Dubai

Job Summary

Data Engineers with engineering skills to build pipelines within the analytics platforms, moving ingested data from raw to modelled and ultimately to dimensional models that can be accessed by BI tools or ML models. Primary duties include:

Build data pipelines for complex sized Data and Analytics solutions (e.g. Data Lake, Data Warehouse, Business Intelligence Dashboards) in a team. Translate functional and non-functional data and analytics requirements into fit for purpose technical design. Ensure solution performance, business edge cases and security related issues are addressed while developing software.

Debug issues of complexity, resolve blockers and follow design documents with minimal supervision. This includes Production incidents.

Complete data engineering coding tasks on problems of moderate to high scope and complexity. Demonstrate good coding principles. Conduct code review for peers. Ensure solutions adhere to published data privacy and cybersecurity principles.

Work with senior and lead data engineers in the technical design process by contributing to the analysis of data application, data integration, large data storage or data pipeline requirements.

Update data inventories and registries as required to keep metadata and data lineage up to date, following agreed Data Governance standards, guidelines and principles.

Carry out unit testing independently. Troubleshoot issues, and fix defects that are of moderate to high complexity.

Shadow lead data engineers on design and architecture components and collaborate with members of the cross-functional team to identify areas of inefficiency and propose solutions.

Adhere to published coding standards, guidelines and best practices and contribute to Data Engineering Playbooks and other data technology blueprints.

Required technical skills: Microsoft Azure and Cloudera technology stacks, Hadoop, Spark, Scala, Hive, H-Base, Sqoop, Oozie, Apache Nifi, Airflow, HDFS, ADLS (Gen 2), Azure Data Factory (ADF), DataBricks, Kafka, Elasticsearch, AVRO / PARQUET file formats, Streaming (e.g. Spark Streaming), SnapLogic, TIBCO, Kafka, Snowflake, SQL, MicroStrategy, Power BI, GIT Bitbucket, Azure DevOps. Note - stronger Data Engineers will have some expertise with all these tools, but even familiarity with some is good to build parts of the pipeline (e.g. Data Engineers with Snowflake/Power BI skills can focus on DW/BI portions, while those with Spark/Scala skills can focus on data ingestion and data product transformations).

Team player:



good attitude and willingness to learn and adapt.

Familiar with Agile and Waterfall methodologies.

8 years of focused experience on end-to-end data engineering.

Key Responsibilities

1. Lead and manage technical teams, providing guidance and support in the implementation of snowflake, azure data factory (adf), and data bricks projects.
2. Design, develop, and maintain data pipelines using snowflake, azure data factory (adf), and data bricks to support business requirements.
3. Work closely with stakeholders to gather requirements, identify opportunities for data analytics, and propose data driven solutions.
4. Monitor and troubleshoot data pipelines, ensuring data quality, reliability, and performance.
5. Stay updated with the latest trends and technologies in data management and analytics, incorporating best practices into projects.
6. Collaborate with cross functional teams to integrate data solutions with existing systems and applications.
7. Provide technical expertise and mentorship to team members, promoting a culture of learning and innovation.

Skill Requirements

1. Proficiency in snowflake, including data modeling, querying, and performance optimization.
2. Strong experience in azure data factory (adf) for data integration and orchestration.
3. Handson knowledge of data bricks for data engineering, data processing, and machine learning.
4. Ability to design, develop, and optimize complex data pipelines for etl processes.
5. Strong problem-solving skills and the ability to troubleshoot data pipeline issues.
6. Excellent communication skills to interact with technical and nontechnical stakeholders effectively.
7. Strong leadership skills to guide and motivate technical teams towards project delivery and success.
8. Experience in agile methodologies and project management practices for productive project execution.

Other Requirements

1.Relevant certifications in Snowflake, Azure Data Factory (ADF), DataBricks are a plus.

Information at a Glance

Why HCLTech?

At HCLTech, you'll supercharge your potential. You'll find your career. And you'll find your spark. All at a place that knows that helping its customers stay on top starts by putting its people first.

HCLTech is a global technology company, home to more than 223,000 people across 60 countries, delivering industry-leading capabilities centered around digital, engineering, cloud and AI, powered by a broad portfolio of technology services and products. We work with clients across all major verticals, providing industry solutions for Financial Services, Manufacturing, Life Sciences and Healthcare, Technology and Services, Telecom and Media, Retail and CPG, and Public Services. Consolidated revenues as of 12 months ending June 2026 totaled $14.8 billion.





Copyright © 2026 HCL Technologies Limited

×

Cookie Consent Manager

When you visit any website, it may store or retrieve information on your browser, mostly in the form of cookies. Because we respect your right to privacy, you can choose not to allow some types of cookies. However, blocking some types of cookies may impact your experience of the site and the services we are able to offer.

Required Cookies

These cookies are required to use this website and can't be turned off.

Required Cookies

Show More Details

Required Cookies Provider Description Enabled
SAP as service provider

We use the following session cookies, which are all required to enable the website to function:

- "route" is used for session stickiness
- "careerSiteCompanyId" is used to send the request to the correct data center
- "JSESSIONID" is placed on the visitor's device during the session so the server can identify the visitor
- "Load balancer cookie" (actual cookie name may vary) prevents a visitor from bouncing from one instance to another

Cookies from provider SAPasserviceprovider are required and cannot be turned off

Functional Cookies

These cookies provide a better customer experience on this site, such as by remembering your login details, optimizing video performance, or providing us with information about how our site is used. You may freely choose to accept or decline these cookies at any time. Note that certain functionalities that these third-parties make available may be impacted if you do not accept these cookies.

Consent to all Functional Cookies

Show More Details

Functional Cookies Provider Description Enabled
Vimeo

Vimeo is a video hosting, sharing, and services platform focused on the delivery of video. Opting out of Vimeo cookies will disable your ability to watch or interact with Vimeo videos.

Consent to cookies from provider Vimeo

YouTube

YouTube is a video-sharing service where users can create their own profile, upload videos, watch, like, and comment on videos. Opting out of YouTube cookies will disable your ability to watch or interact with YouTube videos.

Consent to cookies from provider YouTube

Advertising Cookies

These cookies serve ads that are relevant to your interests. You may freely choose to accept or decline these cookies at any time. Note that certain functionality that these third parties make available may be impacted if you do not accept these cookies.

Consent to all Advertising Cookies

Show More Details

Advertising Cookies Provider Description Enabled
Google Analytics

Google Analytics is a web analytics service offered by Google that tracks and reports website traffic.

Consent to cookies from provider GoogleAnalytics

Google Tag Manager

Google Tag Manager is a tag management system for conversion tracking, site analytics, remarketing, and more.

Consent to cookies from provider GoogleTagManager

LinkedIn

LinkedIn is an employment-oriented social networking service. We use the Apply with LinkedIn feature to allow you to apply for jobs using your LinkedIn profile. Opting out of LinkedIn cookies will disable your ability to use Apply with LinkedIn.

📌 Senior Data Lead - Azure Data Factory (ADF), Databricks (India)
🏢 HCLTech
📍 India