Senior Data Lead - Azure Data Factory (ADF), Databricks

Experience: 6 to 8 years

Location: Noida, India

Skills: Azure, Databricks, Azure Data Factory, Python, Snowflake, AI, GitHub Copilot, M365 Copilot, Codex, Claude

Job Summary
We are looking for a Senior Data Engineer to work on client implementation projects, focused on big data transformation and cloud-native analytics solutions. The role involves designing and delivering scalable data pipelines and transformation frameworks using Azure, Databricks, Azure Data Factory, Python, and Snowflake, with growing adoption of AI‑assisted development tools such as GitHub Copilot, M365 Copilot, Codex, and Claude. The ideal candidate will have robust hands-on experience in modern data platforms and will contribute across design, development, and implementation phases.

Key Responsibilities
Work on end-to-end client implementation projects, delivering data transformation and analytics solutions.
• Design, build, and optimize big data transformation pipelines using Azure Databricks, Azure Data Factory, and Python.
• Develop and manage cloud-based data solutions leveraging Azure services and Snowflake.
• Implement scalable and performance-optimized data processing frameworks to support analytical workloads.
• Leverage AI-assisted development tools (GitHub Copilot, M365 Copilot, Codex, Claude) to improve productivity and code quality.
• Collaborate with client stakeholders,



architects, and cross-functional teams to understand requirements and deliver solutions aligned with business needs.
• Ensure adherence to best practices in data quality, security, and performance optimization.
• Participate in customer interviews, technical discussions, and solution walkthroughs.
• Support CI/CD practices and contribute to automated deployment and code quality processes.

Skill Requirements
• 6–8 years of experience in data engineering and big data transformation.
• Strong hands-on expertise with Microsoft Azure cloud services.
• Proven experience with Azure Databricks for large-scale data processing.
• Solid working knowledge of Azure Data Factory for data integration pipelines.
• Strong programming skills with Python for data transformation and automation.
• Experience with Snowflake for cloud data warehousing and analytics.
• Exposure to AI/ML frameworks for data-driven and intelligent solutions.
• Hands-on experience using GitHub Copilot and M365 Copilot for AI-assisted development.
• Hands-on experience with Codex and Claude for code generation and development productivity.
• Experience working on client-facing implementation projects with robust delivery focus.

Other Requirements
• Relevant certifications in Snowflake, Azure Data Factory (ADF), DataBricks are a plus.

📌 Senior Data Lead Azure Data Factory (ADF), Databricks (Noida)
🏢 HCL Technologies
📍 Noida