Job Summary Job Title: Data Engineering - Technical Architect (Azure & Databricks)

Experience: 12 Years

Location: Noida / Hyderabad

Role Overview We are looking for a highly experienced Data Engineering Technical Architect with deep expertise in Azure cloud and Databricks to design, build, and scale modern data platforms. The ideal candidate will lead architecture decisions, drive data modernization initiatives, and enable advanced analytics capabilities across the enterprise.

Key Responsibilities

- Architect and design modern data platforms on Azure leveraging Databricks Lakehouse architecture
- Define and implement end-to-end data pipelines (batch real-time ingestion, transformation, and serving layers)
- Lead the design of scalable, high-performance data solutions using Azure services
- Build and optimize ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks
- Develop and enforce data architecture standards, governance, and best practices
- Design and implement data models (Dimensional, Data Vault, Medallion/Lakehouse architecture)
- Drive data platform modernization initiatives (on-prem to Azure migration)
- Collaborate with stakeholders to translate business requirements into technical solutions
- Ensure data quality, lineage, governance, and security compliance
- Optimize performance of large-scale distributed data processing systems
- Lead technical teams, provide mentorship, and conduct architecture reviews
- Enable CI/CD pipelines and DevOps practices for data engineering workflows
- Evaluate new tools/technologies and drive innovation

Required Skills &

• Qualifications

Azure Data Engineering Expertise

- Strong hands-on experience in:
- Azure Data Factory (ADF)
- Azure Databricks (PySpark, Spark SQL)
- Azure Data Lake Storage (ADLS Gen2)
- Azure Synapse Analytics

- Experience with Delta Lake, Lakehouse architecture, and Medallion design (Bronze/Silver/Gold layers)

Databricks &

• Big Data

- Deep expertise in:
- Apache Spark (PySpark/Scala)




- Databricks workflows, jobs, clusters, notebooks
- Performance tuning and optimization in distributed environments

- Experience with streaming frameworks (Structured Streaming, Kafka/Event Hub)

Data Engineering &

• Architecture

- Strong experience in data warehousing concepts and data modeling
- Expertise in ETL/ELT frameworks and pipeline orchestration
- Advanced SQL skills across platforms (Synapse, SQL Server, Snowflake, Teradata preferred)
- Experience designing real-time and batch data pipelines

Programming &

• DevOps

- Proficiency in:
- Python (mandatory)
- SQL and optionally Scala

- Experience with:

- Git, CI/CD pipelines (Azure DevOps)
- Infrastructure as Code (ARM templates, Terraform - good to have)

Data Governance &

• Security

- Robust understanding of:
- Data governance frameworks
- Data lineage & cataloging (Purview preferred)
- Access control, security, and compliance models in Azure

Leadership &

• Architecture Skills

- Proven experience in enterprise-scale solution architecture
- Ability to define technical roadmaps and architecture strategy
- Strong stakeholder management and cross-team collaboration
- Experience leading large data engineering teams

Soft Skills

- Excellent communication and presentation skills
- Strong analytical and problem-solving capabilities
- Leadership mindset with mentoring ability
- Ability to work in a fast-paced, agile environment

Education

- Bachelor's or Master's degree in Computer Science, Engineering, or related field

Preferred Qualifications

- Azure certifications such as:
- AZ-305 (Azure Solutions Architect)
- DP-203 (Data Engineer Associate)

- Experience in multi-cloud or hybrid architectures
- Exposure to BI tools (Power BI preferred)
- Experience with enterprise data platforms or large transformation programs

Why Join Us

- Work on cutting-edge Azure &

• Databricks data platforms

- Opportunity to lead large-scale data transformation initiatives
- Collaborate with high-performing teams in a growth-focused environment

📌 Senior Technical Architect (India)
🏢 HCL Technologies
📍 India