Senior Technical Architect

Experience: 12 to Not Available years

Location: Gautam Buddha Nagar, India

Skills: Azure Data Engineering Expertise, Azure Data Factory (ADF), Azure Databricks (PySpark, Spark SQL), Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics, Delta Lake, Lakehouse architecture, Medallion design, Apache Spark (PySpark/Scala), Databricks workflows, jobs, clusters, notebooks, performance tuning, optimization in distributed environments, streaming frameworks, Structured Streaming, Kafka/Event Hub, data warehousing concepts, data modeling, ETL/ELT frameworks, pipeline orchestration, Advanced SQL skills, Synapse, SQL Server, Snowflake, Teradata, real-time data pipelines, batch data pipelines, Python, SQL, Scala, Git, CI/CD pipelines, Azure DevOps, Infrastructure as Code, ARM templates, Terraform, data governance frameworks, data lineage, cataloging, Purview, access control, security, compliance models in Azure, enterprise-scale solution architecture, technical roadmaps, architecture strategy, stakeholder management, cross-team collaboration, large data engineering teams, presentation skills, analytical skills, problem-solving capabilities, leadership mindset, mentoring ability, agile environment

Job Summary
Job Title: Data Engineering – Technical Architect (Azure & Databricks)

Role Overview
We are looking for a highly experienced Data Engineering Technical Architect with deep expertise in Azure cloud and Databricks to design, build, and scale modern data platforms. The ideal candidate will lead architecture decisions, drive data modernization initiatives, and enable advanced analytics capabilities across the enterprise.

Key Responsibilities
• Architect and design modern data platforms on Azure leveraging Databricks Lakehouse architecture
• Define and implement end-to-end data pipelines (batch + real-time ingestion, transformation,



and serving layers)
• Lead the design of scalable, high-performance data solutions using Azure services
• Build and optimize ETL/ELT pipelines using Azure Data Factory (ADF) and Databricks
• Develop and enforce data architecture standards, governance, and best practices
• Design and implement data models (Dimensional, Data Vault, Medallion/Lakehouse architecture)
• Drive data platform modernization initiatives (on-prem to Azure migration)
• Collaborate with stakeholders to translate business requirements into technical solutions
• Ensure data quality, lineage, governance, and security compliance
• Optimize performance of large-scale distributed data processing systems
• Lead technical teams, provide mentorship, and conduct architecture reviews
• Enable CI/CD pipelines and DevOps practices for data engineering workflows
• Evaluate recent tools/technologies and drive innovation

Required Skills & Qualifications
• Azure Data Engineering Expertise
• Strong hands-on experience in: Azure Data Factory (ADF), Azure Databricks (PySpark, Spark SQL), Azure Data Lake Storage (ADLS Gen2), Azure Synapse Analytics
• Experience with Delta Lake, Lakehouse architecture, and Medallion design (Bronze/Silver/Gold layers)
• Deep expertise in: Apache Spark (PySpark/Scala), Databricks workflows, jobs, clusters, notebooks
• Performance tuning and optimization in distributed environments




• Experience with streaming frameworks (Structured Streaming, Kafka/Event Hub)
• Strong experience in data warehousing concepts and data modeling
• Expertise in ETL/ELT frameworks and pipeline orchestration
• Advanced SQL skills across platforms (Synapse, SQL Server, Snowflake, Teradata preferred)
• Experience designing real-time and batch data pipelines
• Proficiency in: Python (mandatory), SQL and optionally Scala
• Experience with: Git, CI/CD pipelines (Azure DevOps), Infrastructure as Code (ARM templates, Terraform – good to have)
• Strong understanding of: Data governance frameworks, Data lineage & cataloging (Purview preferred), Access control, security, and compliance models in Azure
• Proven experience in enterprise-scale solution architecture
• Ability to define technical roadmaps and architecture strategy
• Strong stakeholder management and cross-team collaboration
• Experience leading large data engineering teams

Soft Skills
• Excellent communication and presentation skills
• Strong analytical and problem-solving capabilities
• Leadership mindset with mentoring ability
• Ability to work in a fast-paced, agile environment

Education
Bachelor’s or Master’s degree in Computer Science, Engineering, or related field

Preferred Qualifications
• Azure certifications such as: AZ-305 (Azure Solutions Architect), DP-203 (Data Engineer Associate)
• Experience in multi-cloud or hybrid architectures
• Exposure to BI tools (Power BI preferred)
• Experience with enterprise data platforms or large transformation programs

Why Join Us
• Work on cutting-edge Azure & Databricks data platforms
• Opportunity to lead large-scale data transformation initiatives
• Collaborate with high-performing teams in a growth-focused environment

📌 Senior Technical Architect (Noida)
🏢 HCL Technologies
📍 Noida