10 Sep
|
Huquo Consulting
|
Gurugram
10 Sep
Huquo Consulting
Gurugram
Role & responsibilities
Key Responsibilities:
Lead the end-to-end architecture and solution design for enterprise data platforms on Azure, with solid focus on Databricks Lakehouse, Delta Lake, and scalable cloud-native data ecosystems.
Define target-state data architecture, ingestion patterns, transformation frameworks, and serving layers to support reporting, advanced analytics, ML, and business-critical decisioning use cases.
Design and implement robust ETL/ELT pipelines using PySpark, SQL, Databricks Workflows, Auto Loader, and Delta Live Tables for batch and near real-time processing.
Own architecture standards for data modeling, medallion design, reusable engineering patterns, CI/CD, code quality, setting strategy, and release management across Databricks solutions.
Drive platform governance and security using Unity Catalog, RBAC/ABAC controls, lineage, auditability, and integration with enterprise governance services such as Purview.
Optimize solution performance by tuning Spark workloads, cluster policies, partitioning strategy, file sizing, caching, and compute cost management for large-scale data processing.
Preferred candidate profile
📌 Avp Azure Data Architect Gurugram
🏢 Huquo Consulting
📍 Gurugram