09 Sep
|
Huquo Consulting
|
Gurugram
09 Sep
Huquo Consulting
Gurugram
Role & responsibilities
Key Responsibilities:
- Lead the end-to-end architecture and solution design for enterprise data platforms on Azure, with solid focus on Databricks Lakehouse, Delta Lake, and scalable cloud-native data ecosystems.
- Define target-state data architecture, ingestion patterns, transformation frameworks, and serving layers to support reporting, advanced analytics, ML, and business-critical decisioning use cases.
- Design and implement robust ETL/ELT pipelines using PySpark, SQL, Databricks Workflows, Auto Loader, and Delta Live Tables for batch and near real-time processing.
- Own architecture standards for data modeling, medallion design, reusable engineering patterns, CI/CD, code quality, environment strategy, and release management across Databricks solutions.
- Drive platform governance and security using Unity Catalog, RBAC/ABAC controls, lineage, auditability, and integration with enterprise governance services such as Purview.
- Optimize solution performance by tuning Spark workloads, cluster policies, partitioning strategy, file sizing, caching, and compute cost management for large-scale data processing.
Preferred candidate profile
📌 AVP Azure Data Architect (Gurugram)
🏢 Huquo Consulting
📍 Gurugram