10 Oct
|
WhiteSlips Job Management Consultants
|
Pune
10 Oct
WhiteSlips Job Management Consultants
Pune
Architect end-to-end cloud-native data platforms using Azure services, including Azure Data Lake Storage Gen2, Azure Databricks, Azure Synapse, Azure SQL, Azure Data Factory, and Event/Service Bus.
Define and implement data modeling standards, including dimensional, canonical, and domain-driven designs.
Design Delta Lake architectures, including medallion (Bronze–Silver–Gold) frameworks.
Develop scalable and secure ETL/ELT pipelines using Databricks (PySpark/Spark SQL).
Databricks & Delta Lake Engineering
Implement Delta Lake best practices, including OPTIMIZE, ZORDER, Change Data Feed (CDF), schema evolution, and table versioning.
Optimize Spark workloads for performance, cost, and cluster utilization.
Lead governance implementation using Unity Catalog, including permissions, data lineage, and metadata modeling.
Azure Data Ecosystem Integration
Integrate solutions across Azure Data Factory, Synapse Pipelines, Event Hubs, Functions, Key Vault,
Azure DevOps, and Purview.
Drive CI/CD and Infrastructure-as-Code using Terraform, Bicep, or ARM templates.
Build APIs and microservices supporting data consumption.
Data Governance & Security
Define policies for data quality, master data management, metadata, and data lifecycle management.
Ensure GDPR-compliant data design, encryption (KMS/Key Vault), RBAC/ABAC, and secure network architecture.
Establish frameworks for observability, including logging, monitoring, and alerting.
Stakeholder Leadership
Collaborate with business, product owners, engineers, and analysts to gather data requirements.
Lead architectural reviews and provide long-term technology strategy.
Mentor engineering teams on Azure, Databricks, and scalable data design principles.
📌 Lead Solutions Architect Pune
🏢 WhiteSlips Job Management Consultants
📍 Pune