09 Oct
|
WhiteSlips Job Management Consultants
|
Pune
09 Oct
WhiteSlips Job Management Consultants
Pune
- Architect end-to-end cloud-native data platforms using Azure services, including Azure Data Lake Storage Gen2, Azure Databricks, Azure Synapse, Azure SQL, Azure Data Factory, and Event/Service Bus.
- Define and implement data modeling standards, including dimensional, canonical, and domain-driven designs.
- Design Delta Lake architectures, including medallion (Bronze–Silver–Gold) frameworks.
- Develop scalable and secure ETL/ELT pipelines using Databricks (PySpark/Spark SQL).
- Databricks & Delta Lake Engineering
- Implement Delta Lake best practices, including OPTIMIZE, ZORDER, Change Data Feed (CDF), schema evolution, and table versioning.
- Optimize Spark workloads for performance, cost, and cluster utilization.
- Lead governance implementation using Unity Catalog, including permissions, data lineage, and metadata modeling.
- Azure Data Ecosystem Integration
- Integrate solutions across Azure Data Factory, Synapse Pipelines, Event Hubs, Functions, Key Vault,
Azure DevOps, and Purview.
- Drive CI/CD and Infrastructure-as-Code using Terraform, Bicep, or ARM templates.
- Build APIs and microservices supporting data consumption.
- Data Governance & Security
- Define policies for data quality, master data management, metadata, and data lifecycle management.
- Ensure GDPR-compliant data design, encryption (KMS/Key Vault), RBAC/ABAC, and secure network architecture.
- Establish frameworks for observability, including logging, monitoring, and alerting.
- Stakeholder Leadership
- Collaborate with business, product owners, engineers, and analysts to gather data requirements.
- Lead architectural reviews and provide long-term technology strategy.
- Mentor engineering teams on Azure, Databricks, and scalable data design principles.
📌 Lead Solutions Architect (Pune)
🏢 WhiteSlips Job Management Consultants
📍 Pune