13 Aug
|
Birlasoft
|
Noida
Area(s) of responsibility
Job Description: Cloud Data Platform Engineer / SRE (Azure | Databricks | Fabric | Unity Catalog)
_________________
Key Responsibilities
- Cloud Platform Operations
- Manage and optimize Azure workloads—ADLS, VNets, Key Vault, ADF, Synapse, Fabric, Databricks.
- Configure and maintain Databricks clusters, jobs, DLT pipelines, Delta Lake storage, and Unity Catalog policies.
- Operationalize Fabric Lakehouses, Pipelines, Warehouses, and Semantic Models for production workloads.
- Ensure robust platform governance across environments (DEV–QA–UAT–PROD).
- Infrastructure as Code & CI/CD
- Build and maintain Terraform/Bicep templates for workplace provisioning and configuration.
- Develop end-to-end CI/CD pipelines for Databricks, Fabric, and Azure components (ADO/GitHub).
- Automate deployment of notebooks, workflows, access policies, networking components, and Fabric artifacts.
- Enforce version control, release governance, and quality gates.
- FinOps, Cost Management & Capacity Planning
- Implement FinOps dashboards, alerts, budgets,
and spend governance practices.
- Perform Databricks and Fabric cost optimization—cluster sizing, autoscaling, idle management, job tuning.
- Conduct capacity planning for compute, storage, Fabric engines, and Databricks workloads.
- Develop cost-saving recommendations and automated consumption monitoring.
- Environment Management, Security & Governance
- Provision and manage Azure data environments with consistent policies and naming standards.
- Configure RBAC, ACLs, Unity Catalog grants, service principals, network security, Managed Identities.
- Implement governance standards for data access, lineage, audit logging, compliance, and risk mitigation.
- Ensure secure connectivity using Private Endpoints, VNET integration, and enterprise IAM controls.
- Monitoring, Observability & Platform Reliability (SRE)
- Implement monitoring and alerting using Azure Monitor, Log Analytics, Databricks Met
📌 Cloudops (Noida)
🏢 Birlasoft
📍 Noida