19 Aug
|
Kasmoprav
|
India
We are looking for an experienced Databricks Platform & Infrastructure Engineer with robust expertise in Azure, Databricks, Unity Catalog, Terraform, networking, identity, security, and CI/CD.
The role is implementation-focused and will involve deploying, configuring, and supporting the Azure and Databricks platform capabilities required to establish a secure, scalable, and governed data platform using Unity Catalog.
The candidate will work from architect-defined designs and collaborate closely with Infrastructure, Security, Data Engineering, and Architecture teams.
Key ResponsibilitiesAzure Platform & Infrastructure
- Configure and manage Azure subscriptions, resource groups, and environment structures.
- Deploy and manage ADLS Gen2 storage accounts and supporting Azure services.
- Implement Infrastructure-as-Code using Terraform.
- Configure Azure DevOps projects, repositories, and deployment pipelines.
- Implement Development, Test, and Production environment separation.
- Configure platform monitoring, diagnostic logging, alerting, and operational dashboards.
Network Security & Identity
- Configure Microsoft Entra ID integration with Databricks and Unity Catalog.
- Implement RBAC and ABAC access control models.
- Configure Managed Identities, Service Principals, and authentication mechanisms.
- Configure Databricks networking including:
- VNet Injection
- Secure Cluster Connectivity
- Private connectivity
- Access Connectors
- Support Hub-and-Spoke networking patterns and enterprise security standards.
- Enable secure connectivity between Databricks, ADLS, source systems, and enterprise platforms.
- Collaborate with Infrastructure, Security, and Architecture teams for approvals and security compliance.
Databricks & Unity Catalog
- Deploy and configure Databricks accounts and workspaces.
- Configure Unity Catalog metastore, catalogs, schemas, and storage locations.
- Configure storage credentials and external locations.
- Implement Unity Catalog governance a
📌 Databricks Platform (India)
🏢 Kasmoprav
📍 India