Shift time: 2 PM- 11PM IST

Location: Bangalore/PAN India - Remote

Job Summary

We are looking for an experienced Senior Databricks Platform Administrator to manage, administer, maintain, and optimize enterprise Databricks environments hosted on Microsoft Azure. The ideal candidate should have strong hands-on experience in Databricks workspace administration, Unity Catalog, cluster management, access governance, security, monitoring, troubleshooting, and platform operations.

The candidate will be responsible for ensuring platform stability, availability, performance, security, and operational efficiency while supporting enterprise data engineering and analytics teams.

Key Responsibilities

- Administer and manage enterprise Azure Databricks workspaces, environments, and platform configurations.
- Manage workspace provisioning, workspace settings, configurations, and administrative operations.
- Perform cluster creation, configuration, management, policy enforcement, autoscaling, and optimization.
- Manage Unity Catalog administration, including catalogs, schemas, tables, external locations, storage credentials, and permissions.
- Implement and maintain user access management, groups, service principals, RBAC, and authentication mechanisms.
- Manage identity integration with Microsoft Entra ID (Azure AD), SSO, SCIM provisioning, and service principals.
- Configure and maintain Databricks security, governance, access controls, and compliance standards.
- Monitor platform health, cluster utilization, job execution, performance, and resource consumption.
- Troubleshoot workspace issues, cluster failures, job failures, connectivity problems, and performance bottlenecks.
- Manage Databricks Runtime versions, upgrades, libraries, init scripts, and environment configurations.




- Administer secret scopes, Key Vault integration, storage access, and secure connectivity with Azure services.
- Support integration with Azure Data Lake Storage Gen2, Azure Key Vault, Azure Monitor, and other Azure-native services.
- Implement monitoring, logging, alerting, and operational support processes.
- Support platform automation and infrastructure management using Terraform, Azure DevOps, and GitHub workflows.
- Manage Databricks platform changes, maintenance activities, incident resolution, and operational documentation.
- Work closely with Data Engineering, Cloud Infrastructure, Security, and DevOps teams to ensure platform reliability.

Required Technical Skills
- 6+ years of experience in Cloud Administration, Platform Engineering, Cloud Operations, or Infrastructure Administration.
- 4+ years of hands-on experience administering and supporting enterprise Azure Databricks environments.
- Strong experience in Databricks Workspace Administration and platform operations.
- Hands-on experience with Unity Catalog administration and governance.
- Robust knowledge of Databricks cluster management, cluster policies, compute configurations, and Databricks Runtime.
- Experience managing users, groups, permissions, service principals, RBAC, and access controls.
- Experience with Microsoft Entra ID (Azure AD), SSO, SCIM, and identity management.
- Good understanding of Delta Lake, Apache Spark, and Lakehouse architecture.
- Experience integrating Databricks with Azure services such as ADLS Gen2, Key Vault, and Azure Monitor.
- Experience with monitoring, logging, troubleshooting, and platform performance optimization.
- Familiarity with Terraform, Azure DevOps, GitHub, and CI/CD automation.
- Understanding of cloud security, networking, private endpoints, and enterprise governance.

📌 Senior Databricks Platform Admin (Bengaluru)
🏢 Msys Softsol
📍 Bengaluru