12 Oct
|
Infosys
|
Chennai
Experience: 3-5 Years
Location: PAN India
Employment Type: Full time
- Administer and maintain Databricks workspaces across development, testing, and production environments.
- Manage Databricks clusters, cluster policies, pools, jobs, and notebooks.
- Configure and maintain user access, RBAC, Unity Catalog, and security policies.
- Monitor platform health, cluster utilization, job performance, and resource consumption.
- Troubleshoot Databricks platform issues and provide timely resolution.
- Implement best practices for governance, security, compliance, and cost optimization.
- Manage integrations with cloud services such as Azure AD, AWS IAM, Key Vault, Secrets Manager, and cloud storage.
- Support CI/CD implementations using Azure DevOps, GitHub Actions, or Jenkins.
- Collaborate with Data Engineers, Data Scientists, and DevOps teams to ensure platform stability and scalability.
- Perform workspace migrations, upgrades, and environment setup activities.
- Create and maintain operational documentation, runbooks, and SOPs.
Required Skills
- 35 years of experience in Databricks administration and support.
- Strong knowledge of Databricks workspace management, clusters, jobs, and notebooks.
- Experience with Unity Catalog, Data Governance, and Security Administration.
- Hands-on experience with Azure Databricks, AWS Databricks, or GCP Databricks.
- Knowledge of Spark, PySpark, and SQL.
- Experience with cloud platforms (Azure/AWS/GCP).
- Understanding of IAM, RBAC, SSO, SCIM provisioning, and access management.
- Experience in monitoring and troubleshooting distributed data platforms.
- Familiarity with Git, CI/CD pipelines, and Infrastructure as Code concepts.
- Good understanding of data lake and cloud storage technologies.
📌 Databricks admin (Chennai)
🏢 Infosys
📍 Chennai