- Manage Databricks Workspaces: Set up and maintain clusters, jobs, notebooks, and user access across multiple environments.
- RBAC: Implement and manage role-based access control (RBAC), workspace permissions, and data security policies.
- Cluster Configuration Optimization: Configure clusters for performance, cost-efficiency, and scalability based on workload requirements.
- Automation Scripting: Develop scripts (Python, Bash, PowerShell) to automate administrative tasks and streamline operations.
- Monitoring Troubleshooting: Monitor system performance, logs, and usage metrics; troubleshoot issues related to jobs, clusters, and user access.
- CICD Integration: Support integration of Databricks with DevOps pipelines using tools like Azure DevOps or Jenkins.
- Collaboration with Data Teams:
Work closely with data engineers, scientists, and analysts to support data workflows and resolve platform-related issues.
- Documentation SOPs: Create and maintain standard operating procedures, user guides, and platform documentation.
- Cloud Integration: Manage integration with cloud services (Azure, AWS, GCP) for storage, networking, and identity management.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.