Job Title: Databricks Administrator
Experience: 5+ Years
Location: Pan India
Employment Type: Full-Time
Job Description
We are looking for an experienced Databricks Administrator with robust experience in AWS Databricks administration, cluster management, security, and workspace management.
Mandatory Skills
- 5+ years of experience as a Databricks Administrator
- Strong experience with AWS Databricks
- Databricks clusters, jobs, notebooks, repos, and workspaces
- Apache Spark, Delta Lake, and MLflow
- AWS IAM, S3, EC2, VPC, CloudWatch
- Python or Scala
- Databricks SQL
- Unity Catalog and access management
- Cloud networking and troubleshooting
- Terraform / CloudFormation / AWS CDK
- CI/CD for Databricks notebooks and pipelines
Responsibilities
- Manage and administer AWS Databricks workspaces.
- Manage and optimize clusters, jobs, and SQL warehouses.
- Manage users, permissions, security policies, and access controls.
- Monitor performance and troubleshoot issues.
- Automate deployments using Terraform or similar tools.
- Integrate Databricks with AWS services such as S3, Kinesis, Redshift, and Glue.
- Support development and engineering teams with Databricks-related issues.
- Ensure security and compliance standards are followed.
-