Hello All,
Greetings from ZettaMine!!!
Job Title: AWS Databricks Platform Administration
Location: Pan India
Experience: 5 -10 Years
Notice Period: Immediate Joiners
Role Summary
We are looking for an experienced AWS Databricks Platform Administrator with 5 to 10 years of experience in cloud data platform administration and strong expertise in Databricks on AWS .
The role is responsible for managing, securing, automating, monitoring, and optimizing the Databricks platform to support enterprise-scale data engineering, analytics, and governance requirements.
The ideal candidate should have hands-on experience with AWS infrastructure, IAM, Unity Catalog, cost optimization, platform monitoring, automation, and production support .
Key Responsibilities
Databricks Platform Administration
- Administer and manage Databricks workspaces across AWS environments.
- Manage workspace configurations, users, groups, permissions, clusters, jobs, and platform settings.
- Define and maintain workspace standards, security controls, and operational best practices.
- Support Databricks platform upgrades, releases, and new feature enablement.
AWS Infrastructure & Security
- Configure and maintain secure access to data stored in Amazon S3 using IAM roles, instance profiles, and trust policies.
- Work with AWS services including IAM, S3, EC2, VPC, and CloudWatch .
- Implement appropriate security and access controls for Databricks and AWS resources.
- Troubleshoot networking, authentication, authorization, and storage access issues.
Unity Catalog & Data Governance
- Implement and administer Unity Catalog , including:
- Catalogs
- Schemas
- Tables
- Storage Credentials
- External Locations
- Manage access controls and permissions in accordance with enterprise security and governance standards.
- Support data governance, security, compliance, and access management initiatives.
Cluster & Cost Management
- Define and enforce Databricks cluster policies and workspace standards.
- Monitor cluster performance, resource utilization, usage trends, and platform health.
- Drive cost optimization through autoscaling, tagging, cluster policies, and resource controls .
- Support usage reporting and chargeback/showback initiatives.
Automation & Infrastructure as Code
- Automate Databricks platform provisioning and configuration using Terraform .
- Develop and maintain automation scripts using Python, Shell, or Bash .
- Implement repeatable and standardized platform administration processes.
- Support CI/CD and automated deployment processes for platform configuration changes.
Production Support & Troubleshooting
- Troubleshoot production issues related to:
- Databricks clusters
- Permissions and access
- S3/storage access
- Networking
- Databricks jobs
- Platform configuration
- Monitor platform health and participate in incident management.
- Perform root-cause analysis and implement corrective and preventive actions.
- Provide reliable production support for enterprise data platforms.
Collaboration & Operational Governance
- Collaborate with Data Engineering, Security, Cloud Infrastructure, and Support teams to ensure platform reliability and governance.
- Support release management, platform upgrades, environment migrations, and new feature enablement.
- Create and maintain operational documentation, SOPs, technical procedures, and runbooks.
- Promote Databricks platform best practices across teams.
Required Skills & Qualifications
- 5 to 10 years of overall IT experience , with robust hands-on experience in Databricks administration on AWS .
- Strong understanding of AWS services including IAM, S3, EC2, VPC, and CloudWatch .
- Hands-on experience with Unity Catalog and enterprise data governance practices.
- Strong knowledge of Databricks:
- Workspace administration
- Cluster management
- Job monitoring
- Access management
- Security configuration
- Experience with Terraform / Infrastructure as Code .
- Scripting experience using Python, Shell, or Bash .
- Knowledge of CI/CD, release management, and environment migration processes.
- Experience with monitoring, incident management, root-cause analysis, and production support.
- Understanding of Databricks and AWS cost management and optimization techniques.
- Strong communication, collaboration, and stakeholder management skills.
Interested candidates share your updated CV to
[email protected] or WhatsApp to (phone hidden). Thanks& Regards,
Praneeth.N
📌 Aws DataBricks Admin (Chennai)
🏢 ZettaMine Labs
📍 Chennai