07 Nov
|
Guidehouse
|
Thiruvananthapuram
07 Nov
Guidehouse
Thiruvananthapuram
Job Family: Database Administration (India)
Travel Required: None
Clearance Required: None
What You Will Do
We re seeking an experienced Databricks Platform Administrator to manage and improve our enterprise data platform. You ll help keep the environment secure, reliable, scalable, and cost-effective, working closely with data engineering, data science, development, security, and cloud infrastructure teams.
What You Will Need
1.0 Key Responsibilities
- Administer Databricks workspaces, clusters, jobs, notebooks, instance pools, SQL warehouses, and related services.
- Manage users, groups, roles, service principals, permissions, credentials, and access controls.
- Apply security and governance standards using Unity Catalog, role-based access controls, and data-governance policies.
- Monitor platform availability, system health, job execution, cluster performance, and resource usage.
- Troubleshoot failed jobs, cluster and connectivity issues, performance bottlenecks, and access incidents.
- Configure clusters, pools, autoscaling, and compute policies to improve performance and manage costs.
- Support Databricks integrations with cloud storage, databases, business intelligence tools, APIs, and enterprise applications.
- Maintain configurations across development, testing, staging, and production environments.
- Support automated deployment and infrastructure management through CI/CD and Infrastructure as Code.
- Build and maintain monitoring dashboards, alerts, audit reports, and operational documentation.
- Coordinate platform upgrades, configuration changes, testing, and releases.
- Partner with cybersecurity and governance teams on audits, compliance, logging,
and data protection.
- Assist with establishing platform standards, administrative procedures, naming conventions, and operational practices.
- Provide technical guidance to data engineers, analysts, data scientists, and application teams.
- Assess platform usage and recommend improvements to scalability, reliability, performance, and cost.
1.0 Required Qualifications
- At least four years of experience in cloud infrastructure, data platform administration, database administration, DevOps, data engineering, or a related technical field.
- Hands-on experience administering Databricks in an enterprise workplace.
- Experience with Azure Databricks is a must and Databricks on AWS is a nice to have.
- Strong knowledge of Databricks workspaces, clusters, jobs, notebooks, SQL warehouses, instance pools, and compute policies.
- Experience with Unity Catalog, identity management, service principals, secrets, access controls, and data governance.
- Experience monitoring and troubleshooting Databricks jobs, clusters, integrations, and platform performance.
- Experience with cloud storage, networking, security, and identity-management services.
- Proficiency in SQL and at least one scripting language, such as Python or PowerShell
- Experience with Git, CI/CD pipelines,
and automated deployment.
- Experience with Infrastructure as Code tools such as Terraform.
- Experience integrating Databricks with Power BI, Tableau, Snowflake, SQL Server, or other enterprise data platforms.
- Strong troubleshooting, documentation, communication, and stakeholder-management skills.
- Bachelor s degree in Computer Science, Information Technology, Engineering, Data Science, or a related field.
1.0 Preferred Qualifications
- Databricks certification, such as Databricks Certified Data Engineer or Databricks Certified Associate Developer for Apache Spark.
- Certification in Microsoft Azure
- Experience with Delta Lake, Delta Live Tables, MLflow, Lakehouse architecture, or Databricks SQL.
- Experience with Azure DevOps, GitHub Actions or similar CI/CD platforms.
- Experience supporting regulated, federal, healthcare, financial services, or other highly controlled environments.
- Familiarity with data cataloging, lineage, audit logging, disaster recovery, and business-continuity planning.
2.0 Key Skills
- Databricks administration; Unity Catalog; cloud infrastructure; cluster management; performance and cost optimization; platform security; identity and access management; CI/CD; Infrastructure as Code; Python; SQL; Terraform; monitoring; troubleshooting; data governance; technical documentation.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 Databricks Platform Administrator (Thiruvananthapuram)
🏢 Guidehouse
📍 Thiruvananthapuram