Senior Devops Engineer with Databricks (India)

Senior Devops Engineer with Databricks (India)

02 Oct
|
UST
|
India

02 Oct

UST

India

Job Description:

- 6+ years in data platform engineering, DataOps, platform engineering, DevOps or SRE.

- At least 5+ years of hands-on Terraform and IaC experience, including modules, state management, imports, plans, provider and version control, environment separation, drift detection and CI/CD.

- Strong Python engineering for APIs, automation, testing, packaging, structured logging, error handling and reusable tooling.

- Production experience operating Databricks and Unity Catalog.

- Strong production Apache Airflow experience.

- Experience operating dbt environments, jobs and CI/CD workflows.

- AWS IAM, S3, VPC/private connectivity, KMS, Secrets Manager and CloudWatch.

- Git, CI/CD, REST APIs, SQL, Linux, OAuth, SAML/SCIM and service-principal authentication.

- Experience with monitoring, incident response, change control, rollback and cost management.

- Relevant Databricks platform training or certification is highly preferred.

Responsibilities

- Provision and manage platform resources through reusable Terraform modules and configuration as code.

- Operate Databricks accounts and workspaces, including identities, groups, service principals, entitlements, compute policies, clusters, SQL warehouses and Jobs/Workflows.

- Configure Unity Catalog metastores, catalogs, schemas, external locations, storage credentials, workspace bindings, ownership and least-privilege access.

- Operate dbt projects, environments, connections, jobs, permissions, service tokens, CI quality gates and promotion controls.

- Engineer production Astro/Airflow capabilities covering DAG standards,



dependencies, retries, timeouts, concurrency, backfills, ing and safe recovery.

- Orchestrate and integrate Fivetran, dbt, Databricks and Atlan using APIs, webhooks and workload identities.

- Implement Fivetran usage monitoring, cost thresholds, non-production lifecycle guardrails and configuration portability.

- Enable governed Atlan and Tableau connectivity, metadata, lineage, access and operational workflows.

- Implement ADLC controls for branching, testing, approval, setting promotion, deployment evidence and rollback.

- Integrate identity and access workflows with Okta or equivalent identity providers and ServiceNow.

- Establish platform and pipeline SLOs; monitor reliability, schema changes, data quality, usage and cost.

- Troubleshoot incidents, perform root-cause analysis and automate recurrence prevention.

- Maintain runbooks, configuration inventories, access evidence and recovery procedures.

Skills:

AWS, Terraform, Python, Databricks

About Company:

UST is a global digital transformation solutions provider. For more than 20 years, UST has worked side by side with the world’s best companies to make a real impact through transformation. Powered by technology, inspired by people and led by purpose, UST partners with their clients from design to operation. With deep domain expertise and a future-proof philosophy, UST embeds innovation and agility into their clients’ organizations. With over 30,000 employees in 30 countries, UST builds for boundless impact—touching billions of lives in the process.

📌 Senior Devops Engineer with Databricks (India)
🏢 UST
📍 India

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior devops engineer with databricks (india) / india