Role Description

Role Summary

We are looking for a hands-on Senior DevOps / Databricks Platform Engineer to support an enterprise migration from Azure Databricks to AWS Databricks. The engineer will own standard AWS Databricks platform provisioning, Terraform automation, cloud networking and security integration, CI/CD enablement, platform configuration migration, production cutover, and hypercare. The role requires independent delivery capability and leadership qualities appropriate for an L3/L4 profile.

Role Description Technical

Design, provision, configure, and maintain AWS Databricks environments across DEV, QA/UAT, and PROD using reusable Terraform modules and infrastructure-as-code standards.
Configure AWS services required for Databricks, including VPCs, subnets, routing, security groups, IAM roles and policies, S3, KMS, CloudWatch, Secrets Manager, and VPC endpoints.
Assess Azure Databricks platform configurations and map workspaces, compute, cluster policies, identities, permissions, storage, secrets, and networking to suitable AWS equivalents.




Support migration of Databricks workspaces, jobs/workflows, repositories, libraries, Unity Catalog objects, storage credentials, external locations, volumes, grants, and service principals.
Retrofit platform references from ADLS Gen2/abfss paths to Amazon S3 and migrate the approved secret-management and authentication patterns from Azure to AWS.
Build and maintain basic CI/CD pipelines for Terraform and Databricks assets using Azure DevOps, GitHub Actions, Jenkins, GitLab CI, or equivalent tools.
Implement SSO, SCIM, Unity Catalog access controls, logging, monitoring, auditability, and standard platform security controls.
Support Databricks Runtime and library compatibility, Azure-to-AWS compute mapping, deployment promotion, cutover, rollback planning, production validation, and hypercare.
Troubleshoot networking, IAM, authentication, authorization, cluster, workflow, Terraform, and deployment issues across Az

📌 Senior Dev Ops Engineer (Bengaluru)
🏢 Tredence
📍 Bengaluru