About the Role
We are looking for an experienced Databricks Platform Engineer to help design, build, and operate a modern enterprise data platform. This role focuses on developing core platform automation, deployment frameworks, governance capabilities, and observability solutions that enable scalable, secure, and reliable data operations across the organization.
You will play a critical role in building and maintaining data contract-driven deployment systems, automation frameworks, monitoring infrastructure, and governance tooling. The ideal candidate combines deep Databricks expertise with solid Python development skills and software engineering best practices.
This position requires a hands-on engineer who can proactively identify complex design challenges, propose practical solutions, and contribute throughout the entire platform lifecycle, from architecture and implementation to operations and continuous improvement.
Responsibilities
Data Contract System & Deployment Pipeline
• Design and implement a contract-driven automation bundle generator that converts Open Data Contract Standard (ODCS)
YAML files into deployable Databricks assets.
• Build and maintain deployment pipelines for Declarative Automation Bundles, including:
• Environment parameterization
• Deployment atomicity
• Rollback mechanisms
• Develop and operate Azure DevOps/Azure Pipelines CI/CD workflows, including:
• Multi-stage pipelines
• Environment approvals
• Variable groups
• Service connections
• Automate governance processes within Unity Catalog, including:
• Schemas
• Tables
• Tags
• Grants
• Develop integrations utilizing Databricks SDKs and REST APIs.
• Generate and execute SQL DDL statements for row-level filters and column-level masking based on data contract definitions.
• Design and maintain a contract index, including recovery and atomic maintenance mechanisms.
• Implement dead-letter asset deployment patterns and ensure deployment consistency.
• Establish and enforce Git workflows,
📌 Databricks Infrastructure (India)
🏢 Amazon
📍 India