31 Jul
|
Databricks
|
Bengaluru
31 Jul
Databricks
Bengaluru
P-375
At Databricks, we build powerful infrastructure that accelerates innovation and enables data teams to deliver with confidence and scale. Our unified schema migration platform underpins automated, observable, and developer-friendly workflows—ensuring Databricks can continue evolving rapidly across thousands of databases and 60+ mission-critical services.
What You’ll Do
As a Staff Software Engineer, you’ll lead the design, development, and reliability of our global platform that manages schema and data changes at scale:
- Schema Migration Platform: Architecting and maintaining automated schema change infrastructure for MySQL and TiDB, while implementing versioning, rollback, validation, and auditing for safe, predictable, and fast migrations.
- Scale, Reliability & Test Harness: Ensuring the platform operates across thousands of global databases with zero downtime, enhancing resilience, observability, and recovery, and building a test harness for migration and deployment validation.
- Developer Experience & CI/CD Integration: Designing intuitive tools and APIs for seamless schema and data change management, and embedding migration workflows into CI/CD pipelines to increase velocity and reduce friction.
- Schema & Data management: Designing infrastructure for safe,
large-scale schema and data operations like backfills and purging. This includes ensuring backfill operations are monitored, retryable, minimally disruptive, and automated to align with schema/data evolution and maintain data integrity.
Your role will be crucial in:
- Ensuring the scalability and reliability of schema and data operations across Databricks’ global footprint.
- Driving predictable deployments by architecting robust test harnesses and automation.
- Elevating the developer experience by building accessible, resilient tools that make complex migrations feel simple.
- Guaranteeing the integrity of both schema and data through protected, efficient backfill strategies.
What we look for:
- 12+ years of professional experience in backend systems or platform engineering.
- Experience in building platforms, infrastructure, or database engineering, especially with MySQL, TiDB.
- Track record of building and scaling mission-critical platforms supporting high-throughput, global services.
- Experience with schema migration frameworks, CI/CD automation and developer tooling.
- Champion of developer experience, creating clear, reliable, and user-friendly workflows.
📌 Staff Software Engineer - Databases (Bengaluru)
🏢 Databricks
📍 Bengaluru