Senior Data Architect (Databricks / Lakehouse) (Thrissur)

Senior Data Architect (Databricks / Lakehouse) (Thrissur)

Role: Architect Databricks

Position Type: Full-Time Contract (40hrs/week)

Contract Duration: 12 Months+

Work Schedule: 8 hours/day (Mon-Fri)

Work Hours: Start at 3:30 am EST

Location: 100% Remote

We are seeking a highly experienced Databricks Architect to design and lead the implementation of an enterprise-scale data platform built on the Databricks Lakehouse architecture. This role is 50% hands-on coding and 50% architecture, design, and mentorship, ideal for a senior technologist who can both build and lead.

You will define architectural standards, governance frameworks, and best practices while partnering closely with engineering, analytics, and business teams to deliver scalable, secure, and high-performance data solutions.

Key Responsibilities

- Define and own the end-to-end Databricks platform architecture, including workspace design, Unity Catalog governance, storage patterns, and compute strategies
- Design and implement data governance and security frameworks (Unity Catalog, access controls, identity federation, compliance)
- Establish architectural best practices for medallion architecture, Delta Lake, data mesh, and pipeline orchestration
- Lead platform design for compute optimization, cost management, autoscaling, and workload isolation
- Define enterprise data modeling standards, CDC patterns, SCD strategies, and data quality frameworks
- Design CI/CD and DevOps patterns for Databricks using Git-based workflows and Infrastructure-as-Code (Terraform or similar)




- Drive performance optimization (partitioning, Z-ordering, clustering, monitoring, observability)
- Architect integrations with source systems, streaming platforms, and BI tools (Power BI, Tableau, etc.)
- Mentor engineers, review code, and provide architectural guidance across teams
- Stay current with Databricks platform innovations and drive adoption of current capabilities

Required Qualifications

- 7+ years of experience in data architecture, data engineering, or platform engineering
- 3+ years of hands-on experience designing and leading Databricks platforms
- Deep expertise with Databricks Unity Catalog, Delta Lake, DLT, Workflows, SQL Warehouses
- Strong cloud experience (Azure, AWS, or GCP), including security, identity, and storage services
- Advanced proficiency in SQL, Python/PySpark, and enterprise data modeling
- Hands-on experience with Terraform or Infrastructure-as-Code
- Strong understanding of DevOps, CI/CD, performance tuning, and cost optimization

Nice to Have

- Databricks and/or cloud certifications
- Experience with streaming architectures (Kafka, Event Hubs, Kinesis)
- Exposure to MLOps, MLflow, feature stores, or AI/ML platforms
- Experience with data mesh or multi-tenant architectures

What Makes This Role Unique

- High-impact architect-level ownership
- Balanced hands-on + strategic leadership role
- Opportunity to shape a modern enterprise Lakehouse platform

📌 Senior Data Architect (Databricks / Lakehouse) (Thrissur)
🏢 Sky Systems, Inc. (SkySys)
📍 Thrissur