Experience: 10–12 years

Grade: Architect / Principal

Role Summary

Own the end-to-end architecture of the Databricks Lakehouse platform on AWS — the landing zone, governance model, integration with the operational data layer, and the standards every engineering stream builds against. You will be the design authority and the point of technical escalation for the platform.

Key Responsibilities

- Define and evolve the target Lakehouse architecture: medallion layers, catalog structure, storage strategy, compute topology.
- Own the Databricks landing zone on AWS — workspaces, account structure, networking (PrivateLink, NCC, VPC design), encryption and key management.
- Design the Unity Catalog governance model: metastore layout, external locations, storage credentials, access control, lineage and audit.
- Architect integration between the operational store (DynamoDB) and the analytical Lakehouse, including streaming, replay and consistency semantics.
- Set standards for data modelling, table formats (Delta/Iceberg), naming, CI/CD, environment promotion and code quality.
- Own platform cost architecture — DBU consumption modelling, commitment planning, compute policies, chargeback and optimisation.
- Define security and compliance posture for a multi-country BFSI footprint: data residency, PII handling, retention, regulatory audit readiness.
- Lead architecture reviews,



produce decision records and defend design choices to senior stakeholders and global review boards.
- Mentor engineering, ML and BI streams; unblock complex technical problems.

Must-Have Skills

- Deep Databricks architecture expertise — Unity Catalog, Delta Lake, workspace and account administration, serverless and classic compute.
- Strong AWS architecture: VPC and hybrid networking, PrivateLink, IAM and cross-account trust, S3, Glue, Lake Formation, KMS.
- Large-scale distributed data architecture and Spark internals.
- Proven experience designing platforms handling high-volume, low-latency and multi-tenant workloads.
- Data governance, security and regulatory compliance in a financial-services context.
- Strong written architecture communication — HLD/LLD, decision records, stakeholder presentations.

Good to Have

- Databricks Certified Data Engineer Skilled and/or Databricks Platform Architect accreditation.
- AWS Solutions Architect Professional.
- Multi-cloud experience — Azure Databricks, cross-cloud commitment models.
- Terraform / infrastructure-as-code for Databricks and AWS.

Additional Info

- Comfortable working in a regulated, audit-heavy environment with strict change control.
- Documentation as a first-class deliverable — designs, runbooks, data dictionaries.
- Collaborative working style across engineering, product, risk and country teams.
- Willingness to work with distributed/global stakeholders across time zones.

📌 Databricks Solution Architect (Maharashtra)
🏢 CRIF India
📍 Maharashtra