Key Responsibilities

Customer Architecture and Pre-sales

- Lead executive and technical discovery workshops; translate business outcomes and non-functional requirements into Data + AI roadmaps and target architectures.
- Architect end-to-end solutions covering ingestion, batch and streaming pipelines, lakehouse storage, governance, data warehousing, analytics, ML/GenAI and operational applications.
- Define phased migrations from legacy warehouses, Hadoop, cloud data platforms and ETL estates to Databricks.
- Lead technical solutioning for proposals, demonstrations, RFP/RFI responses, estimates and proofs of value; clearly articulate business value and architectural trade-offs.
- Collaborate with sales, delivery, cloud partners and Databricks account teams on joint pursuits and co-sell readiness.

Delivery Governance and Practice Building

- Provide architecture governance from pursuit through production, including design, security, performance, cost and operational-readiness reviews.
- Guide CI/CD, infrastructure as code, environment strategy, testing, observability, release management and production support.
- Define the practice roadmap, skills matrix, certification plan and hiring profile; mentor architects, data engineers and technical leads.
- Create reusable reference architectures, discovery and estimation templates, demos, accelerators and technical playbooks.

Databricks Platform Expertise Core Lakehouse, Data Engineering and Governance

- Delta Lake and lakehouse design: ACID transactions, schema evolution, Change Data Feed, optimization and Medallion or domain data-product patterns.
- Unity Catalog: catalogs/schemas, access controls, managed and external locations, lineage, discovery, audit, federation and Delta Sharing.
- Lakeflow Connect,



Lakeflow Spark Declarative Pipelines and Lakeflow Jobs for ingestion, batch/streaming transformation, data quality, orchestration and observability.
- Apache Spark, PySpark, SQL and Structured Streaming, including workload sizing, optimization and production troubleshooting.
- Databricks SQL, serverless warehouses, query optimization, AI/BI dashboards and Genie for governed natural-language analytics.

Required Experience, Qualifications and Certifications

- 10+ years in data engineering, data architecture, analytics or cloud data platforms, including at least 4 years of substantial Databricks experience.
- Demonstrated success architecting and delivering enterprise-scale Databricks solutions in productionnot only isolated notebooks or pipelines.
- Strong pre-sales capability across discovery, technical storytelling, estimates, proposals, demonstrations, proofs of value and senior customer presentations.
- Strong SQL and Python/PySpark skills, with the ability to review implementations, troubleshoot designs and guide engineering teams.
- Experience leading architecture governance and multidisciplinary teams; prior practice-building, hiring, mentoring or reusable-IP responsibility is strongly preferred.
- Professional-level Databricks certification is strongly preferred at joining. An otherwise strong candidate must complete an agreed skilled certification within six months.
- Excellent communication, executive presence and structured problem-solving; able to explain technical and commercial trade-offs clearly.
- Experience in consulting, a systems integrator or a Databricks partner is preferred, particularly in BFSI, manufacturing, healthcare/life sciences or retail.
- Willingness to work from Palni’s Hyderabad office and travel for customer or partner engagements when required.

📌 Principal Databricks Solution Architect (Hyderabad)
🏢 Palni
📍 Hyderabad