Requirements

The ideal candidate is a hands-on AI architect with deep Databricks and GenAI expertise, robust data engineering foundations, and a proven record of taking AI solutions to production at enterprise scale. Key requirements:

• 12–14 years of experience in data and AI/ML solutions, including designing and architecting large-scale (TB/PB) data platforms and production AI/ML systems.
• Deep, hands-on architecture expertise with Databricks — Spark/PySpark, Delta Lake, lakehouse/medallion architecture, Unity Catalog, Databricks Workflows, and Delta Live Tables — with strong performance and cost optimization.
• Proven experience architecting Generative AI / LLM solutions — RAG pipelines, chunking and embedding strategies, vector store design, prompt engineering, evaluation, and guardrails/responsible-AI patterns.
• Strong hands-on experience with native Databricks AI capabilities — Mosaic AI (Model Serving, Vector Search, Agent Framework), Foundation Model APIs, MLflow, Feature Store, and model governance via Unity Catalog.




• Solid ML/MLOps foundations — model lifecycle management, experiment tracking, deployment, monitoring, and drift/quality evaluation in production.
• Expert-level PySpark and Spark SQL, with strong Python for building reusable data and feature pipelines that power AI workloads (batch and streaming).
• Strong hands-on experience with AWS and Azure Cloud, including networking, IAM/security, cost optimization, and AI/ML services; comfortable architecting across cloud data and AI services.
• Experience with LLM orchestration frameworks (LangChain/LangGraph or equivalent), agentic patterns, tool use, and multi-agent workflows at an architecture level.
• Deep expertise in data and AI governance, data quality, lineage, security, and responsible AI — including PII handling, access control (Unity Catalog, RBAC), and audit.
• Proven ability to set architecture standards, lead design reviews, and provide technical leadership and mentorship across mult

📌 Databricks AI Architect (Chennai)
🏢 Impetus
📍 Chennai