About the Role

We are seeking an experienced Databricks Resident Solutions Architect to act as an embedded technical advisor and lead data architect for our enterprise clients. In this role, you will bridge the gap between business requirements and scalable cloud infrastructure, designing and optimizing high-performance data engineering pipelines on the Databricks Lakehouse platform.

If you have 5+ years of overall data engineering/architecture experience and 3+ years of hands-on expertise building scalable solutions on Databricks, we’d love to speak with you.

Core Responsibilities

- Platform Architecture: Design and implement scalable, secure, and resilient data architectures on the Databricks Lakehouse platform using Delta Lake and Unity Catalog.
- Hands-On Pipeline Delivery: Build, optimize, and maintain complex data pipelines using PySpark, Apache Spark, Python, Scala, and SQL.
- Client Advisory & Mentorship: Serve as the primary embedded technical advisor for clients, offering best practices in data governance, MLOps, and cloud integration.
- Performance Tuning: Identify and resolve bottlenecks in large-scale data processing jobs, query execution, and cluster configurations (utilizing Photon engine).
- Cloud & Security Integration:



Implement cloud-native architectures and secure data access frameworks across major cloud providers (AWS, Azure, or GCP).

Required Skills & Qualifications

- Overall Experience: 5+ years in Data Engineering, Data Architecture, or Big Data Solutions.
- Databricks Expertise: 3+ years of hands-on experience with Lakehouse Architecture, Delta Lake, Unity Catalog, Photon, and SQL Analytics.
- Big Data & Programming: Deep technical proficiency in Apache Spark, PySpark, Python, Scala, and advanced SQL.
- Cloud Infrastructure: Strong hands-on experience with at least one major cloud provider (Azure/ADLS Gen2, AWS/S3, or GCP) including security, IAM models, and storage access.
- DevOps & Delivery: Practical experience with CI/CD deployment pipelines (GitHub Actions, Azure DevOps) and containerization tools (Docker, Kubernetes).

Preferred Qualifications

- Databricks Certifications: Databricks Certified Data Engineer (Associate/Qualified) or Databricks Certified Solutions Architect.
- Cloud Certifications: Major cloud certifications (AWS Solutions Architect, Azure Data Engineer, or GCP Data Engineer).
- Consulting background: Prior experience in client-facing consulting, resident architecture, or embedded technical advisor roles.

Pay: ₹2,500,000.00 - ₹4,000,000.00 per year

Work Location: Remote

📌 Databricks Resident Solutions Architect (India)
🏢 IITM Research Park
📍 India