12 Aug
|
LumenData
|
Bengaluru
12 Aug
LumenData
Bengaluru
Solution Architect – Databricks
Experience Required
10+ years of overall consulting / technology experience
7+ years of experience in Data Engineering, Data Platforms, Big Data, or Analytics
Robust hands-on Databricks experience
Minimum 6–8 end-to-end Databricks project implementations
Role Overview
We are looking for a highly experienced Senior FDE / Resident Solution Architect – Databricks who can work closely with enterprise customers to design, develop, optimize, and support scalable data engineering and analytics solutions on the Databricks platform.
The consultant should have strong hands-on expertise in Databricks, Apache Spark, PySpark, distributed computing, cloud platforms, performance optimization, and solution architecture.
This is a highly technical and client-facing role. The consultant should be able to independently drive architecture discussions, troubleshoot complex Databricks/Spark issues, provide implementation guidance, and support production deployments.
Key Responsibilities
Design and implement scalable Databricks Lakehouse solutions.
Work directly with customers to understand technical and business requirements.
Define end-to-end data engineering and platform architecture.
Build and optimize data pipelines using Databricks, Spark, PySpark, SQL, and Delta Lake.
Design batch and streaming data-processing solutions.
Provide technical guidance on Databricks architecture, development standards, and best practices.
Troubleshoot complex Spark and Databricks performance issues.
Optimize workloads for performance, scalability, reliability, and cost.
Support enterprise Databricks platform implementation and modernization initiatives.
Work with Databricks capabilities such as Delta Lake, Unity Catalog, Workflows, Auto Loader, Databricks SQL, Lakeflow/DLT, and Serverless.
Design and support CI/CD processes for Databricks deployments.
Work with DevOps and Infrastructure-as-Code tools such as Git, Terraform, Azure DevOps, GitHub, GitLab, or Jenkins.
Provid
📌 Solution Architect – Databricks (Bengaluru)
🏢 LumenData
📍 Bengaluru