09 Aug
|
NRM Analytix
|
Tamil Nadu
09 Aug
NRM Analytix
Tamil Nadu
Job Title: Databricks Solution Architect
Experience: 6–10 Years
Location: India (Remote/ Hybrid)
Employment Type: Contract / Full-time / Consulting
Job Summary
We are seeking an experienced Databricks Solution Architect to design and implement enterprise-scale data and AI solutions on the Databricks Lakehouse Platform. The ideal candidate should have robust expertise in Databricks, Spark, cloud platforms, and modern data architecture, along with experience in migration, optimization, and ML workloads. The candidate must possess Databricks Registered Solutions Architect (RSA) Certification .
Mandatory Skills
- Databricks Registered Solutions Architect (RSA) Certification (Mandatory)
- 6–10 years of experience in Data Engineering / Big Data / Data Architecture
- 3+ years of hands-on experience with Databricks
- Strong expertise in Apache Spark, PySpark, Spark SQL
- Experience with Delta Lake, Unity Catalog, and Medallion Architecture
- Strong knowledge of Python and SQL
- Experience designing and implementing scalable Lakehouse Architectures
- Experience with Azure Databricks or AWS Databricks
- Hands-on experience with ETL/ELT pipeline development
- Strong understanding of Data Modeling (Star Schema, Snowflake Schema)
- Experience in cloud platforms (Azure or AWS)
Preferred Skills
- Experience with Feature Store, MLflow, and MLOps
- Experience in Tecton to Databricks Feature Store migration or similar migration projects
- Knowledge of Delta Live Tables (DLT)
- Experience with Kafka, Event Hubs, or streaming data pipelines
- Experience with orchestration tools such as Azure Data Factory, Apache Airflow, or Databricks Workflows
- Experience with CI/CD, Git, and Azure DevOps
- Knowledge of Snowflake, Synapse, or BigQuery
- Databricks Professional certifications are an added advantage
Key Responsibilities
- Design scalable enterprise data platforms using the Databricks Lakehouse architecture.
- Lead end-to-end solution architecture, including data ingestion, transformation, storage, governance, and consumption.
- Architect and optimize Spark workloads for performance and cost efficiency.
- Design and implement Delta Lake-based solutions using Medallion Architecture.
- Lead migration projects from legacy data platforms or Feature Store platforms (e.g., Tecton) to Databricks.
- Collaborate with Data Scientists to enable feature engineering, Feature Store integration, and ML workflows.
- Implement governance using Unity Catalog and data security best practices.
- Develop architecture standards, design documents, and best practices.
- Guide development teams through implementation and code reviews.
- Work directly with clients to understand business requirements and propose scalable technical solutions.
Nice to Have
- Experience with Generative AI, RAG, or Agentic AI solutions on Databricks.
- Knowledge of Infrastructure as Code (Terraform).
- Experience with healthcare, finance, or retail data platforms.
- Previous consulting or Professional Services (PS) experience.
Soft Skills
- Strong communication and stakeholder management skills.
- Excellent problem-solving and analytical abilities.
- Experience leading technical discussions and architecture workshops.
- Ability to work independently in a remote or hybrid environment.
Ideal Candidate
- Databricks Registered Solutions Architect (RSA) certified.
- Strong hands-on architecture experience on Databricks.
- Experience delivering enterprise migration and modernization projects.
- Deep understanding of Lakehouse architecture, Spark optimization, and cloud-native data platforms.
- Exposure to Feature Store, MLflow, and MLOps is highly preferred.
📌 Databricks Solution Architect (Tamil Nadu)
🏢 NRM Analytix
📍 Tamil Nadu