12 Aug
|
Unison Group
|
Hyderabad
12 Aug
Unison Group
Hyderabad
Description
Job Summary
We are seeking a highly skilled and hands-on Databricks Solution Architect with deep expertise in designing, building, and optimizing Lakehouse-based Data Engineering, Machine Learning, and AI solutions on the Databricks platform. This contract role is based in Singapore, offering flexibility to work on-site with enterprise clients or remotely within the region.
The ideal candidate will have strong experience in architecting contemporary data platforms, implementing scalable data pipelines, enabling MLOps, and delivering AI/LLM use cases using Databricks technologies. You will lead technical solution design, mentor engineering teams, and collaborate closely with business stakeholders to deliver secure, scalable, and high-performance data solutions.
Key Responsibilities
- Design, architect, and implement enterprise-scale Databricks Lakehouse solutions for analytics, data engineering, machine learning, and AI workloads.
- Develop scalable batch and streaming data pipelines using Delta Live Tables (DLT), Apache Spark, Spark SQL, Python, and Scala.
- Build,
optimize, and maintain Delta Lake architectures for high-performance data processing.
- Configure and administer Databricks Workspaces, Unity Catalog, SQL Warehouses, clusters, and job orchestration.
- Design secure, governed, and compliant data platforms using Unity Catalog, access controls, and data governance best practices.
- Implement Infrastructure as Code (IaC) using Terraform and automate deployments through Git-based CI/CD pipelines.
- Optimize ETL, ELT, streaming, and machine learning workloads for performance, scalability, cost efficiency, and reliability.
- Build and operationalize MLOps pipelines using MLflow, model registry, experiment tracking, and automated model deployment.
- Develop AI and Generative AI solutions leveraging DBRX, Mosaic AI, Retrieval-Augmented Generation (RAG), and LLM frameworks.
- Integrate enterprise AI services such as OpenAI, Amazon Bedrock, Azure OpenAI, or H
📌 Databricks Solution Architect (Hyderabad)
🏢 Unison Group
📍 Hyderabad