Looking for: Databricks Data Engineer (Databricks AI/ML)

Job Type: Contract

Location: Remote (India)

Role Summary

We are looking for an experienced Databricks Data Engineer to support multiple data engineering, analytics, and AI/ML initiatives. The resource will work closely with the onshore Data Architect and business teams to design, develop, deploy, and support scalable data solutions in Databricks. This role requires robust technical expertise, proactive communication, ownership, and the ability to collaborate effectively across multiple concurrent projects.

Required Skills

• 5+ years of experience as a Data Engineer.

• 3+ years of hands-on experience with Databricks.

• Strong SQL skills.

• Strong Python and PySpark development experience.

• Experience building scalable ETL/ELT pipelines using Databricks.

• Strong understanding of Delta Lake, Unity Catalog, and Databricks Workflows.

• Experience deploying and managing Databricks Asset Bundles (DAB) and CI/CD pipelines.

• Experience with Git and DevOps best practices.

• Experience ingesting data from APIs, SFTP,



databases, and flat files (CSV, JSON, Parquet).

• Experience implementing data quality, audit logging, reconciliation, and monitoring frameworks.

• Knowledge of dimensional modeling and data warehousing concepts.

• Experience with Azure Data Factory or similar orchestration tools.

AI/ML & GenAI Experience

• Hands-on experience integrating AI/ML solutions within the Databricks ecosystem.

• Experience working with Databricks AI/ML capabilities, including MLflow and Model Serving.

• Experience integrating and deploying Databricks Genie or similar GenAI conversational analytics capabilities.

• Experience consuming and integrating LLM APIs and AI services is preferred.

• Understanding of Retrieval-Augmented Generation (RAG), vector search, embeddings, and AI application architecture is a plus.

Responsibilities

• Design, develop, and maintain scalable Databricks data pipelines.

• Build

📌 Databricks Data Engineer (India)
🏢 Diligente Technologies
📍 India