SaaS Databricks Engineer

Location: Bengaluru (Hybrid)

Experience: 5-8 Years

Employment Type: Full-Time

Job Summary: We are seeking a highly skilled SaaS Databricks Engineer to design, develop, and optimize cloud-native data engineering solutions on Azure Databricks. The ideal candidate will have strong expertise in PySpark, SQL, Delta Lake, Azure Data Factory, and contemporary data platform architectures. The role involves building scalable ETL/ELT pipelines, supporting SaaS applications, and ensuring reliable data delivery across enterprise environments.

Responsibilities

Design, develop, and maintain scalable data pipelines using Azure Databricks, PySpark, and Spark SQL.
Build and optimize ETL/ELT workflows for large-scale data processing.
Implement and manage Bronze, Silver, and Gold Lakehouse architectures using Delta Lake.
Integrate SaaS applications and external data sources into enterprise data platforms.
Develop data ingestion frameworks using Azure Data Factory (ADF).
Optimize Databricks clusters, notebooks, and Spark workloads for performance and cost efficiency.




Implement data quality, validation, audit, and reconciliation controls.
Work with Azure Data Lake Storage Gen2 (ADLS), SQL databases, and cloud-native storage solutions.
Automate deployment processes using CI/CD pipelines (Azure DevOps or GitHub Actions).
Perform troubleshooting, root cause analysis, and production support activities.
Ensure security, governance, and compliance using RBAC, Key Vault, and managed identities.
Monitor pipeline health and implement proactive alerting and observability solutions.
Collaborate with architects, analysts, business stakeholders, and product teams.
Create technical documentation, data flow diagrams, and operational runbooks.
Continuously recommend improvements in platform scalability, reliability, and cost optimization.

Mandatory Skills

5-8 years of Data Engineering experience.
3+ years of hands-on Azure Databricks experience.
Strong expertise in PySpark an

📌 SENIOR SOFTWARE ENGINEER (Bengaluru)
🏢 Happiest Minds Technologies
📍 Bengaluru