Company Name: VARITE India Private Limited

About The Client:

Client is one of the world’s leading professional services firms and the fastest growing Big Four accounting firm

About The Job:
- We are seeking a skilled Data Engineer (Databricks) to join our team and build scalable, high-performance data solutions.
- The ideal candidate will have hands-on experience designing and maintaining ETL/ELT pipelines on Databricks using PySpark, Spark SQL, and Delta Lake, with a robust foundation in modern data warehousing and cloud-based data platforms.

Essential Job Functions:
- Design, develop, and maintain scalable ETL/ELT pipelines using Databricks, PySpark, Spark SQL, and Delta Lake.
- Implement and optimize data ingestion, transformation, and data quality processes across large-scale datasets.
- Build and maintain data models following fact/dimension modeling, Slowly Changing Dimensions (SCDs), and incremental loading strategies.
- Develop solutions aligned with Medallion Architecture (Bronze, Silver, Gold layers).
- Orchestrate, monitor, troubleshoot,



and performance-tune Databricks Workflows to ensure reliable production execution.
- Optimize Spark jobs and Databricks workloads for performance, scalability, and cost efficiency.
- Manage data governance, security, and access controls using Unity Catalog.
- Integrate Databricks with cloud storage services on AWS or Azure.
- Collaborate with business stakeholders, data analysts, and engineering teams to translate requirements into robust data solutions.
- Ensure adherence to best practices around data quality, testing, monitoring, and documentation.

Qualifications:

Must-Have
- 2-4 years of experience in Data Engineering with strong exposure to Databricks.
- Hands-on expertise in:
- PySpark
- Spark SQL
- Delta Lake
- Databricks Workflows
- Solid knowledge of:
- Data Warehousing Concepts
- Fact & Dimension Modeling
- Slowly Changing Dimensions (SCD Type 1 & 2)
- Incremental Data Processing
- Medallion Architecture
-

📌 Data Engineer (Bengaluru)
🏢 VARITE
📍 Bengaluru