About the Company – KPI Partners

KPI Partners is a global data, analytics, and AI consulting company that helps businesses modernize their data platforms and build advanced analytics solutions. The company works with technologies such as Databricks, Azure, AWS, GCP, and Snowflake.

Website: https://www.kpipartners.com/

About the Role – Databricks Data Engineer

Looking for an experienced Databricks Data Engineer with 8–12 years of experience to design, develop, and optimize scalable data pipelines. The candidate should have strong hands-on expertise in Databricks, PySpark, Apache Spark, Python, SQL, and cloud platforms.

Roles & Responsibilities

- Design and develop scalable data pipelines using Databricks and PySpark.
- Work on Apache Spark and distributed data processing.
- Optimize Spark jobs for performance and cost efficiency.




- Implement CI/CD pipelines and MLOps workflows.
- Work on Lakehouse architecture and production deployments.
- Collaborate with international clients and offshore/onshore teams.
- Provide technical guidance and lead customer engagements.

Must-Have Skills

- Databricks, Apache Spark, PySpark
- Python and SQL
- Spark Performance Tuning
- Delta Lake and Lakehouse Architecture
- AWS, Azure, GCP (at least 2 cloud platforms)
- CI/CD and MLOps
- Production-grade data pipeline development
- Consulting or customer-facing experience

Experience: 8–12 years

Location: Bengaluru, Chennai, Hyderabad, Pune(Offshore)

Work Mode: Hybrid

Employment: Full time

📌 Lead Data Engineer (Bengaluru)
🏢 KPI Partners
📍 Bengaluru