KPI Partners is a global data, analytics, and AI consulting company that helps businesses modernize their data platforms and build advanced analytics solutions. The company works with technologies such as Databricks, Azure, AWS, GCP, and Snowflake.
Website: https://www.kpipartners.com/
About the Role – Databricks Data Engineer
Looking for an experienced Databricks Data Engineer with 8–12 years of experience to design, develop, and optimize scalable data pipelines. The candidate should have solid hands-on expertise in Databricks, PySpark, Apache Spark, Python, SQL, and cloud platforms.
Roles & Responsibilities
- Design and develop scalable data pipelines using Databricks and PySpark.
- Work on Apache Spark and distributed data processing.
- Optimize Spark jobs for performance and cost efficiency.
- Implement CI/CD pipelines and MLOps workflows.
- Work on Lakehouse architecture and production deployments.
- Collaborate with international clients and offshore/onshore teams.
- Provide technical guidance and lead customer engagements.
Must-Have Skills
- Databricks, Apache Spark, PySpark
- Python and SQL
- Spark Performance Tuning
- Delta Lake and Lakehouse Architecture
- AWS, Azure, GCP (at least 2 cloud platforms)
- CI/CD and MLOps
- Production-grade data pipeline development
- Consulting or customer-facing experience
Experience: 8–12 years Location: Bengaluru, Chennai, Hyderabad, Pune(Offshore)
Work Mode: Hybrid
Employment: Full-time
📌 Lead Data Engineer (Bangalore Metropolitan Area)
🏢 KPI Partners
📍 Bangalore Metropolitan Area
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.