22 Nov
|
KPI Partners
|
Bengaluru
22 Nov
KPI Partners
Bengaluru
About the Company
KPI Partners is a leading global data analytics and business intelligence consulting firm with a solid presence in the data and analytics industry. The company works with Fortune 500 clients across manufacturing, healthcare, retail, and financial services, delivering innovative data engineering, analytics, and business intelligence solutions.
About the Role
KPI Partners is looking for an experienced Databricks Data Engineer with 8–12 years of experience to join its offshore delivery team. The role involves designing, developing, and optimizing scalable data solutions using Databricks and PySpark. The candidate will work on distributed computing, CI/CD implementation, MLOps workflows, and cloud platforms while collaborating with global teams and overlapping with PST
working hours
. Roles and Responsibilities
• Design, develop, and optimize production-grade data solutions using Databricks and PySpark.
• Build and optimize distributed data processing workloads using Apache Spark.
• Implement CI/CD pipelines for automated deployments.
• Establish and operationalize MLOps workflows.
• Optimize data pipelines for performance, scalability, and cost efficiency.
• Work across AWS, Azure, and GCP cloud environments.
• Guide customers on lakehouse implementation and production readiness.
• Collaborate with onshore teams and stakeholders, ensuring overlap with PST
working hours
. Must-Have Skills
• Databricks
• PySpark
• CI/CD
• MLOps
• Apache Spark and distributed computing
• Hands-on experience with cloud platforms (AWS, Azure, GCP)
• Data pipeline development and performance optimization
• Strong analytical and problem-solving skills
• Excellent communication and stakeholder management skills
📌 Databricks Data Engineer (Bengaluru)
🏢 KPI Partners
📍 Bengaluru