KPI Partners is seeking a highly skilled Lead Data Engineer specializing in Databricks Services and DevOps. The ideal candidate will possess robust technical expertise in data engineering and a passion for leveraging cloud-based solutions to drive efficiency and insights. This role requires a strategic thinker who can lead data-driven initiatives and collaborate with cross-functional teams to ensure the successful execution of data projects.
Responsibilities:
- Lead the design, development, and implementation of data engineering solutions utilizing Databricks.
- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and transform business needs into technical solutions.
- Oversee the integration of various data sources and systems, ensuring data quality, consistency, and accessibility.
- Implement DevOps practices for continuous integration and deployment, optimizing the data engineering pipeline.
- Mentor and guide junior data engineers,
promoting best practices in data management and engineering methodologies.
- Monitor and troubleshoot data infrastructure for performance optimization and reliability.
- Stay current with industry trends and emerging technologies to drive innovation within the data engineering team.
- Ensure adherence to security and compliance standards across all data projects.
Qualifications:
- Bachelor s degree in Computer Science, Engineering, or a related field; Master s degree preferred.
- Minimum of 7 years of experience in data engineering, with extensive experience in Databricks and cloud platforms.
- Strong knowledge of data pipeline architectures and ETL/ELT processes.
- Proven experience with DevOps tools and practices, including CI/CD methodologies.
- Proficiency in programming languages such as Python or Scala.
- Experience with big data technologies, such as Spark, Kafka, or similar frameworks.
- Excellent problem-solving skil
📌 Lead - Data Engineer - Databricks Services, DevOps (Pune)
🏢 KPI Partners
📍 Pune
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.