About the Role
We are looking for a Lead Data Engineer to take ownership of designing, building, and scaling modern data solutions. In this role, you will provide technical leadership across data architecture, data pipelines, and cloud-based analytics platforms. You will work closely with engineering, analytics, product, and business teams to ensure reliable, high-quality, and accessible data across the organization.
Key Responsibilities
- Contribute to the design and development of scalable data pipelines and a growing data lake
- Build and extend data processing workflows using Python, Apache Spark, and Databricks
- Define technical standards, best practices, and reusable frameworks for data engineering
- Ensure data quality, reliability, performance, and maintainability across data solutions
- Support data modeling, data integration, and transformation processes for analytics and reporting
- Drive automation, monitoring, and CI/CD improvements to ensure operational excellence
- Collaborate across teams, acting as a technical interface between the data platform and engineering,
analytics, and business stakeholders.
- Contribute to architecture decisions and long-term data platform strategy
Your Profile
- Outstanding programming experience, preferably in Python; ability to write clean, testable,production-grade code; able to write clean, testable, production-grade code
- Solid SQL skills and familiarity with structured and semi-structured data formats (JSON,Protobuf, Delta format)
- Hands-on experience with Apache Spark, ideally on Databricks, and understanding of the medallion architecture
- Solid grasp of data lakehouse principles, data modeling, and data governance concepts
- Experience building and maintaining CI/CD pipelines (e.g. GitLab CI); familiarity with IaC and deployment
- Cloud Platforms: Experience with AWS or comparable cloud providers; familiarity with Databricks as a managed Lakehouse platform
- Experience with event-driven architectures or stre
📌 Senior Data Engineer (Pune)
🏢 KSB
📍 Pune