16 Nov
|
TVS Motor
|
Bengaluru
16 Nov
TVS Motor
Bengaluru
Job Purpose
Design, develop and operate reliable, scalable and secure data pipelines and curated datasets for Digital Mobility Products. Translate agreed product, analytics and data science requirements into tested data solutions, applying established architecture and governance standards. With 57 years of experience, independently deliver assigned data engineering components, improve data quality and operational performance, and collaborate with product, data science, software engineering and DevOps teams to enable trusted analytics and production AI use cases.
Key Responsibilities
1. Build and maintain batch and streaming pipelines to ingest, transform and serve mobility-product data within agreed architecture and delivery plans.
2. Develop SQL/Python transformations, reusable components and curated datasets for product analytics, experimentation and data science/AI use cases.
3. Implement data models, incremental loads, schema changes and data interfaces; document definitions and acceptance criteria with stakeholders.
4. Automate data validation,
reconciliation and quality checks; maintain metadata and lineage, and resolve data defects at source where possible.
5. Apply approved access controls, privacy, security and retention requirements; address governance findings for assigned datasets and pipelines.
6. Monitor pipeline availability, freshness and failures; troubleshoot production incidents, perform root-cause analysis and implement preventive fixes.
7. Tune queries, processing jobs and storage usage to improve throughput, latency and resource efficiency against agreed service levels.
8. Use automated tests, Git, code reviews and CI/CD to deliver maintainable code and reliable deployments with engineering and DevOps teams.
9. Collaborate with product owners, analysts and data scientists to refine requirements, estimate work and deliver accepted data solutions on time.
10. Document designs, runbooks and operating procedures; contribute to design/code reviews, share reusable patterns and support less-experienced engineers.
📌 Data Engineer 2 (Bengaluru)
🏢 TVS Motor
📍 Bengaluru