Senior Technical Lead (Bengaluru)

Senior Technical Lead (Bengaluru)

19 Nov
|
HCLTech
|
Bengaluru

19 Nov

HCLTech

Bengaluru

Job Summary

VOLGJP00043875 - fg- VAS Requirement "Description:

Senior Data Platform Engineer – Volvo Autonomous Solutions, Bangalore
Senior Data Platform Engineer to join the Volvo Autonomous Solutions team in Bangalore. In this role, the person will design, develop, test, and maintain data engineering solutions, supporting the complete data lifecycle from vehicle-edge ingestion to centralized storage and data lakehouse pipelines. The person will work closely with engineering teams to ensure reliable data ingestion, data quality, and efficient access to multi-modal vehicle data.
Key Responsibilities:

- Data Pipeline Development:
- Design, develop, test, and maintain ETL/ELT data pipelines in production, covering vehicle-edge ingestion through Bronze, Silver, and Gold lakehouse layers.
- Implement high-throughput ingestion of large multi-modal vehicle data, including camera, LiDAR, and MCAP recordings.
- Ensure reliable, resumable, and restart-safe data transfers from vehicle-edge systems to centralized storage without unnecessary re-uploading.
- Database & Data Lakehouse Management:
- Work with relational and non-relational databases using Python and SQL.
- Implement and maintain object storage and lakehouse solutions using S3-compatible storage, MinIO, Azure ADLS, Apache Iceberg, or Delta Lake.
- Support immutable raw data storage and curated datasets.
- Data Quality Assurance:
- Implement data quality checks, including checksum validation, schema verification, and time-synchronization checks.
- Maintain data contracts, manifests, metadata, and searchable catalogs to ensure data integrity and discoverability.
- Workflow Orchestration & Monitoring:
- Develop and maintain automated data workflows using orchestration tools such as Apache Airflow.
- Implement pipeline monitoring, observability,



and alerting to ensure pipeline health.
- Data Access & API Development:
- Develop data-access APIs using FastAPI or Flask.
- Enable efficient access to multi-modal data for internal teams.
- Documentation & Knowledge Sharing:
- Create and maintain technical documentation for data pipelines and related solutions.
- Support team collaboration and onboarding of new data sources.
- Collaboration & Problem-Solving:
- Work closely with engineering teams to support data ingestion, processing, and accessibility.
- Troubleshoot data pipeline issues and contribute to reliable data engineering solutions."

Key Responsibilities

"Description:

Senior Data Platform Engineer – Volvo Autonomous Solutions, Bangalore
Senior Data Platform Engineer to join the Volvo Autonomous Solutions team in Bangalore. In this role, the person will design, develop, test, and maintain data engineering solutions, supporting the complete data lifecycle from vehicle-edge ingestion to centralized storage and data lakehouse pipelines. The person will work closely with engineering teams to ensure reliable data ingestion, data quality, and efficient access to multi-modal vehicle data.
Key Responsibilities:

- Data Pipeline Development:
- Design, develop, test, and maintain ETL/ELT data pipelines in production, covering vehicle-edge ingestion through Bronze, Silver, and Gold lakehouse layers.




- Implement high-throughput ingestion of large multi-modal vehicle data, including camera, LiDAR, and MCAP recordings.
- Ensure reliable, resumable, and restart-safe data transfers from vehicle-edge systems to centralized storage without unnecessary re-uploading.
- Database & Data Lakehouse Management:
- Work with relational and non-relational databases using Python and SQL.
- Implement and maintain object storage and lakehouse solutions using S3-compatible storage, MinIO, Azure ADLS, Apache Iceberg, or Delta Lake.
- Support immutable raw data storage and curated datasets.
- Data Quality Assurance:
- Implement data quality checks, including checksum validation, schema verification, and time-synchronization checks.
- Maintain data contracts, manifests, metadata, and searchable catalogs to ensure data integrity and discoverability.
- Workflow Orchestration & Monitoring:
- Develop and maintain automated data workflows using orchestration tools such as Apache Airflow.
- Implement pipeline monitoring, observability, and alerting to ensure pipeline health.
- Data Access & API Development:
- Develop data-access APIs using FastAPI or Flask.
- Enable effective access to multi-modal data for internal teams.
- Documentation & Knowledge Sharing:
- Create and maintain technical documentation for data pipelines and related solutions.
- Support team collaboration and onboarding of new data sources.
- Collaboration & Problem-Solving:
- Work closely with engineering teams to support data ingestion, processing, and accessibility.
- Troubleshoot data pipeline issues and contribute to reliable data engineering solutions."

Skill Requirements

Must Have Skill

Python,Data Engineering

Good to Have Skill

Apache Airflow,CI/CD

Other Requirements

📌 Senior Technical Lead (Bengaluru)
🏢 HCLTech
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior technical lead (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: senior technical lead (bengaluru) / bengaluru