Senior Technical Lead Bengaluru (India)

Senior Technical Lead Bengaluru (India)

19 Nov
|
HCL Technologies
|
India

19 Nov

HCL Technologies

India

Job Summary

VOLGJP00043875 - fg- VAS Requirement

Description:

Senior Data Platform Engineer - Volvo Autonomous Solutions, Bangalore.
Senior Data Platform Engineer to join the Volvo Autonomous Solutions team in Bangalore. In this role, the person will design, develop, test, and maintain data engineering solutions, supporting the complete data lifecycle from vehicle-edge ingestion to centralized storage and data lakehouse pipelines. The person will work closely with engineering teams to ensure reliable data ingestion, data quality, and effective access to multi-modal vehicle data.

Key Responsibilities:
Data Pipeline Development:
Design, develop, test, and maintain ETL/ELT data pipelines in production, covering vehicle-edge ingestion through Bronze, Silver, and Gold lakehouse layers.
Implement high-throughput ingestion of large multi-modal vehicle data, including camera, LiDAR, and MCAP recordings.
Ensure reliable, resumable, and restart-protected data transfers from vehicle-edge systems to centralized storage without unnecessary re-uploading.
Database & Data Lakehouse Management:
Work with relational and non-relational databases using Python and SQL.
Implement and maintain object storage and lakehouse solutions using S3-compatible storage, MinIO, Azure ADLS,



Apache Iceberg, or Delta Lake.
Support immutable raw data storage and curated datasets.
Data Quality Assurance:
Implement data quality checks, including checksum validation, schema verification, and time-synchronization checks.
Maintain data contracts, manifests, metadata, and searchable catalogs to ensure data integrity and discoverability.
Workflow Orchestration & Monitoring:
Develop and maintain automated data workflows using orchestration tools such as Apache Airflow.
Implement pipeline monitoring, observability, and alerting to ensure pipeline health.
Data Access & API Development:
Develop data-access APIs using FastAPI or Flask.
Enable efficient access to multi-modal data for internal teams.
Documentation & Knowledge Sharing:
Create and maintain technical documentation for data pipelines and related solutions.
Support team collaboration and onboarding of recent data sources.
Collaboration & Problem-Solving:
Work closely with engineering teams to support data ingestion, processing, and accessibility.
Troubleshoot data pipeline issues and contribute to reliable data engineering solutions.

Skill RequirementsOther Requirements

📌 Senior Technical Lead Bengaluru (India)
🏢 HCL Technologies
📍 India

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: senior technical lead bengaluru (india) / india

Subscribe to this job alert:

Get the latest job offers by email for: senior technical lead bengaluru (india) / india