21 Nov
|
HCLTech
|
Bengaluru
Job Summary
VOLVO IT - VAS Requirement -VOLGJP00043871 "We are looking for a Senior Data Engineer to join VAS team. In this role, resource will establish and maintain high-quality data environments, ensuring consistent and secure access for all authorized users. Will work closely with multiple project and product delivery teams, providing data engineering leadership and end-to-end support throughout the data lifecycle. As a key interface with stakeholders, will deliver scalable data engineering solutions that drive our mission forward.
Key Responsibilities:
- Data Pipeline Development:
- Design, develop, and maintain data pipelines for uploading, ingesting, extracting, transforming, and loading (ETL/ELT) data from diverse sources into our data lake.
- Implement advanced data ingestion techniques, including handling multiple file formats (with a focus on time series data such as Mcap and MDF4).
- Database & Data Lakehouse Management:
- Architect, implement, and maintain relational and non-relational databases to support scalable, high-performance data storage and retrieval.
- Design, maintain, and optimize the Data Lakehouse solution to enable unified analytics, productive data governance, and seamless integration between structured and unstructured data.
- Ensure robust data security, access controls, and compliance across all data platform.
- Data Quality Assurance:
- Participate in rigorous testing and monitoring to ensure data accuracy and integrity across all pipelines.
- Documentation & Knowledge Sharing:
- Create and maintain comprehensive documentation for data pipelines and architecture.
- Actively update team documentation in Confluence and contribute feedback to team roadmaps.
- Foster knowledge transfer and support ongoing maintenance by team members.
- Collaboration & Problem-Solving:
- Work with cross-functional teams to troubleshoot and resolve data-related issues.
- Review colleagues’ code and deliveries, ensuring clean coding practices and high standards."
Key Responsibilities
"We are looking for a Senior Data Engineer to join VAS team. In this role, resource will establish and maintain high-quality data environments, ensuring consistent and secure access for all authorized users. Will work closely with multiple project and product delivery teams, providing data engineering leadership and end-to-end support throughout the data lifecycle. As a key interface with stakeholders, will deliver scalable data engineering solutions that drive our mission forward.
Key Responsibilities:
- Data Pipeline Development:
- Design, develop, and maintain data pipelines for uploading, ingesting, extracting, transforming, and loading (ETL/ELT) data from diverse sources into our data lake.
- Implement advanced data ingestion techniques, including handling multiple file formats (with a focus on time series data such as Mcap and MDF4).
- Database & Data Lakehouse Management:
- Architect, implement, and maintain relational and non-relational databases to support scalable, high-performance data storage and retrieval.
- Design, maintain, and optimize the Data Lakehouse solution to enable unified analytics, efficient data governance, and seamless integration between structured and unstructured data.
- Ensure robust data security, access controls, and compliance across all data platform.
- Data Quality Assurance:
- Participate in rigorous testing and monitoring to ensure data accuracy and integrity across all pipelines.
- Documentation & Knowledge Sharing:
- Create and maintain comprehensive documentation for data pipelines and architecture.
- Actively update team documentation in Confluence and contribute feedback to team roadmaps.
- Foster knowledge transfer and support ongoing maintenance by team members.
- Collaboration & Problem-Solving:
- Work with cross-functional teams to troubleshoot and resolve data-related issues.
- Review colleagues’ code and deliveries, ensuring clean coding practices and high standards."
Skill Requirements
Must Have Skill
DataStage Designer,Informatica
Good to Have Skill
Other Requirements
📌 Senior Technical Lead (Bengaluru)
🏢 HCLTech
📍 Bengaluru