Req ID: 139673 Remote Position: HybridRegion: Asia Country: India State/Province: Chennai City: Guindy, Chennai General Overview
Functional Area: Engineering Career Stream: Design - Software EngineeringSAP Short Name: ENG-ENG-DSEJob Level: Level 07IC/MGR: Individual Contributor Direct/Indirect Indicator: IndirectSummary
The Data Engineer will play a key role in designing and delivering robust data solutions that enable AI and advanced analytics across the organization. This role owns the end‑to‑end data lifecycle: from requirement gathering and data mapping to implementing scalable pipelines, managing metadata, and creating high‑level reporting visualizations.A primary focus of this role is to ingest data from disparate engineering and business tools into a single, curated, well‑structured data lake and data catalogue. The engineer will transform raw, fragmented data into curated, high‑quality datasets from multiple source platforms, so that data scientists can easily discover datasets in the catalogue and export them in table format for modeling and analytics.Detailed Description





Requirement Management: Facilitate deep‑dive sessions with business and technology leaders to gather and manage technical requirements, ensuring data initiatives align with strategic organizational goals.
Data Ingestion & Integration: Design and implement connectors and ingestion jobs that pull data from multiple tools (e.g., Azure DevOps, Jira, test systems, logs) into the central data lake.
Data Curation, Metadata Management & Governance: Lead efforts to clean and curate complex datasets. Develop and maintain data catalogues, metadata, and data mapping documentation to ensure transparency, lineage, and trust across the ecosystem.
End‑to‑End Pipeline & ETL Development: Architect, implement, and optimize scalable ETL/ELT processes, moving data from diverse sources into enterprise‑grade data lake and warehouse environments.
Automation & Python Scripting: Leverage Python to automate data va

📌 07 - Engineer, Software (Chennai)
🏢 Celestica International
📍 Chennai