02 Oct
|
Tenarai
|
Vasanthanagar
02 Oct
Tenarai
Vasanthanagar
Job DescriptionJob Summary
nA Data Lineage Engineer builds automated systems to map, trace, and visualize the full journey of data across an organization showing exactly where data comes from, how it gets transformed, and where it ends up.
nWork Location: Bengaluru / Noida / Mumbai / Pune
nTechnical Stack
nBackend: Java, Spring Boot, REST APIs
nFrontend: React, JavaScript, Graph Visualization Libraries (e.g., React Flow, D3.js)
nInfrastructure & DevOps: Kubernetes, Docker, CI/CD Pipelines (Jenkins, GitHub Actions, or GitLab CI)
nDomain Tools: OpenLineage, Marquez, Apache Atlas, Graph Databases (e.g., Neo4j)
nEssential skills and experience
nMinimum 8+ years of experience
nBackend Lineage Tracking (Java & Spring Boot):
n● Develop microservices that intercept data pipelines, capture metadata, and track data movement
nacross APIs and databases.
n● Implement open standards (such as OpenLineage) to parse SQL queries and ETL jobs for automated dependency mapping.
nFrontend Visualization (React / JavaScript):
n● Build interactive, web-based lineage graphs (e.g., node-and-edge DAG views) so developers and
nanalysts can visually trace data flows and run impact analysis.
nInfrastructure & Automation (Kubernetes & CI/CD):
n
- n
- Containerize lineage tracking services and deploy them on Kubernetes.n
- Integrate tracking jobs into CI/CD pipelines to ensure metadata capturing is fully automated during software deployments.n
📌 Data Lineage Engineer (Vasanthanagar)
🏢 Tenarai
📍 Vasanthanagar