Data Lineage Engineer - OpenLineage, Marquez, Apache Atlas,Neo4j (Bengaluru)

Data Lineage Engineer - OpenLineage, Marquez, Apache Atlas,Neo4j (Bengaluru)

24 Sep
|
TENARAI TECHNOLOGIES PRIVATE
|
Bengaluru

24 Sep

TENARAI TECHNOLOGIES PRIVATE

Bengaluru

Job Summary A Data Lineage Engineer builds automated systems to map, trace, and visualize the full journey of data across an organizationshowing exactly where data comes from, how it gets transformed, and where it ends up.

Technical Stack

Backend: Java, Spring Boot, REST APIs

Frontend: React, JavaScript, Graph Visualization Libraries (e.g., React Flow, D3.js)

Infrastructure & DevOps: Kubernetes, Docker, CI/CD Pipelines (Jenkins, GitHub Actions, or GitLab CI)

Domain Tools: OpenLineage, Marquez, Apache Atlas, Graph Databases (e.g., Neo4j)

Essential skills and experience

Minimum 8+ years of experience

Backend Lineage Tracking (Java & Spring Boot):

- Develop microservices that intercept data pipelines, capture metadata, and track data movement across APIs and databases.




- Implement open standards (such as OpenLineage) to parse SQL queries and ETL jobs for automated dependency mapping.

Frontend Visualization (React / JavaScript):
- Build interactive, web-based lineage graphs (e.g., node-and-edge DAG views) so developers and analysts can visually trace data flows and run impact analysis.

Infrastructure & Automation (Kubernetes & CI/CD):
- Containerize lineage tracking services and deploy them on Kubernetes.
- Integrate tracking jobs into CI/CD pipelines to ensure metadata capturing is fully automated during software deployments.

📌 Data Lineage Engineer - OpenLineage, Marquez, Apache Atlas,Neo4j (Bengaluru)
🏢 TENARAI TECHNOLOGIES PRIVATE
📍 Bengaluru

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: data lineage engineer - openlineage, marquez, apache atlas,neo4j (bengaluru) / bengaluru

Subscribe to this job alert:

Get the latest job offers by email for: data lineage engineer - openlineage, marquez, apache atlas,neo4j (bengaluru) / bengaluru