We are looking for an experienced Senior Data Engineer to own and evolve our data engineering architecture, ensuring reliable, scalable, and high-quality data pipelines. The role will focus on big data architecture, workflow orchestration using Kestra, canonical data models and catalog schemas, LLM evaluation pipelines, and technical leadership within the data engineering team.

The role reports to the Head of Engineering.

Responsibilities

Build, maintain, and evolve data pipelines that write to multiple targets, including PostgreSQL and a vector database.
Integrate external APIs for data enrichment and reliably incorporate the results into the pipeline.
Design and maintain the schemas and data structures that underpin the platform, keeping them coherent as product requirements change.
Operate pipelines to production standards: observable, recoverable, and maintainable by engineers other than the original author.
Essential requirements

Around 3+ years of hands-on data engineering experience,



including independent ownership of production pipelines.
Demonstrable experience writing complex SQL for data modelling and transformation, beyond routine querying.
Demonstrable experience writing Python (or an equivalent scripting language) to integrate APIs and implement pipeline logic.
Proven experience building and operating production-ready data flows in a workflow orchestration tool such as Airflow, Dagster, Prefect, or Kestra.
Robust data-structure design and schema-management skills.
Proficient in English & Comfortable working with globally distributed teams across time zones.

Preferred

Direct experience with Kestra.
Experience with vector databases and embedding workflows.
Experience on Google Cloud Platform (BigQuery, Cloud Run, and related services).
Experience assuming ownership of an existing production pipeline built by another engineer.

📌 Senior Data Engineer Chalakudy
🏢 Aventus Informatics
📍 Chalakudy