We are looking for an experienced Senior Data Engineer to own and evolve our data engineering architecture, ensuring reliable, scalable, and high-quality data pipelines. The role will focus on big data architecture, workflow orchestration using Kestra , canonical data models and catalog schemas, LLM evaluation pipelines, and technical leadership within the data engineering team.
The role reports to the Head of Engineering.
Responsibilities
- Build, maintain, and evolve data pipelines that write to multiple targets, including PostgreSQL and a vector database.
- Integrate external APIs for data enrichment and reliably incorporate the results into the pipeline.
- Design and maintain the schemas and data structures that underpin the platform, keeping them coherent as product requirements change.
- Operate pipelines to production standards: observable, recoverable, and maintainable by engineers other than the original author.
Essential requirements
- Around 3+ years of hands-on data engineering experience,
including independent ownership of production pipelines
- .Demonstrable experience writing complex SQL for data modelling and transformation, beyond routine querying
- .Demonstrable experience writing Python (or an equivalent scripting language) to integrate APIs and implement pipeline logic
- .Proven experience building and operating production-ready data flows in a workflow orchestration tool such as Airflow, Dagster, Prefect, or Kestra
- .Solid data-structure design and schema-management skills
- .Proficient in English & Comfortable working with globally distributed team s across time zones
.
Preferred
- Direct experience with Kestra
- .Experience with vector databases and embedding workflows
- .Experience on Google Cloud Platform (BigQuery, Cloud Run, and related services)
- .Experience assuming ownership of an existing production pipeline built by another engineer
.
📌 Senior Data Engineer (Chalakudy)
🏢 Aventus Informatics
📍 Chalakudy
Reply to this offer
Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.