Job Type: Contract (6 Months, Extendable)
Work Mode: Remote
Working Hours: 8 hours/day, Monday–Friday (UK time-zone overlap)
Job Summary
We are looking for an experienced Senior Data Engineer to build, manage and optimise production data pipelines for an AI-powered recruitment platform. The role involves data ingestion, processing, quality management and integration with search, matching and ML systems.
Key Responsibilities
Build and maintain reliable data ingestion pipelines and workflows.
Manage data validation, deduplication, incremental updates and recovery.
Work with Go, PostgreSQL and APIs for data processing and orchestration.
Maintain data quality, lineage, monitoring and pipeline performance.
Support vector search, embeddings and ML-based search/matching systems.
Troubleshoot production issues and implement automated testing and recovery processes.
Required Skills & Experience
Solid experience in production data engineering and pipeline management.
Proficiency in Go (Golang), SQL and PostgreSQL.
Experience with APIs, batch processing and asynchronous workflows.
Hands-on experience with vector search and embedding pipelines.
Understanding of data quality, schema evolution, retries and recovery mechanisms.
Experience with cloud environments, deployment and monitoring.
Valuable to Have
Experience with pgvector, Amazon Bedrock and VoyageAI.
Python-based data processing.
Experience with AI/ML, search relevance or entity matching systems.
Recruitment technology or HRTech domain experience.
Contract Details
Initial 6-month contract with potential extension.
Remote prospect (India-based candidates).
Monday–Friday, 8 hours per day, with UK working-hour overlap.
Immediate availability preferred.