Working Hours: 8 hours/day, Monday–Friday (UK time-zone overlap)
Job Summary
We are looking for an experienced Senior Data Engineer to build, manage and optimise production data pipelines for an AI-powered recruitment platform. The role involves data ingestion, processing, quality management and integration with search, matching and ML systems.
Key Responsibilities
- Build and maintain reliable data ingestion pipelines and workflows.
- Manage data validation, deduplication, incremental updates and recovery.
- Work with Go, PostgreSQL and APIs for data processing and orchestration.
- Maintain data quality, lineage, monitoring and pipeline performance.
- Support vector search, embeddings and ML-based search/matching systems.
- Troubleshoot production issues and implement automated testing and recovery processes.
Required Skills & Experience
- Solid experience in production data engineering and pipeline management.
- Proficiency in Go (Golang), SQL and PostgreSQL.
- Experience with APIs, batch processing and asynchronous workflows.
- Hands-on experience with vector search and embedding pipelines.
- Understanding of data quality, schema evolution, retries and recovery mechanisms.
- Experience with cloud environments, deployment and monitoring.
Good to Have
- Experience with pgvector, Amazon Bedrock and VoyageAI.
- Python-based data processing.
- Experience with AI/ML, search relevance or entity matching systems.
- Recruitment technology or HRTech domain experience.
Contract Details
- Initial 6-month contract with potential extension.
- Remote opportunity (India-based candidates).
- Monday–Friday, 8 hours per day, with UK working-hour overlap.
- Immediate availability preferred.