Senior AI Product Engineer

About Andela

Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career opportunities with leading organizations, access to a global community of professionals, and educational opportunities with leading technology providers.

At Andela, we're deeply passionate about creating long-lasting and transformative growth opportunities and doing it in an E.P.I.C. way! After applying for this role, you will join our Andela Community of brilliant technologists by passing a technical screening and live interview. As a community member, you'll have access to exclusive technologist opportunities in our global marketplace.

Andela's Benefits

- 100% payment in USD.
- Fully remote opportunity.

About the Role

We are seeking a Senior AI Product Engineer to join an international AI Engineering team responsible for maintaining and improving the quality, reliability, and production performance of Generative AI capabilities across multiple research and knowledge-retrieval products.

This is an AI product-engineering role rather than a pure research or model-training position. You will work on production AI agents, Retrieval-Augmented Generation (RAG), content and indexing pipelines, retrieval quality, AI evaluation, hybrid and graph-assisted search, backend services, and production deployment.

You will operate with significant autonomy on high-complexity systems, taking ownership of delivery and production outcomes while applying strong software-architecture judgment throughout the product lifecycle.

Responsibilities

- Design, develop, deploy, and maintain production AI agents using Python, Large Language Models (LLMs), LangChain, and LangGraph.
- Own agent architecture, workflow state, tool integration, failure recovery, maintainability, and production evolution.
- Apply prompt and context engineering to improve agent behavior, structured outputs, safety, reliability, and overall quality.
- Design and improve Retrieval-Augmented Generation (RAG), knowledge-retrieval, hybrid-search, content-processing, and indexing workflows.
- Work with embeddings, vector databases, semantic search, chunking, metadata, reranking, and other retrieval techniques.
- Extend and improve AI evaluation frameworks, evaluation datasets, regression suites, model-performance monitoring, and quality-analysis pipelines.
- Define systematic quality controls for LLM, retrieval, and agentic AI systems.
- Design and maintain backend services and APIs that expose, consume, integrate, or orchestrate agentic AI capabilities.
- Develop reliable distributed workflows with appropriate failure handling, recovery, and observability.
- Design testing strategies covering both deterministic software behavior and probabilistic AI behavior, including integration and end-to-end testing.
- Own AWS-based deployment practices and contribute to Docker, CI/CD, release safety, monitoring,



and relevant DevOps standards.
- Apply authentication, authorization, secure coding, auditability, and responsible data-handling practices.
- Make architecture decisions and trade-offs involving system boundaries, interfaces, maintainability, migration, observability, security, and scalability.
- Lead significant system changes, identify and resolve delivery risks, and support production operations.
- Collaborate with product, engineering, domain, and platform teams across an international Agile organization.
- Communicate technical decisions, trade-offs, risks, and solutions clearly to technical and non-technical stakeholders.

Qualifications

- 7+ years of professional software-industry experience, ideally 8+ years.
- Bachelor's degree in Computer Science, Information Technology, MIS, or a related field.
- Solid hands-on experience designing, building, testing, debugging, and maintaining production-quality Python systems.
- Broad experience building, deploying, and maintaining LLM-enabled AI agents in production or production-oriented environments.
- Hands-on experience with both LangChain and LangGraph.
- Strong understanding of agentic AI architecture, including workflow orchestration, state management, tool use, failure recovery, and production reliability.
- Practical experience designing, deploying, integrating, or operating software on Amazon Web Services (AWS).
- Strong experience defining or improving systematic AI evaluation and quality-control approaches for LLM, retrieval, or agentic systems.
- Strong knowledge of software architecture and demonstrated autonomous ownership of complex production systems and significant engineering changes.
- Proven backend development, API integration, and distributed workflow-orchestration experience.
- Experience delivering software from conception through deployment and production support.
- Experience working autonomously within Agile engineering teams and coordinating across multiple dependencies.
- Strong written and verbal English communication skills.

Must-Haves

- Advanced production-grade Python development.
- Large Language Models (LLMs) and agentic AI.
- Hands-on production or production-oriented AI agent development.
- LangChain.
- LangGraph.
- Amazon Web Services (AWS).
- Retrieval-Augmented Generation (RAG).
- Vector databases, embeddings, and semantic search.
- Strong AI evaluation and quality-framework experience.
- Prompt and context engineering.
- Backend services and API development.
- Strong software architecture and autonomous technical ownership.
- Docker and CI/CD experience.
- Testing, reliability, and production-support experience.

AI Evaluation & Quality Experience





Candidates should demonstrate hands-on experience with systematic approaches to evaluating AI systems, including areas such as:

- Evaluation datasets and test sets.
- Retrieval and generation quality metrics.
- Agent and workflow evaluation.
- Regression testing for AI behavior.
- Human review and feedback mechanisms.
- Production-quality monitoring.
- Evaluation of probabilistic and non-deterministic behavior.
- Quality analysis and continuous improvement of LLM and retrieval systems.

RAG & Knowledge Retrieval Experience

Candidates should have practical experience with several of the following:

- Retrieval-Augmented Generation (RAG).
- Vector databases.
- Embeddings.
- Semantic search.
- Hybrid search.
- Indexing and content-processing pipelines.
- Chunking strategies.
- Metadata and filtering.
- Reranking.
- Access-controlled retrieval.
- Knowledge-retrieval architectures.

Nice to Have

- Node.js experience alongside Python.
- React.js or other frontend-development experience.
- Model Context Protocol (MCP) server or MCP-enabled workflow experience.
- Hybrid-search or graph-assisted retrieval experience.
- Database and search-platform experience.
- Experience working with research, knowledge, legal, regulatory, or other content-intensive platforms.
- Logging and observability experience using ELK, Kibana, or equivalent technologies.
- Microsoft Copilot or other agentic software-development tools.
- Additional machine-learning or search experience relevant to retrieval and AI quality.

Offer

- Estimated Duration: 6-month contractor position (renewable).
- Work setup: 100% remote.
- Full-time dedication: 40 hours/week.
- Time zone overlap requirement: 5 working hours with CET/CEST.
- Device requirement: BYOD (Bring Your Own Device).
- Location Requirement: Candidates must reside in an eligible country within Africa, Asia, Europe, or Oceania.

At Andela, we know our strengths lie in our diverse community whose talents, perspectives, backgrounds and orientations we take pride in. Andela is committed to nurturing a work environment where all individuals are treated with respect and dignity. Everyone has the right to work in a professional atmosphere that promotes equal employment opportunities and prohibits discriminatory practices. Andela provides equal employment opportunities to all employees and applicants without regard to factors including but not limited to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, pregnancy (including breastfeeding), genetic information, HIV/AIDS or any other medical status, family or parental status, marital status, amnesty or status as a covered veteran in accordance with applicable federal, state and local laws. This commitment applies to all terms and conditions of employment, including but not limited to hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. Our policies expressly prohibit any form of harassment and/or discrimination, as stated above.

Andela is home for all. Come as you are.

📌 Senior AI Product Engineer (India)
🏢 Andela
📍 India