Home/Jobs/Sr.AI/ML Engineer

Sr.AI/ML Engineer

G2 Technology Solutions India Pvt Ltd

Coimbatore

4-8 years

Today

$14.5K–28.9K/yr

Full time

Onsite

Skills Required LLM

RAG

Gen AI

Embeddings

Vector Database

Prompt Engineering

LangChain

LlamaIndex agentic workflow design

Fine-tuning

RAGAS

Claude

OpenAI sentence-transformers

GraphRAG

Description Senior AI/ML Engineer to design, build, evaluate and mature the intelligence layer of the Enterprise AI Framework focusing on production-grade Retrieval-Augmented Generation and AI evaluation.

Role: Senior AI/ML Engineer — Enterprise AI Framework

Location: In person

Experience

- 4–8 years overall engineering/AI/ML experience with substantial hands-on software development

Responsibilities

- Design and improve production RAG/retrieval pipelines
- Develop semantic, keyword and hybrid retrieval strategies
- Tune chunking, embeddings, metadata filters, top-K selection and reranking
- Diagnose retrieval failures and improve Recall@K, MRR, precision and related quality measures
- Design evidence-aware context assembly and context prioritization
- Prevent irrelevant/context-overloaded prompts
- Develop and maintain LLM gateway/model abstraction components
- Integrate commercial or open-source LLMs through controlled interfaces
- Implement model timeout, retry, fallback, cost and token controls
- Develop versioned system prompts and structured output contracts
- Build AI guardrails for grounding, citations, unsupported claims, PII and policy constraints
- Work with deterministic business logic and scoring engines without transferring decision authority to an LLM




- Design evaluation datasets/golden sets
- Build automated retrieval, prompt and model regression tests
- Establish trustworthy offline and online AI-quality measurement
- Investigate hallucination, retrieval drift and context-quality failures
- Evaluate and integrate rerankers/cross-encoders where justified
- Work with local and hosted embedding models
- Contribute to graph-assisted retrieval/entity-aware context where quality evidence justifies it
- Support future proactive/agentic workflows while maintaining bounded actions and human accountability
- Instrument AI components for quality, latency, tokens, cost and guardrail outcomes
- Work with Data Engineering to ensure ingestion/indexing quality
- Work with Backend Engineering for APIs, orchestration and security
- Conduct architecture/design reviews and mentor less-experienced AI engineers

Additional Responsibilities

- Ensure responses are grounded in governed enterprise evidence
- Maintain important business decisions as deterministic, auditable and human-controlled
- Work with deterministic business logic and scoring engines

Nice To Have

- Neo4j or graph databases
- LangChain, LlamaIndex, LangGraph or equivalent
- Model gateways such as LiteLLM




- MLflow / Weights & Biases
- AWS AI infrastructure
- Prompt-injection/adversarial testing
- AI security and governance
- Agentic workflow design
- Fine-tuning experience

More Skills Python programming, Machine-learning fundamentals, LLM/Generative AI applications, Semantic search, Vector databases/search platforms, Document chunking and retrieval design, LLM API integration, Prompt/context engineering, Automated evaluation/testing, Retrieval and ranking metrics interpretation, Debugging, System design, Semantic retrieval, Keyword retrieval, Hybrid search, Metadata filtering, Top-K selection, Reranking, Cross-encoders, Context assembly, Grounding, Hallucination, Citations, Retrieval evaluation

Prepare for this role

Recommended resources to build the skills for this position. Sponsored.

Top 50 LLM System Design Interview Questions

Zenaique

Curated LLM system design questions from Zenaique.

Top 15 Fine-tuning Interview Questions (Quick)

Zenaique A shorter fine-tuning interview prep set for quick review.

Top 50 Embeddings Interview Questions

Zenaique

Curated embeddings questions covering models, similarity, and retrieval.

More LLM jobs

(Senior) AI Engineer

Cells

Bengaluru

Today

Software Engineer (Agentic AI, LLM, Python )

Cisco

Bengaluru

Today

Senior AI Solutions Engineer

Sembcrop

Gurugram

Today

AI Engineer – GenAI / LLM / Agentic AI (4+years)

The Growth Hive

Pune

Today

AI Engineer

Ford Motor Company

Chennai

Today

GenAI / Agentic AI engineer

Persistent

Pune

Today

📌 Sr.AI/ML Engineer (Coimbatore)
🏢 Top Gen AI Jobs
📍 Coimbatore