Company Name: VARITE India Private Limited

About The Client

Client is one of the world’s leading professional services firms and the fastest growing Big Four accounting firm

About The Job:

- - You will architect agent systems, optimize memory management for data and context, and guide cross-functional teams to productionize scalable AI solutions.

Essential Job Functions:

- Architect and build LLM-powered agents with robust tool-use, planning, and multi-turn reasoning.

- Design and implement Agent Memory Management: short/long-term memory, vector stores, episodic/semantic memory, retrieval pipelines, and context optimization.

- Develop and operationalize RAG (Retrieval Augmented Generation) systems, prompt orchestration, and context windows management.

- Own end-to-end AI engineering lifecycle: data pipelines, model integration, evaluation, observability, and MLOps for deployment and scaling.

- Optimize cost, latency, and reliability for production-grade agent workflows.

- Collaborate with Product, Data, and Platform teams; mentor junior engineers.

Qualifications

Must-Have Skills

- 7–8 years in software/AI engineering with 3+ years hands-on with LLMs and agent frameworks.

- Strong in Python and one or more: TypeScript/Java/Go.

- Experience with LLM frameworks (LangChain, LlamaIndex, DSPy, OpenAI Assistants, Semantic Kernel, AgentQL, etc.).

- Expertise in vector databases (FAISS, Pinecone, Weaviate, Milvus) and embedding models.

- Deep understanding of prompt design, tool calling, function calling, RAG, evaluation (BLEU/ROUGE, grounding, factuality), and guardrails.

- Hands-on with cloud & MLOps (Azure/AWS/GCP), CI/CD, model versioning, observability (prometheus/logging/tracing).

- Experience with data privacy, PII handling, and responsible AI practices.

Good to Have

- Knowledge of fine-tuning/LoRA, distillation, and model quantization.

- Experience building multi-agent systems, planners, and memory graphs.

- Familiarity with streaming,



event-driven architectures, and message queues (Kafka/Redis).

- Prior experience deploying AI copilots or enterprise assistants.

Education

- BE/BTech/MTech/MS in Computer Science, AI/ML, Data Science, or related fields (or equivalent experience).

Perks & Benefits

- Hybrid work in Pune + cab facility for onsite days.

- Competitive compensation with performance bonus.

- Learning budget, certifications, and access to AI tools.

- Collaborative culture and rapid-paced product environment.

How to Apply: Interested candidates are encouraged to respond/submit their updated resumes, and for additional job opportunities, please visit Jobs In India – VARITE.

Unlock Rewards: Refer Candidates and Earn.

If you're not available or interested in this opportunity, please pass this along to anyone in your network who might be a good fit and interested in our open positions. VARITE offers a Candidate Referral program, where you'll receive a one-time referral bonus based on the following scale if the referred candidate completes a three-month assignment with VARITE.

Experience Level Bonus Referral:

0-2 years

INR 5,000

2-6 years

INR 7,500

6+ years

INR 10,000

About VARITE: VARITE is a global staffing and IT consulting company providing technical consulting and team augmentation services to Fortune 500 Companies in USA, UK, CANADA and INDIA. VARITE is currently a primary and direct vendor to the leading corporations in the verticals of Networking, Cloud Infrastructure, Hardware and Software, Digital Marketing and Media Solutions, Clinical Diagnostics, Utilities, Gaming and Entertainment, and Financial Services.

Equal Opportunity Employer:

VARITE is an equal opportunity employer. We celebrate diversity and are committed to creating an inclusive environment for all employees. We do not discriminate on the basis of race, color, religion, sex, sexual orientation, gender identity or expression, national origin, age, marital status, veteran status, or disability status.

📌 AI Engineer – LLM & Agent Design (Pune)
🏢 VARITE
📍 Pune