27 Oct
|
Conceit Consultancy Services
|
India
27 Oct
Conceit Consultancy Services
India
Senior Data Scientist – Generative AI & Agentic SystemsClient: Neurealm
Engagement: Contract-to-Contract (C2C)
Work mode: Remote
Experience: 8+ years of relevant professional experience
Monthly budget: ₹1.85 lakh
Role OverviewWe are seeking a hands-on Senior Data Scientist to develop and improve Generative AI capabilities for Contact Center and Unified Communications products.
You will build AI agents that understand customer needs, retrieve relevant knowledge, use tools effectively and complete complex tasks. The role focuses on integrating and evaluating provider-hosted Large Language Models (LLMs).
You will collaborate with software engineers, AI/ML engineers, product managers and domain experts to take solutions from experimentation to production. This is an individual contributor role requiring independent technical judgment and strong execution.
Key Responsibilities
- Develop, evaluate and improve production GenAI applications and AI agents.
- Optimize agent reasoning, tool selection, tool execution, context management, personalization and multi-step workflows.
- Design and refine prompts, structured instructions, context-building strategies and structured outputs.
- Build and optimize Retrieval-Augmented Generation (RAG) pipelines, including embeddings, semantic search, retrieval, ranking and context selection.
- Compare models, prompts, retrieval strategies and agent configurations through systematic experimentation.
- Define evaluation frameworks, benchmarks, datasets and metrics covering accuracy, relevance, task completion, reliability, safety and customer experience.
- Design offline and online experiments to measure meaningful improvements.
- Diagnose and mitigate hallucinations, retrieval failures, inconsistent responses and unsuccessful tool execution.
- Analyze production traces,
evaluation results and customer feedback to identify regressions and improvement opportunities.
- Partner with engineering teams to deliver scalable, reliable, secure and observable GenAI services.
- Implement safeguards for grounding, output validation, privacy, security and prompt-injection protection.
- Write maintainable, tested, production-quality Python code.
Required Skills & Experience
- 8+ years of professional experience in data science, applied AI, machine learning, software engineering or a related field, including meaningful hands-on GenAI experience.
- Robust Python programming and software engineering skills.
- Practical experience integrating provider-hosted LLMs into applications.
- Hands-on experience with RAG, embeddings, semantic search and retrieval optimization.
- Experience developing tool-using AI agents and multi-step workflows.
- Strong understanding of prompt engineering, context management and structured LLM outputs.
- Experience evaluating LLM applications using datasets, benchmarks and measurable success criteria.
- Knowledge of experimental design, statistical analysis and offline/online testing.
- Ability to troubleshoot production AI systems and translate findings into improvements.
- Ability to work independently when requirements are ambiguous and collaborate effectively across teams.
Preferred Experience
- Conversational AI or voice AI.
- Contact Center or Unified Communications products.
- Vector databases and LLM observability platforms.
- Production monitoring, responsible AI safeguards and GenAI security.
Application DetailsPlease share your updated resume along with:
- Total and relevant experience
- Hands-on GenAI experience
- Current location
- Notice period or earliest joining date
- Expected monthly C2C rate
- A brief summary of a production RAG or AI-agent project
📌 Senior Data Scientist – Generative AI & Agentic Systems (India)
🏢 Conceit Consultancy Services
📍 India