02 Aug
|
HDFC Life
|
India
Department : Data Labs
Reporting to : Ayan Chaki
Designation : Senior Manager
Grade : 4
Location : Bengaluru
IC/Team Manager role : IC
: Senior Data Scientist Gen AI (4-7 Years Experience)
What are we looking for?
HDFC Life is seeking a highly skilled and cutting-edge LLM Engineer to drive the development, evaluation, and optimization of Generative AI solutions across business functions. The ideal candidate will have strong expertise in Large Language Models (LLMs), Prompt Engineering, AI Evaluation Frameworks, and Rapid Prototyping, with a passion for building enterprise-grade AI applications that deliver measurable business value.
You will design, develop, and deploy next-gen AI solutions using open-source LLMs, retrieval-augmented generation (RAGs), and Agentic workflows to solve real-world business problems.
This role requires a blend of hands-on experimentation, model evaluation, prompt optimization, and production deployment expertise to accelerate the adoption of Generative AI across the organization.
Key Qualifications :
- 46 years of experience in AI/ML, with 3 years hands-on with Generative AI, LLMs, and NLP applications.
- Proficient in Python, PyTorch, or TensorFlow, with experience in LLM evaluation models.
- Strong exposure to open-source LLMs like Metas LLaMA, Qwen, Gemma etc., and the Hugging Face Transformers &
- PEFT ecosystem.
- Hands-on expertise in Prompt Engineering, including prompt design, optimization, few-shot learning, chain-of-thought prompting, and agentic workflows.
- Practical experience designing and implementing GenAI Evaluation Frameworks, including automated evaluation, benchmarking, hallucination detection, factuality assessment, safety testing, and response quality measurement.
- Understanding and application of Agentic workflowsbuilding multi-step autonomous agents for tasks such as claims processing, underwriting, or customer query handling.
- Experience building Proof of Concepts (POCs), MVPs, and Rapid Prototypes to validate AI use cases and business opportunities.
- Experience working with Cloud AI services (AWS Sagemaker/ GCP Vertex AI/ Azure OpenAI) and containerized deployment (Docker, Kubernetes).
- Understanding of AI governance, responsible AI principles, model observability, and evaluation best practices.
- Excellent communication and stakeholder management skills with the ability to translate business requirements into AI solutions.
What does the job entail?
1. LLM Development &
- Prompt Engineering :
- Design, test, and optimize prompts for a wide range of business use cases including content generation, summarization, Q&A;, document intelligence, and workflow automation.
- Develop reusable prompt libraries, prompt management frameworks, and prompt optimization strategies to improve model performance.
- Evaluate and benchmark multiple LLMs to identify the most suitable models for different business requirements.
- Collaborate with business teams to convert real-world challenges into effective GenAI solutions.
2.
GenAI Evaluation Frameworks :
- Design and implement robust evaluation frameworks to measure accuracy, relevance, grounding, safety, consistency, and business impact of LLM applications.
- Establish automated evaluation pipelines for prompt testing, regression testing, and model benchmarking.
- Define quality metrics, scorecards, and KPIs for GenAI applications across multiple business domains.
- Analyze model outputs and continuously improve performance through prompt refinement and evaluation insights.
3.
Rapid
Prototyping &
- Innovation :
- Build rapid prototypes, Proof of Concepts (POCs), and Minimum Viable Products (MVPs) to validate GenAI opportunities.
- Quickly experiment with emerging AI technologies, frameworks, and methodologies to accelerate innovation.
- Partner with business stakeholders to demonstrate AI capabilities and gather feedback for iterative improvements.
- Support the transition of successful prototypes into scalable production solutions.
4.
Data Integration :
- Collaborate with data engineering teams to ingest structured/unstructured data and develop agents and MCPs that feed into various stages of the GenAI lifecycleretrieval, grounding, generation, and feedback loops.
- Integrate and manage real-time BFSI data feeds to support intelligent, adaptive decision-making via GenAI models.
5.
Deployment and Optimization :
- Package and deploy GenAI applications in production environments using Docker, Kubernetes, and MLOps workflows.
- Continuously monitor model drift, improve performance using live feedback, and adapt to evolving business goals and compliance needs.
- Optimize model cost-performance ratio by intelligently choosing between open-source models, APIs, and hybrid cloud setups.
6. Research &
- Technology Enablement :
- Stay up to date with the latest developments in LLMs, AI agents, reasoning models, evaluation methodologies, and GenAI tooling.
- Assess new frameworks, models, and technologies for enterprise adoption.
- Contribute to internal AI best practices, standards, and knowledge-sharing initiatives.
- Mentor junior team members on Prompt Engineering, GenAI evaluation, and emerging AI technologies.
Education : Bachelors or Masters degree in Computer Science, AI, Data Science, or a related field.
📌 HDFC Life - Senior Data Scientist - Generative AI (India)
🏢 HDFC Life
📍 India