19 Nov
|
Eli Lilly
|
Bengaluru
19 Nov
Eli Lilly
Bengaluru
Job Summary
Product Research Development (PRD) owns the CMC (Chemistry, Manufacturing, and Controls) data that underpins every regulatory submission, batch investigation, and process decision across Lilly's development portfolio, spanning structured systems (LIMS, MES, DMS, ELN) and unstructured scientific content (protocols, batch records, investigation reports). The function operates under strict GxP, data integrity, and audit-readiness requirements. The Advisor/Architect - Data Agentic AI, PRD, builds the engineering backbone that carries PRD content from source to a governed, served agent: ingestion pipelines, ML and NLP components, retrieval services, APIs, and agent runtimes that sit on the Semantic Layer and Knowledge Graph. This role is hands-on, writing and shipping production code across data engineering, ML, and agentic delivery, and equally operates at design and guidance level: setting reference designs, reviewing team designs, and advising the teams that build on the platform. It works alongside the Systems Architect and knowledge graph engineers who own ontology and graph design. This role ensures PRD's agents are built on shared, tested, reusable components rather than one-off pipelines, so each new agent and domain ships faster and stays governable as the footprint scales.
Path/Level
Path/Level: R4/R5 (Advisor/Architect), individual contributor.
Key Responsibilities
- Multi-Modal Data Ingestion - build and operate ingestion pipelines for multi-modal and multi-lingual PRD content (documents, structured records, and beyond text-only formats where relevant), feeding the knowledge graph and vector store with ontology-based tagging.
- ML NLP Components - build entity and relationship extraction, classification, embedding, and LLM-assisted metadata enrichment components, and productionize them with testing, versioning, and monitoring.
- Retrieval Services - implement and tune hybrid graph, vector, and keyword retrieval services for human exploration and agentic tool calls, optimizing precision, recall, latency, and groundedness against agreed evaluation sets.
- Agent Runtimes MCP Services - build agent runtimes and MCP (Model Context Protocol) servers that expose Semantic Layer capabilities (QA, summarization, context retrieval) with tool calling, orchestration, and human-in-the-loop controls.
- Evaluation, Observability Guardrails - build evaluation harnesses, tracing, monitoring, and guardrails for agents, and contribute to a shared prompt library,
so PRDs agentic footprint stays measurable and governable beyond single-agent use cases.
- Full-Stack API Delivery - design and deliver APIs, services, and internal tooling (including front-end where needed) that make Semantic Layer and agent capabilities consumable by domain teams and scientists.
- Platform Engineering DevOps - own CI/CD, containerized deployment, setting management, and monitoring on Azure or AWS, with infrastructure and releases that meet GxP change-control expectations.
- Data Quality, Lineage Compliance Support - build data-quality checks, lineage, and access controls into pipelines and services, and produce the traceability and validation evidence needed to meet FDA 21 CFR Part 11, GxP, and enterprise security and privacy requirements.
- Design Authority Technical Guidance - act as design authority for ingestion, retrieval, and agent services: define reference designs, review team designs and code, advise domain teams on build-versus-reuse decisions and trade-offs, and give technical guidance to engineers building on the platform, while remaining a primary builder.
- Reusable Engineering Patterns - establish reference implementations for ingestion, retrieval, and agent services that domain teams can reuse, reducing fragmentation and delivery time.
- Technology Evaluation - evaluate vector database, orchestration, and agentic frameworks for CMC applicability through staged (Bronze/Silver/Gold) proofs of concept before wider adoption.
- Collaboration Peer Mentorship - work closely with the Systems Architect, knowledge graph engineers, and platform engineers; mentor peers on production data and agent engineering practice.
Technical Strategic Expertise Areas
- Python Production Data Engineering (ETL/ELT, batch and streaming)
- ML NLP Engineering
- Entity/Relationship Extraction
- Embeddings Vector Databases (Azure AI Search, AWS OpenSearch, Pinecone)
- Hybrid Graph-RAG Retrieval
- Agentic AI Multi-Agent Systems
- Agent Orchestration (LangGraph or equivalent)
- MCP (Model Context Protocol)
- Agent Evaluation Observability
- Prompt Context Engineering
- API Service Design (REST)
- Full-Stack Development
- Cloud Platforms (Azure/AWS)
- Containerisation Kubernetes
- CI/CD Infrastructure as Code
- Data Quality, Lineage Access Control
- Knowledge Graph Fundamentals (Neo4j, RDF/OWL)
- Reference Architecture Design Review
- Security Compliance Awareness
- Stakeholder Communication
Basic Qualifications
- Proven track record delivering production data, ML, and agentic systems end to end, building them rather than overseeing others who build them.
- Hands-on production Python across data engineering and ML.
- Experience operating agents in production with tool calling, orchestration, evaluation, and observability, beyond single-agent RAG or QA systems.
- Experience building retrieval systems on vector stores and tuning them against measured quality.
- Evidence of end-to-end ownership, from ingestion through to a served, monitored endpoint.
- Experience operating at both levels: building hands-on, and defining reference designs, reviewing others work, and advising teams on trade-offs.
- Experience partnering with architects, engineers, and business or science stakeholders to turn requirements into delivered services.
Additional Qualifications / Competencies
- Exposure to Neo4j or GraphDB, RDF/OWL, and Graph-RAG patterns.
- Experience in pharmaceutical, life sciences, or other GxP-regulated environments, including traceability, validation, and access control.
- Experience exposing knowledge or data services to LLM and agent consumption via MCP or equivalent tool-calling interfaces.
- Experience with multi-modal or multi-lingual content pipelines.
- Front-end or internal-tooling experience.
- Comfortable explaining engineering trade-offs to senior, non-technical stakeholders.
Required Leadership Capabilities
- Goes deep technically and communicates trade-offs in business-relevant terms.
- Gives design guidance and advice to teams building on the platform, and reviews designs and code, while remaining a primary builder.
- Takes ownership of a component or capability and sees it through to production and operation.
- Raises design concerns early and unblocks peers without needing a formal people-manager structure.
- Systems thinking that connects pipeline, retrieval, and agent design choices to downstream scientific workflows and business outcomes.
Disclaimer: This job posting has been aggregated from external source. Role details, content, and availability are subject to change. Applicants are advised to confirm the latest information directly on the company website before applying.
📌 PR&D - Advisor/Architect - Data & Agentic AI (Bengaluru)
🏢 Eli Lilly
📍 Bengaluru