02 Oct
|
London Stock Exchange Group
|
Bengaluru
02 Oct
London Stock Exchange Group
Bengaluru
Role Overview:
We are looking for an exceptional AI/GenAI Data Engineer to join our AI Platform team — one of the most technically ambitious initiatives at LSEG. This is not a role to maintain legacy pipelines. You will design and build the systems that make AI possible at HR-market scale.
You will operate at the intersection of data engineering, machine learning infrastructure, and large language model applications. Your work will directly impact products used by the largest financial institutions in the world.
Key responsibilities:
- Design and operate high-throughput, low-latency data pipelines
- Build and maintain the feature stores, vector databases, and data layers that power production ML models and LLM-based applications across LSEG's product suite
- Architect SQL and NoSQL data systems to serve analytical and operational workloads with strict SLAs, and build real-time event streaming pipelines using Apache Kafka
- Implement Redis-based caching and pub/sub systems to support sub-millisecond data access for trading and analytics applications
- Build and deploy machine learning pipelines — from data preprocessing and feature engineering through model training, evaluation, and serving at scale
- Integrate and fine-tune large language models for different tasks
- Design and own CI/CD pipelines for data and ML systems, covering automated testing, model validation, and deployment automation
- Partner with Applied Research, Product Engineering, and Platform teams to translate AI research into reliable, production-grade systems
Must Have Skills:
- LLM & Generative AI: Hands-on experience building LLM-powered applications using APIs from OpenAI, Anthropic, or similar providers. Experience with RAG (Retrieval-Augmented Generation) pipelines, embedding models, vector stores, and frameworks such as LangChain or LlamaIndex. Familiarity with prompt engineering, LLM evaluation techniques, and fine-tuning is strongly preferred.
- MCP (Model Context Protocol): Understandin
📌 AI Data Engineer (Bengaluru)
🏢 London Stock Exchange Group
📍 Bengaluru