Boston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. Today, we help clients with total transformation-inspiring complex change, enabling organizations to grow, building competitive advantage, and driving bottom-line impact.
To succeed, organizations must blend digital and human capabilities. BCG delivers solutions through leading-edge management consulting along with technology and design, corporate and digital ventures—and business purpose. To realize our aspirations to build a Gen AI assistant that will transform the way BCG works, we are looking for LLM engineers who are passionate about designing, developing, and optimizing GenAI products. You will work within the LLM Squad and your Squad Leader in your domain of expertise, helping to advance the work and using your experience to maximize Squad performance. You will bring expertise in full stack development, Performance, and stability of custom-built products. This role is involved in all aspects of LLM based application including LLM expertise, Data science/ML, backend development including API and core functional logic. Bringing insights from your domain expertise to discussions, helping to guide technical direction and bestpractices.
Identifying where technical expertise is needed and suggesting ways to fill any gaps, whether through yourown contributions, training, or advocating for new resources.

Actively embracing and supporting the organization's new working models, including Agile practices.
BA degree in Computer Science, Statistics, or related field with a focus on Artificial Intelligence,Machine Learning, or Natural Language Processing

- 2+ years of experience developing and experimenting with LLMs




- 3+years of experience developing AI/ML technologies within large and business critical applications

Experience & Skills (Mandatory)
Proficiency in Python and all associated DS libraries and frameworks
Solid knowledge in AI, machine learning, and natural language processing
Experience with leveraging, training and fine-tuning Foundation Models, including multimodal inputs and outputs
Strong experience working with key LLM models APIs (e.g. OpenAI, Anthropic) and LLM Frameworks (e.g. Experience with multi-agent frameworks/systems and an understanding of multi-agent systems and their applications in complex problem-solving scenarios.
Experience with unstructured.io or similar libraries for handling various document formats and extracting structured information from unstructured data.
Expertise in using LlamaIndex for building and querying knowledge bases, including its data connectors,indexing strategies, and query engines.
Proficiency in generating and working with text embeddings using models like BERT, GPT, or domain specific embedding models. Understanding of embedding spaces and their applications in semantic search and information retrieval.
Experience in constructing and querying knowledge graphs, including technologies like Neo4j or RDF triplestores. Experience with RAG concepts and fundamentals (vectorDBs, semantic search, etc.), Expertise in implementing RAG systems that combine knowledge bases with generative AI models.




Experience & Skills (Nice To Have)
Experience with cloud infrastructure for AI/ML
Experience with LLM guardrails
Exeprience with LLM monitoring and observability
Experience with security related to LLM integration
Being a highly skilled Senior AI and LLM Engineer.
Executing both planning and hands-on technical work independently.
Using a data-driven approach to solve technical challenges and make informed decisions.
Applying your systems-level thinking, integrating both data science and engineering principles.
Taking full ownership of the features and projects you work on, delivering high-quality solutions on your own.

YOUR TRAVEL

Mostly from the BCG office, occasionally work at other BCG offices.
We offer multiple career paths for the world's best talent to have a real impact on business and society. As part of our team, you will benefit from the breadth and diversity of what we are doing today and where we are headed next. We believe that in-person collaboration plays an important role in our culture, mentorship, and professional development.
For this role, you will generally be expected to work from a BCG office or in person with clients on a regular basis (typically around 50% of working time), depending on business needs and in line with local policies and practices.
All qualified applicants will receive consideration for employment without regard to race, color, age, religion, sex, sexual orientation, gender identity / expression, national origin, disability, protected veteran status, or any other characteristic protected under national, provincial, or local law, where applicable, and those with criminal histories will be considered in a manner consistent with applicable state and local laws.

📌 Manager, AI/ML Engineering (Gurugram)
🏢 Boston Consulting Group (BCG)
📍 Gurugram