AI/ML Engineer (Open-Source LLM – BFSI Domain)

Job Title: AI/ML Engineer (Open-Source LLM – BFSI Domain)

Location: Brookefield, Bengaluru

Employment Type: Full time

Work Schedule: Monday to Saturday (Alternate Saturdays Off)

Working Hours: 9:00 AM – 6:00 PM (Extendable based on project requirements)

About the Role

We are seeking a talented AI/ML Engineer with hands-on experience in building, fine-tuning, and deploying Open-Source Large Language Models (LLMs) for the Banking, Financial Services, and Insurance (BFSI) domain. The ideal candidate will have practical experience developing production-ready AI solutions and a passion for leveraging Generative AI to solve real-world business challenges.

In this role, you will collaborate with Product, Engineering, and Data Science teams to design intelligent AI solutions that enhance customer experience, automate business processes, and improve operational efficiency.

Key Responsibilities

Design, develop, fine-tune, and deploy Open-Source LLMs for BFSI use cases.

Build AI-powered applications using modern LLM frameworks and orchestration tools.

Collaborate with Product Managers, Data Scientists, and Software Engineers to understand business requirements and deliver scalable AI solutions.

Conduct model experimentation, evaluation, optimization, and performance benchmarking using real-world datasets.

Implement Retrieval-Augmented Generation (RAG), prompt engineering, vector databases, and AI workflows where applicable.

Monitor model performance in production environments and continuously improve model accuracy, latency, and scalability.

Ensure AI solutions comply with enterprise security, privacy, and regulatory standards.

Develop APIs and integrate AI models into enterprise applications.

Maintain technical documentation, architecture diagrams, and deployment procedures.

Stay updated with the latest advancements in Artificial Intelligence, Machine Learning, and Open-Source LLM technologies.

Required Qualifications

Education





Bachelor's degree in Computer Science, Artificial Intelligence, Information Technology, Engineering, or a related technical field.

Equivalent practical experience will also be considered.

Experience

Minimum 2+ years of hands-on AI/ML development experience.

Experience in the BFSI domain is preferred.

Proven experience building and deploying AI/ML solutions in production environments.

Technical Skills

Programming Languages

Python (Mandatory)

Java (Preferred)

AI/ML Frameworks

PyTorch

TensorFlow

Scikit-learn

Open-Source LLM Technologies

Experience with one or more of the following:

LangChain

LangGraph

Ollama

Hugging Face Transformers

Llama

Mistral

DeepSeek

Qwen

vLLM

FastAPI

Generative AI

Prompt Engineering

Fine-Tuning LLMs

Retrieval-Augmented Generation (RAG)

Embeddings

Vector Databases (FAISS, ChromaDB, Milvus, Pinecone, etc.)

Model Evaluation and Optimization

Additional Skills

Docker

Kubernetes (Preferred)

REST APIs

Git

Linux

CI/CD pipelines

Core Competencies

Strong analytical and problem-solving skills.

Excellent understanding of AI/ML concepts and LLM architectures.

Ability to communicate technical concepts to non-technical stakeholders.

Strong interpersonal and collaboration skills.

Self-motivated with a passion for continuous learning and innovation.

Preferred Experience

Experience in any of the following areas will be an added advantage:

Banking & Financial Services applications

Fraud Detection

Credit Risk Assessment

Intelligent Document Processing

Loan Processing Automation

Customer Support Chatbots

Regulatory Compliance

OCR & Document AI

Agentic AI and Multi-Agent Systems

Interview Process

Round 1 – Technical Interview

Conducted by: Senior AI Engineer

Assessment includes:

Python Programming

Machine Learning Fundamentals

Open-Source LLMs

LangChain & RAG

Coding and Problem Sol…

Skills:- Python, Huggingface, Stackless Python, Retrieval Augmented Generation (RAG), Open-source LLMs, Prompt engineering, Stani's Python Editor and prometheus

📌 AI/ML Engineer (Open-Source LLM – BFSI Domain) (Bengaluru)
🏢 IMPACTO DIGIFIN TECHNOLOGIES
📍 Bengaluru