Job Description

The Context

Using an AI model through an API is very different from deploying and operating AI systems in production.

Private AI systems require decisions around model selection, inference, evaluation, latency, infrastructure, data pipelines, retrieval, cost, and reliability.

Our AI Engineering team works on this layer.

We are looking for interns who want to understand how modern AI systems work beyond prompt engineering and hosted APIs, and who are interested in learning how models are deployed, evaluated, and integrated into real products.

About the Role

As an AI Engineering Intern, you will work primarily on the AI layer of our products and solutions.

You will help deploy and evaluate open-weight models, build inference and retrieval pipelines, experiment with model configurations, and expose AI capabilities for application teams to use.

You will work primarily with Python and gain hands-on experience with technologies around model serving, LLM inference, embeddings, vector databases, RAG, evaluation frameworks, cloud infrastructure, and open-weight models.





You are not expected to already be an expert in model deployment or fine-tuning. We are looking for robust technical fundamentals, curiosity, and the ability to learn unfamiliar systems quickly.

What You'll Work On

Depending on the project, you may work on:

- Deploying open-weight language and embedding models.

- Building and testing model inference APIs and services.

- Comparing models based on quality, latency, throughput, memory usage, and cost.

- Building RAG pipelines using embeddings, vector databases, and retrieval systems.

- Creating evaluation datasets and running model and application-level evaluations.

- Experimenting with prompts, model parameters, retrieval strategies, and inference configurations.

- Working with GPUs, containers, cloud infrastructure, and model-serving frameworks.

- Investigating model failures and understanding why different models behave differently.

- Documenting experiments so results can be reproduced and compared.

- Working with Software Engineers to expose AI capabilities to production applications.

📌 AI Engineering Intern (Bengaluru)
🏢 Abstrabit Technologies
📍 Bengaluru