About KiteFishAI

KiteFishAI is an AI research lab focused on building efficient, domain-specialized and sovereign Large Language Models (LLMs) and Small Language Models (SLMs).

We work across the full model development stack — from data and model architecture to pretraining, post-training, evaluation, inference and deployment. Our goal is to build models that are not only capable, but efficient, reliable and helpful for real-world applications.

We are a research-first team. We believe that building strong models requires understanding what happens underneath the APIs and frameworks — from data quality and tokenization to optimization, distributed training and model behavior.

We are looking for a Research Engineer — LLM Pretraining & Systems to work closely with our research team on building and improving the next generation of KiteFishAI models.

What You’ll Work On

Research and implement improvements across LLM architecture, pretraining, optimization, data and evaluation
Build and experiment with Transformer-based language models from the ground up




Design and execute controlled experiments to understand model behavior and training dynamics
Develop data pipelines for collecting, cleaning, filtering, deduplicating and preparing large-scale training datasets
Experiment with tokenization, data mixtures, sequence lengths and sampling strategies
Work on training efficiency, memory optimization and GPU utilization
Implement and optimize distributed training across multiple GPUs and machines
Investigate training instability, convergence, scaling and model quality
Evaluate models using both standard benchmarks and internally designed evaluations
Read and reproduce ideas from recent research papers and determine whether they improve our models
Build internal tools for training, evaluation, experimentation and model analysis
Contribute across the stack — from low-level GPU and PyTorch optimizations to high-level model design
Work closely with the team to take research ide

📌 Research Engineer, Pretraining (Gurugram)
🏢 KiteFishAI
📍 Gurugram