15 Oct
|
Graviton Research Capital
|
Gurugram
15 Oct
Graviton Research Capital
Gurugram
Who are we: Graviton Research Capital is one of the largest quantitative trading firms emerging out of APAC, with a strong footprint across global exchanges and a rapidly growing presence across Europe and the USA. We’re long-term focused, and deeply invested in building high-performance teams that operate at scale in some of the most competitive markets globally. You will be part of the team that builds and manages AI platforms.
What you’ll do:
- Deploy and operate open-weight LLMs on our internal servers.
- Build and run an internal LLM gateway/router between in-house and external models.
- Size and manage internal infrastructure capacity across teams: scheduling, monitoring and utilization.
- Tune serving for throughput and latency: KV cache management, batching, quantization and context-length trade-offs.
- Evaluate new models and inference techniques as they appear, and advise on what to adopt.
- Support fine-tuning of models on internal data and help evaluate the results.
- Help teams use the platform with coding assistants, internal tools, retrieval over documentation.
What We’re Looking For:
- 7+ years of engineering experience, preferably in Python.
- Hands-on experience deploying and serving LLMs on on-prem servers.
- Experience with or strong working knowledge of LLM gateways/proxies (LiteLLM, OpenRouter or in-house).
- Understanding of inference concepts: KV cache, batching, quantization, memory limits.
- Working knowledge of fine-tuning and how tuned models are evaluated.
- Actively follows AI developments and can discuss recent models and techniques.
Why Join Us
- Work on challenging and advanced engineering problems
- Flat, engineering-centric culture with peers from robust technical backgrounds
- Fast paced decision-making, high ownership, and long-term focus
- Competitive compensation with strong growth opportunities
📌 AI Platform Engineer (Gurugram)
🏢 Graviton Research Capital
📍 Gurugram