Go Developer Intern — AI Inference InfrastructureCompany: Gpu.net

Location:Bangalore - Manaya tech park

Duration: [3 ] months, with possibility of a full-time offer

Stipend: 10000

About usWe run a large-scale AI inference cluster built on next-generation accelerator hardware (Tenstorrent), serving open-weight LLMs and multimodal models to customers through our own API platform. We’re a small team building everything from the request gateway to the tooling that keeps the hardware healthy, so interns work on real production systems from week one.

The roleThis is a flexible role. Depending on what the cluster needs and where your interests lie, you’ll rotate across:

API gateway & request path

- Build and improve our inference gateway in Go: routing, auth, API keys, rate limiting and quotas
- Handle streaming responses (SSE/WebSockets) for text and audio, and file/URL-based responses for images and video
- Input validation, request queuing, load balancing across nodes and models

Observability & metrics

- Build services that collect node, accelerator and model-level metrics (throughput, latency, tokens/sec, utilization, errors)
- Instrument services with Prometheus/OpenTelemetry and build Grafana dashboards and alerts
- Usage metering and per-customer token accounting for billing





Internal tools & cluster operations

- CLI tools and internal services for deploying models, health checks and node management
- Automation for provisioning, upgrades and incident response
- Whatever else it takes to keep the cluster running reliably

What we’re looking for

- Solid fundamentals in Go (goroutines, channels, context, error handling, testing), or strong skills in another language plus a willingness to get productive in Go quickly
- Understanding of HTTP, REST APIs and basic networking
- Comfortable on Linux and the command line
- Familiarity with Git and writing clean, tested code
- Curiosity about how AI models are actually served in production

Nice to have

- Experience with Docker / Kubernetes
- Prometheus, Grafana or any observability stack
- gRPC, Redis, PostgreSQL, message queues
- Exposure to LLM serving (vLLM, OpenAI-compatible APIs, tokenizers)
- Open-source contributions or personal projects in Go

What you’ll get

- Hands-on work with a production AI cluster, which very few internships offer
- Direct mentorship from the engineers who built and run it
- Ownership of real features that ship to customers
- [PPO opportunity / certificate / flexible schedule / other perks]

📌 Go Developer (Bengaluru)
🏢 GPUNET
📍 Bengaluru