Go Developer Intern — AI Inference InfrastructureCompany: Gpu.net

Location:Bangalore - Manaya tech park

Duration: [3 ] months, with possibility of a full-time offer

Stipend: 10000

About usWe run a large-scale AI inference cluster built on next-generation accelerator hardware (Tenstorrent), serving open-weight LLMs and multimodal models to customers through our own API platform. We’re a small team building everything from the request gateway to the tooling that keeps the hardware healthy, so interns work on real production systems from week one.

The roleThis is a versatile role. Depending on what the cluster needs and where your interests lie, you’ll rotate across:

API gateway & request path
Build and improve our inference gateway in Go: routing, auth, API keys, rate limiting and quotas
Handle streaming responses (SSE/WebSockets) for text and audio, and file/URL-based responses for images and video
Input validation, request queuing, load balancing across nodes and models

Observability & metrics
Build services that collect node, accelerator and model-level metrics (throughput, latency, tokens/sec, utilization, errors)
Instrument services with Prometheus/OpenTelemetry and build Grafana dashboards and alerts
Usage metering and per-customer token accounting for billing





Internal tools & cluster operations
CLI tools and internal services for deploying models, health checks and node management
Automation for provisioning, upgrades and incident response
Whatever else it takes to keep the cluster running reliably

What we’re looking for
Solid fundamentals in Go (goroutines, channels, context, error handling, testing), or solid skills in another language plus a willingness to get productive in Go quickly
Understanding of HTTP, REST APIs and basic networking
Comfortable on Linux and the command line
Familiarity with Git and writing clean, tested code
Curiosity about how AI models are actually served in production

Nice to have
Experience with Docker / Kubernetes
Prometheus, Grafana or any observability stack
gRPC, Redis, PostgreSQL, message queues
Exposure to LLM serving (vLLM, OpenAI-compatible APIs, tokenizers)
Open-source contributions or personal projects in Go

What you’ll get
Hands-on work with a production AI cluster, which very few internships offer
Direct mentorship from the engineers who built and run it
Ownership of real features that ship to customers
[PPO opportunity / certificate / flexible schedule / other perks]

📌 Go Developer Bengaluru (India)
🏢 GPUNET
📍 India