14 Nov
|
Asper.ai
|
Bengaluru
14 Nov
Asper.ai
Bengaluru
Position Overview : We are looking for an Gen AI/Agentic Engineer with a solid software engineering background and recent hands-on experience in GenAI / Agentic Engineering.
The role requires someone who has owned and scaled entire product engineering systems and can design, build, and deploy enterprise grade autonomous and semiautonomous AI agents that power high impact decision workflows.
Key Skills Required :
Core Software Engineering (non-negotiable)
- Data structures & algorithms, system design
- Python (strong), plus one of Go/Java/TypeScript
- REST/gRPC API design, microservices architecture
- Distributed systems, concurrency, async programming
- Git, CI/CD, Docker, Kubernetes
- Unit/integration testing, TDD
- SQL + at least one NoSQL (Postgres, MongoDB, Redis)
GenAI / Agentic Inference & Deployment
- Model serving: vLLM,
TensorRT-LLM, Triton Inference Server, TGI (Text Generation Inference)
- Quantization (GPTQ, AWQ, GGUF), model compression, latency/throughput optimization
- GPU infra: CUDA basics, batching strategies, KV-cache optimization
- Multi-provider LLM routing / gateway design (OpenAI, Anthropic, Azure OpenAI, Bedrock, Vertex AI)
- Cloud platforms: Azure (AI Foundry, Azure OpenAI), AWS (Bedrock, SageMaker) GCP as a plus
- Observability: OpenTelemetry, LLM-specific tracing (LangSmith, Arize Phoenix, Langfuse)
- Cost/latency optimization, caching strategies, autoscaling for inference workloads
📌 Senior Gen AI/Agentic Engineer (Bengaluru)
🏢 Asper.ai
📍 Bengaluru