Home/Jobs/Infrastructure Platform Engineer

Infrastructure Platform Engineer

Jmd Technologies Inc

Pune / Bengaluru

6-8 years

1 day ago

$47.0K–60.2K/yr

Full time

Remote

Skills Required LLM

RAG

OpenTelemetry

Azure DevOps

Azure Monitor

ArgoCD

CI/CD

Datadog

Docker

ELK

GitHub Actions

GitOps

Helm

Kubernetes

Python

Description Infrastructure Platform Engineer role focused on production AI/LLM infrastructure, RAG, GPU, and inference platforms.

Company: JMD Technologies Inc

Role: Infrastructure Platform Engineer

Location: Pune / Bangalore | Remote | Office visit as needed

Experience

- 6–8 years of experience
- Hands-on production AI/LLM infrastructure experience

Responsibilities

- Build and support production AI/LLM infrastructure
- Work on RAG pipelines and embeddings infrastructure
- Support GPU infrastructure for A100, H100, and B200 environments
- Support LLM inference platforms using Triton and NIM
- Implement Kubernetes, Docker, Helm, Terraform, and GitOps-based platform workflows
- Use Azure services including Azure DevOps and Azure Monitor
- Set up CI/CD with GitHub Actions
- Operate observability and monitoring with Datadog, ELK, and OpenTelemetry
- Handle SRE practices including on-call, RCA,



and SLO/SLA

Additional Responsibilities

- Work with security and InfoSec requirements

More Skills Azure Platform, Terraform, SRE, RCA, SLO/SLA, Vector DB, Embeddings Infrastructure, Production RAG Pipeline, GPU Infrastructure, A100, H100, B200, LLM Inference, Triton, NIM, AI/ML Infrastructure, Security, InfoSec

Prepare for this role

Recommended resources to build the skills for this position. Sponsored.

Top 10 RAG Quick-Prep Questions

Zenaique A shorter RAG interview prep set for quick review.

Top 20 LLM System Design Questions (Quick)

Zenaique A focused LLM system design interview question set.

Top 50 LLM System Design Interview Questions

Zenaique

Curated LLM system design questions from Zenaique.

More LLM jobs

Senior Developer- Snowflake Cortex AI

Cognizant

United States

Today

Lead Agentic Software Engineer II

Deloitte

Hermitage

Today

AI Engineer

Cornerstone OnDemand

Hyderabad

Today

Opening For GenAI- Python

Cognizant

Chennai

Today

Senior Software Engineer

Cyient

Noida

Today

Agentic Solutions-AI

Deloitte

Bengaluru

Today

📌 Infrastructure Platform Engineer (Bengaluru)
🏢 Top Gen AI Jobs
📍 Bengaluru