AI PRE Engineer (Platform Reliability / Production Readiness Engineer)
The Role

An AI PRE Engineer ensures AI/ML platforms are production-ready, highly reliable, observable, secure, and cost-productive, bridging AI engineering, SRE, DevOps, and MLOps disciplines.
Responsibilities:

Define and maintain production readiness standards across platform, data, model, application, and security layers.
Manage the NVIDIA Enterprise AI Software stack and deployment of GPU enabled Kubernetes clusters.
Establish SLO/SLI frameworks for latency, availability, quality, safety, and drift implement error budget policies.
Implement and configure the LLM inferencing services using kServe, NIM, AI Gateways
Curate deployment blueprints (canary/shadow, blue–green, A/B) for models and prompts with rollback guidance.
Standardize observability patterns for prompts, embeddings, latency, cost, quality, and safety telemetry.
Own capacity engineering (token/concurrency budgets, GPU/CPU sizing, vector scaling, cache hierarchies).
Define resilience patterns (timeouts, circuit breakers, fallbacks,



idempotent retries, semantic/prompt caching).
Set AI security baselines (secrets, private networking, egress controls) and mandate red‑team & safety evaluations.
Maintain compliance mappings (e.g., ISO 27001, SOC 2, GDPR/DPDP, HIPAA where applicable).
Provide CI/CD pipelines, SDKs, Helm/Terraform templates, and policy‑as‑code for consistent delivery.
Author PRR checklists, runbooks/playbooks, and DR/BCP blueprints (RTO/RPO, multi‑region/site failover). Drive enablement (trainings, brown-bags) and maintain knowledge repositories and decision records.
Partner with solution teams to validate architecture and non‑functional requirements (scale, latency, cost, safety).
Conduct Production Readiness Reviews (PRRs) and certify releases across performance, security, privacy, and compliance.
Implement observability (tracing, metrics, logs), dashboards, and SLO burn and cost anomaly alerting.
Experience with differ

📌 Platform Engineer (Bengaluru)
🏢 HCLTech
📍 Bengaluru