Location: Remote, India
Schedule: Regular overlap with U.S. Eastern Time

We are looking for a Senior Applied AI Backend Engineer to help make our AI workflows reliable, secure, testable, and production-ready.

The Role
This is a backend-oriented applied AI engineering position.
You will build and maintain production LLM workflows, prompt systems, evaluation frameworks, backend services, database processes, and transcription integrations.
The primary focus is not frontend development or custom model training. The focus is turning probabilistic AI behavior into controlled, measurable, and defensible production systems.

Responsibilities
LLM Systems and Prompt Engineering
Design and maintain multi-stage LLM workflows.
Develop, test, version, and optimize system prompts, task prompts, evaluation rubrics, and structured outputs.
Build reliable context-construction and prompt-orchestration processes.
Implement model routing based on quality, latency, cost, availability, and task complexity.
Design retry, fallback, timeout, repair, and graceful-degradation strategies.




Understand the strengths and limitations of major commercial LLM providers.
Determine when requirements should be enforced through prompts, deterministic code, validation, or database controls.
Implement explicit handling for insufficient evidence, conflicting data, malformed responses, and unsupported conclusions.
LLM Evaluations and Promptfoo
Serve as a primary owner of Promptfoo implementation.
Build and maintain automated LLM evaluation suites.
Create representative datasets covering normal, difficult, ambiguous, and adversarial scenarios.
Develop deterministic, semantic, schema-based, model-graded, and custom assertions.
Compare prompts, models, configurations, and fallback strategies.
Establish measurable quality thresholds and release gates.
Integrate evaluations into CI/CD processes.
Convert production failures into permanent regression tests.
Identify whether failures originate in prompts, models, data

📌 Senior Applied AI Backend Engineer (India)
🏢 Pumex Computing
📍 India