AI Inference Performance (Hyderabad)

AI Inference Performance (Hyderabad)

19 Nov
|
Spydra
|
Hyderabad

19 Nov

Spydra

Hyderabad

Positions: 1 |

Experience:
4–7 years

About the role
You will establish reproducible performance measurement and regression testing for inference services.

Key responsibilities
• Design benchmark suites across models, contexts, concurrency levels and request patterns.
• Measure TTFT, TPOT, inter-token latency, throughput, concurrency and GPU utilisation.
• Run load, stress, endurance and scalability tests with controlled comparisons.
• Compare GPU types, model variants, quantisation and serving frameworks.
• Build automated performance regression pipelines and observability dashboards.
• Evaluate cost per million tokens and power/energy efficiency. Required technical skills Python, Prometheus, Grafana, NVIDIA DCGM, MLPerf methodology, GenAI-Perf or equivalent, load-testing tools, statistics. Expected deliverables Automated benchmark suite, performance baselines, comparison reports and regression dashboards.

📌 AI Inference Performance (Hyderabad)
🏢 Spydra
📍 Hyderabad

Reply to this offer

Impress this employer describing Your skills and abilities, fill out the form below and leave Your personal touch in the presentation letter.

Subscribe to this job alert:

Get the latest job offers by email for: ai inference performance (hyderabad) / hyderabad

Subscribe to this job alert:

Get the latest job offers by email for: ai inference performance (hyderabad) / hyderabad