GPU & ML Infrastructure Engineer

Experience: 10+ Years
Location: Remote

About the Role

We are looking for an experienced GPU & ML Infrastructure Engineer to build, test, monitor, and maintain reliable infrastructure for GPU-based benchmarking, stress testing, telemetry collection, and machine learning workloads.

The role involves working with NVIDIA data-center GPUs and embedded/edge platforms, deploying ML workloads, collecting hardware telemetry, automating testing processes, and ensuring that the resulting data is accurate, consistent, and reproducible.

The engineer will own the end-to-end testing and data-generation process, from preparing recent GPU platforms and deploying workloads to collecting telemetry, validating data, and documenting results.

Key Responsibilities
- Port and adapt existing GPU test procedures to new NVIDIA data-center and edge/embedded platforms.
- Analyze differences in GPU drivers, power/thermal limits, hardware sensors, and telemetry sources across platforms.
- Build and maintain GPU benchmarking, stress-testing, and workload suites.




- Deploy and execute LLM inference and training workloads, including Llama-family models.
- Work with both quantized and full-precision ML models.
- Develop and execute synthetic workloads such as:
- GEMM
- Convolution
- Compute workloads
- Memory-bandwidth workloads
- Multi-GPU workloads
- Vision models for edge platforms
- Ensure GPU workloads are reproducible and consistent across repeated runs.
- Collect and validate hardware telemetry using:
- NVML
- DCGM
- BMC
- IPMI
- Redfish
- Other external/lab-grade measurement equipment
- Ensure consistent sampling rates, timestamps, field names, and clock alignment across telemetry sources.
- Identify and troubleshoot missing, irregular, inconsistent, or inaccurate sensor data.
- Automate infrastructure deployment, workload execution, logging, data collection, and cleanup.
- Build automated data-quality checks for time-series and hardware telemetry data.
- De

📌 GPU & ML Infrastructure Engineer (India)
🏢 Consultbae India
📍 India