This repository was archived by the owner on Jun 5, 2026. It is now read-only.

Repository navigation

This repository was archived by the owner on Jun 5, 2026. It is now read-only.

Issues

Ephemeral Port Exhaustion
AI-Hypercomputer/inference-benchmark#26 · opened on Mar 28, 2025
Rename output metrics
AI-Hypercomputer/inference-benchmark#25 · opened on Mar 28, 2025
Display the input / output distribution in detailed histogram buckets
AI-Hypercomputer/inference-benchmark#18 · opened on Mar 25, 2025
Add an option to output a trace of all requests
AI-Hypercomputer/inference-benchmark#17 · opened on Mar 25, 2025
A helm chart to run the benchmark
AI-Hypercomputer/inference-benchmark#14 · opened on Mar 13, 2025
Report input, output and total tokens throughput in tokens / sec instead of tokens / min
AI-Hypercomputer/inference-benchmark#6 · opened on Mar 4, 2025
Report ITL and TPOT in milliseconds
AI-Hypercomputer/inference-benchmark#5 · opened on Mar 4, 2025