bench(concurrency): add ragged paired benchmark - #596

Open

Graffioh wants to merge 13 commits into

Luce-Org:mainfrom

Graffioh:codex/ragged-concurrency-benchmark

Commits on Aug 14, 2026

feat(serving): consolidate concurrent paged serving
Graffioh
committed
7eae5fe
perf(paged): support causal ragged prefill
Graffioh
committed
51fc0ca
perf(qwen35): pack ragged concurrent prefills
Graffioh
committed
f4f30d7
docs(paged): document Qwen36 concurrency optimization experiments
Graffioh
committed
2e88268
perf(qwen35): use hipBLASLt for gfx1151 concurrency
Graffioh
committed
95c565c
perf(qwen35): add concurrent ROCTX markers
Graffioh
committed
eb0e519
perf(qwen35): tune Q4_K MMQ tiles for RDNA
Graffioh
committed
7207c3c
bench(concurrency): add ragged paired benchmark
Graffioh
committed
ef49d85
bench(concurrency): report decode-facing throughput
Graffioh
committed
15b395a
fix(bench): drop obsolete prefill tuning flags
Graffioh
committed
7c16d8c
bench(concurrency): add canonical workload matrix
Graffioh
committed
faf9648
bench(concurrency): document workload crossover
Graffioh
committed
c781578
refactor(bench): consolidate concurrency harness tools
Graffioh
committed
20e3cf1