Skip to content

CI: Update baseline.json (from PR #286) - #303

Open
MingxuZh wants to merge 1 commit into
mainfrom
ci/update-baseline-pr-286
Open

CI: Update baseline.json (from PR #286) #303
MingxuZh wants to merge 1 commit into
mainfrom
ci/update-baseline-pr-286

Conversation

@MingxuZh

@MingxuZh MingxuZh commented Jul 16, 2026

Copy link
Copy Markdown
Collaborator

Fused MoE Benchmark Comparison

Ratio = log / baseline (lower is better)

LOWER (log < baseline)

num_tokens - num_experts - topk - hidden_size - shard_intermediate_size log baseline ratio
fused_moe:1-32-4-2880-2880-torch.bfloat16-False-silu 0.314 0.321984 -2.47%
fused_moe:1-32-4-2880-2880-torch.bfloat16-True-silu 0.322 0.325 -1.02%
fused_moe:1-64-6-1280-1792-torch.bfloat16-False-silu 0.180 0.188084 -4.56%
fused_moe:1-64-6-1280-1792-torch.bfloat16-True-silu 0.183 0.194532 -5.80%
fused_moe:1-64-8-3584-1280-torch.bfloat16-False-silu 0.332 0.343252 -3.18%
fused_moe:1-64-8-3584-1280-torch.bfloat16-True-silu 0.347 0.357656 -3.00%
fused_moe:1-64-8-3584-640-torch.bfloat16-False-silu 0.214 0.225888 -5.11%
fused_moe:1-64-8-3584-640-torch.bfloat16-True-silu 0.227 0.238888 -5.18%
fused_moe:1-8-2-4096-3584-torch.bfloat16-False-silu 0.277 0.283218 -2.05%
fused_moe:1-8-2-4096-3584-torch.bfloat16-True-silu 0.284 0.289796 -2.17%
fused_moe:1-8-2-4096-7168-torch.bfloat16-False-silu 0.475 0.481052 -1.29%
fused_moe:1-8-2-4096-7168-torch.bfloat16-True-silu 0.483 0.48386 -0.08%
fused_moe:1-8-2-8192-16384-torch.bfloat16-False-gelu 1.877 1.88053 -0.20%
fused_moe:1-8-2-8192-16384-torch.bfloat16-True-gelu 1.881 1.88235 -0.07%
fused_moe:1024-32-4-2880-2880-torch.bfloat16-False-silu 2.546 2.56875 -0.87%
fused_moe:1024-32-4-2880-2880-torch.bfloat16-True-silu 2.673 2.67636 -0.14%
fused_moe:1024-64-6-1280-1792-torch.bfloat16-False-silu 1.397 1.45122 -3.72%
fused_moe:1024-64-6-1280-1792-torch.bfloat16-True-silu 1.412 1.46702 -3.75%
fused_moe:1024-64-8-3584-1280-torch.bfloat16-False-silu 3.088 3.1779 -2.83%
fused_moe:1024-64-8-3584-1280-torch.bfloat16-True-silu 3.057 3.14314 -2.74%
fused_moe:1024-64-8-3584-640-torch.bfloat16-False-silu 1.971 2.058 -4.21%
fused_moe:1024-64-8-3584-640-torch.bfloat16-True-silu 1.973 2.05785 -4.13%
fused_moe:1024-8-2-4096-3584-torch.bfloat16-False-silu 1.696 1.70544 -0.53%
fused_moe:1024-8-2-4096-3584-torch.bfloat16-True-silu 1.591 1.59835 -0.45%
fused_moe:1024-8-2-4096-7168-torch.bfloat16-False-silu 2.927 2.93051 -0.11%
fused_moe:1024-8-2-4096-7168-torch.bfloat16-True-silu 2.698 2.70124 -0.14%
fused_moe:1024-8-2-8192-16384-torch.bfloat16-False-gelu 14.182 14.2169 -0.25%
fused_moe:1024-8-2-8192-16384-torch.bfloat16-True-gelu 16.841 16.9499 -0.64%
fused_moe:128-32-4-2880-2880-torch.bfloat16-True-silu 2.139 2.17511 -1.65%
fused_moe:128-64-6-1280-1792-torch.bfloat16-False-silu 1.117 1.12627 -0.81%
fused_moe:128-64-6-1280-1792-torch.bfloat16-True-silu 1.133 1.13706 -0.37%
fused_moe:128-64-8-3584-1280-torch.bfloat16-False-silu 2.279 2.30407 -1.11%
fused_moe:128-64-8-3584-1280-torch.bfloat16-True-silu 2.291 2.30474 -0.60%
fused_moe:128-64-8-3584-640-torch.bfloat16-False-silu 1.199 1.21836 -1.55%
fused_moe:128-64-8-3584-640-torch.bfloat16-True-silu 1.215 1.23094 -1.26%
fused_moe:128-8-2-4096-7168-torch.bfloat16-False-silu 2.041 2.04344 -0.14%
fused_moe:128-8-2-4096-7168-torch.bfloat16-True-silu 2.060 2.1527 -4.32%
fused_moe:128-8-2-8192-16384-torch.bfloat16-False-gelu 8.539 8.5422 -0.04%
fused_moe:2048-32-4-2880-2880-torch.bfloat16-False-silu 3.812 3.86558 -1.39%
fused_moe:2048-32-4-2880-2880-torch.bfloat16-True-silu 3.850 3.90151 -1.32%
fused_moe:2048-64-6-1280-1792-torch.bfloat16-False-silu 1.740 1.84543 -5.72%
fused_moe:2048-64-6-1280-1792-torch.bfloat16-True-silu 1.765 1.87338 -5.77%
fused_moe:2048-64-8-3584-1280-torch.bfloat16-False-silu 4.794 4.94832 -3.12%
fused_moe:2048-64-8-3584-1280-torch.bfloat16-True-silu 4.543 4.71344 -3.63%
fused_moe:2048-64-8-3584-640-torch.bfloat16-False-silu 2.980 3.18588 -6.46%
fused_moe:2048-64-8-3584-640-torch.bfloat16-True-silu 2.974 3.17476 -6.33%
fused_moe:2048-8-2-4096-3584-torch.bfloat16-False-silu 2.887 2.90584 -0.66%
fused_moe:2048-8-2-4096-3584-torch.bfloat16-True-silu 2.769 2.77888 -0.37%
fused_moe:2048-8-2-4096-7168-torch.bfloat16-False-silu 5.595 5.59824 -0.06%
fused_moe:2048-8-2-4096-7168-torch.bfloat16-True-silu 5.614 5.61465 -0.01%
fused_moe:2048-8-2-8192-16384-torch.bfloat16-False-gelu 22.665 22.7313 -0.29%
fused_moe:2048-8-2-8192-16384-torch.bfloat16-True-gelu 22.942 22.996 -0.23%
fused_moe:4096-32-4-2880-2880-torch.bfloat16-False-silu 6.539 6.68283 -2.16%
fused_moe:4096-32-4-2880-2880-torch.bfloat16-True-silu 6.602 6.76406 -2.39%
fused_moe:4096-64-6-1280-1792-torch.bfloat16-False-silu 2.991 3.21875 -7.08%
fused_moe:4096-64-6-1280-1792-torch.bfloat16-True-silu 3.017 3.22566 -6.47%
fused_moe:4096-64-8-3584-1280-torch.bfloat16-False-silu 7.771 8.13202 -4.43%
fused_moe:4096-64-8-3584-1280-torch.bfloat16-True-silu 8.021 8.39628 -4.46%
fused_moe:4096-64-8-3584-640-torch.bfloat16-False-silu 5.093 5.4653 -6.82%
fused_moe:4096-64-8-3584-640-torch.bfloat16-True-silu 5.159 5.52932 -6.70%
fused_moe:4096-8-2-4096-3584-torch.bfloat16-False-silu 5.038 5.08732 -0.97%
fused_moe:4096-8-2-4096-3584-torch.bfloat16-True-silu 5.306 5.33426 -0.53%
fused_moe:4096-8-2-4096-7168-torch.bfloat16-False-silu 9.375 9.41876 -0.47%
fused_moe:4096-8-2-4096-7168-torch.bfloat16-True-silu 9.654 9.71391 -0.61%
fused_moe:4096-8-2-8192-16384-torch.bfloat16-False-gelu 40.883 40.8911 -0.02%
fused_moe:4096-8-2-8192-16384-torch.bfloat16-True-gelu 43.717 43.8217 -0.24%
fused_moe:512-32-4-2880-2880-torch.bfloat16-False-silu 2.186 2.20646 -0.92%
fused_moe:512-32-4-2880-2880-torch.bfloat16-True-silu 2.206 2.21728 -0.53%
fused_moe:512-64-6-1280-1792-torch.bfloat16-False-silu 1.240 1.26911 -2.27%
fused_moe:512-64-6-1280-1792-torch.bfloat16-True-silu 1.257 1.28466 -2.15%
fused_moe:512-64-8-3584-1280-torch.bfloat16-False-silu 2.516 2.56027 -1.74%
fused_moe:512-64-8-3584-1280-torch.bfloat16-True-silu 2.537 2.57803 -1.59%
fused_moe:512-64-8-3584-640-torch.bfloat16-False-silu 1.489 1.52922 -2.66%
fused_moe:512-64-8-3584-640-torch.bfloat16-True-silu 1.506 1.55009 -2.83%
fused_moe:512-8-2-4096-7168-torch.bfloat16-False-silu 2.107 2.11905 -0.58%
fused_moe:512-8-2-4096-7168-torch.bfloat16-True-silu 2.071 2.07397 -0.15%
fused_moe:8192-32-4-2880-2880-torch.bfloat16-False-silu 11.937 12.2032 -2.18%
fused_moe:8192-32-4-2880-2880-torch.bfloat16-True-silu 11.984 12.2867 -2.46%
fused_moe:8192-64-6-1280-1792-torch.bfloat16-False-silu 5.324 5.76077 -7.59%
fused_moe:8192-64-6-1280-1792-torch.bfloat16-True-silu 5.374 5.78937 -7.17%
fused_moe:8192-64-8-3584-1280-torch.bfloat16-False-silu 14.423 15.2426 -5.38%
fused_moe:8192-64-8-3584-1280-torch.bfloat16-True-silu 14.363 15.1701 -5.32%
fused_moe:8192-64-8-3584-640-torch.bfloat16-False-silu 9.461 10.3308 -8.41%
fused_moe:8192-64-8-3584-640-torch.bfloat16-True-silu 9.497 10.3384 -8.14%
fused_moe:8192-8-2-4096-3584-torch.bfloat16-False-silu 9.666 9.73216 -0.68%
fused_moe:8192-8-2-4096-3584-torch.bfloat16-True-silu 9.385 9.46182 -0.81%
fused_moe:8192-8-2-4096-7168-torch.bfloat16-False-silu 18.382 18.3927 -0.06%
fused_moe:8192-8-2-4096-7168-torch.bfloat16-True-silu 18.424 18.5002 -0.41%
fused_moe:8192-8-2-8192-16384-torch.bfloat16-True-gelu 81.155 81.2379 -0.10%

HIGHER (log > baseline)

num_tokens - num_experts - topk - hidden_size - shard_intermediate_size log baseline ratio
fused_moe:128-32-4-2880-2880-torch.bfloat16-False-silu 2.129 2.11827 +0.52%
fused_moe:128-8-2-4096-3584-torch.bfloat16-False-silu 1.151 1.13331 +1.58%
fused_moe:128-8-2-4096-3584-torch.bfloat16-True-silu 1.160 1.0984 +5.60%
fused_moe:128-8-2-8192-16384-torch.bfloat16-True-gelu 8.556 8.55254 +0.04%
fused_moe:512-8-2-4096-3584-torch.bfloat16-False-silu 1.258 1.25096 +0.54%
fused_moe:512-8-2-4096-3584-torch.bfloat16-True-silu 1.301 1.28838 +0.99%
fused_moe:512-8-2-8192-16384-torch.bfloat16-False-gelu 8.519 8.51864 +0.00%
fused_moe:512-8-2-8192-16384-torch.bfloat16-True-gelu 8.568 8.56344 +0.06%
fused_moe:8192-8-2-8192-16384-torch.bfloat16-False-gelu 80.910 80.8513 +0.07%

EQUAL

None

Flash Attention Benchmark Comparison

Ratio = log / baseline (lower is better)

LOWER (log < baseline)

config log baseline ratio
flash_attn:1-1-4096-16-4-128-False-False-False-0 0.055 0.139256 -60.27%
flash_attn:1-1-4096-16-4-128-False-False-False-128 0.055 0.064792 -15.69%
flash_attn:1-1-4096-16-4-256-False-False-False-128 0.091 0.106808 -14.56%
flash_attn:1-1-4096-16-4-512-False-False-False-128 0.187 0.204672 -8.54%
flash_attn:1-1-4096-16-4-64-False-False-False-128 0.038 0.045864 -17.23%
flash_attn:1-1-4096-16-8-128-False-False-False-0 0.090 0.1456 -38.07%
flash_attn:1-1-4096-16-8-128-False-False-False-128 0.060 0.09438 -36.47%
flash_attn:1-1-4096-16-8-256-False-False-False-128 0.102 0.145548 -29.62%
flash_attn:1-1-4096-16-8-512-False-False-False-128 0.175 0.241852 -27.52%
flash_attn:1-1-4096-16-8-64-False-False-False-128 0.038 0.056342 -32.16%
flash_attn:1-128-4096-16-4-128-False-True-False-0 0.021 0.183378 -88.46%
flash_attn:1-128-4096-16-4-128-False-True-False-128 0.038 0.199264 -80.72%
flash_attn:1-128-4096-16-4-256-False-True-False-128 0.260 0.420446 -38.05%
flash_attn:1-128-4096-16-4-512-False-False-False-128 1.806 3.11943 -42.09%
flash_attn:1-128-4096-16-4-512-False-True-False-128 0.947 8.90581 -89.37%
flash_attn:1-128-4096-16-4-512-True-False-False-128 1.828 3.0848 -40.74%
flash_attn:1-128-4096-16-4-64-False-False-True-128 0.098 0.194688 -49.49%
flash_attn:1-128-4096-16-4-64-False-True-False-128 0.038 0.276952 -86.20%
flash_attn:1-128-4096-16-4-64-False-True-True-128 0.132 0.280176 -53.03%
flash_attn:1-128-4096-16-4-64-True-False-True-128 0.100 0.21866 -54.44%
flash_attn:1-128-4096-16-8-256-False-True-False-128 0.296 0.41184 -28.20%
flash_attn:1-128-4096-16-8-512-False-False-False-128 1.805 3.25101 -44.49%
flash_attn:1-128-4096-16-8-512-False-True-False-128 0.533 9.08968 -94.14%
flash_attn:1-128-4096-16-8-512-True-False-False-128 1.821 3.21095 -43.30%
flash_attn:1-128-4096-16-8-64-False-False-True-128 0.098 0.191828 -48.66%
flash_attn:1-128-4096-16-8-64-False-True-False-128 0.143 0.278044 -48.51%
flash_attn:1-128-4096-16-8-64-False-True-True-128 0.019 0.27794 -93.34%
flash_attn:1-128-4096-16-8-64-True-False-True-128 0.100 0.216788 -54.01%
flash_attn:16-1-4096-16-4-128-False-False-False-0 0.375 1.28372 -70.78%
flash_attn:16-1-4096-16-4-128-False-False-False-128 0.218 0.365664 -40.44%
flash_attn:16-1-4096-16-4-256-False-False-False-128 0.409 0.673348 -39.27%
flash_attn:16-1-4096-16-4-512-False-False-False-128 0.820 1.32306 -38.02%
flash_attn:16-1-4096-16-4-64-False-False-False-128 0.139 0.21502 -35.50%
flash_attn:16-1-4096-16-8-128-False-False-False-0 0.672 1.36214 -50.67%
flash_attn:16-1-4096-16-8-128-False-False-False-128 0.370 0.661544 -44.04%
flash_attn:16-1-4096-16-8-256-False-False-False-128 0.700 1.26875 -44.79%
flash_attn:16-1-4096-16-8-512-False-False-False-128 1.337 2.57873 -48.17%
flash_attn:16-1-4096-16-8-64-False-False-False-128 0.216 0.3653 -40.91%
flash_attn:16-128-4096-16-4-128-False-True-False-0 0.865 1.52922 -43.45%
flash_attn:16-128-4096-16-4-128-False-True-False-128 0.814 1.60165 -49.19%
flash_attn:16-128-4096-16-4-256-False-True-False-128 0.617 5.3398 -88.45%
flash_attn:16-128-4096-16-4-512-False-False-False-128 22.945 39.5081 -41.92%
flash_attn:16-128-4096-16-4-512-False-True-False-128 5.236 139.183 -96.24%
flash_attn:16-128-4096-16-4-512-True-False-False-128 23.093 39.1857 -41.07%
flash_attn:16-128-4096-16-4-64-False-False-True-128 0.539 0.874224 -38.34%
flash_attn:16-128-4096-16-4-64-False-True-False-128 0.773 1.19881 -35.54%
flash_attn:16-128-4096-16-4-64-False-True-True-128 0.311 1.19766 -74.02%
flash_attn:16-128-4096-16-4-64-True-False-True-128 0.540 0.970138 -44.31%
flash_attn:16-128-4096-16-8-128-False-True-False-0 0.586 1.64965 -64.51%
flash_attn:16-128-4096-16-8-128-False-True-False-128 1.207 1.67409 -27.91%
flash_attn:16-128-4096-16-8-256-False-True-False-128 2.419 5.24789 -53.90%
flash_attn:16-128-4096-16-8-512-False-False-False-128 22.945 36.8448 -37.73%
flash_attn:16-128-4096-16-8-512-False-True-False-128 6.790 139.928 -95.15%
flash_attn:16-128-4096-16-8-512-True-False-False-128 22.989 35.6149 -35.45%
flash_attn:16-128-4096-16-8-64-False-False-True-128 0.609 0.889096 -31.55%
flash_attn:16-128-4096-16-8-64-False-True-False-128 0.331 1.18316 -72.03%
flash_attn:16-128-4096-16-8-64-False-True-True-128 0.488 1.19389 -59.13%
flash_attn:16-128-4096-16-8-64-True-False-True-128 0.604 0.976092 -38.11%
flash_attn:8-1-4096-16-4-128-False-False-False-0 0.219 0.732212 -70.04%
flash_attn:8-1-4096-16-4-128-False-False-False-128 0.139 0.216892 -35.89%
flash_attn:8-1-4096-16-4-256-False-False-False-128 0.223 0.36712 -39.21%
flash_attn:8-1-4096-16-4-512-False-False-False-128 0.442 0.683228 -35.35%
flash_attn:8-1-4096-16-4-64-False-False-False-128 0.088 0.13806 -36.20%
flash_attn:8-1-4096-16-8-128-False-False-False-0 0.371 0.78442 -52.75%
flash_attn:8-1-4096-16-8-128-False-False-False-128 0.217 0.364988 -40.42%
flash_attn:8-1-4096-16-8-256-False-False-False-128 0.385 0.667394 -42.29%
flash_attn:8-1-4096-16-8-512-False-False-False-128 0.741 1.31401 -43.60%
flash_attn:8-1-4096-16-8-64-False-False-False-128 0.138 0.216736 -36.13%
flash_attn:8-128-4096-16-4-128-False-True-False-128 0.910 0.913484 -0.35%
flash_attn:8-128-4096-16-4-256-False-True-False-128 2.688 2.87732 -6.59%
flash_attn:8-128-4096-16-4-512-False-False-False-128 11.503 20.4255 -43.68%
flash_attn:8-128-4096-16-4-512-False-True-False-128 5.872 70.4383 -91.66%
flash_attn:8-128-4096-16-4-512-True-False-False-128 11.601 20.4417 -43.25%
flash_attn:8-128-4096-16-4-64-False-False-True-128 0.291 0.451958 -35.59%
flash_attn:8-128-4096-16-4-64-False-True-False-128 0.107 0.604552 -82.37%
flash_attn:8-128-4096-16-4-64-False-True-True-128 0.098 0.61009 -83.94%
flash_attn:8-128-4096-16-4-64-True-False-True-128 0.290 0.510172 -43.24%
flash_attn:8-128-4096-16-8-128-False-True-False-128 0.774 0.966004 -19.91%
flash_attn:8-128-4096-16-8-256-False-True-False-128 2.677 2.82142 -5.11%
flash_attn:8-128-4096-16-8-512-False-False-False-128 11.493 19.0868 -39.79%
flash_attn:8-128-4096-16-8-512-False-True-False-128 0.460 71.1556 -99.35%
flash_attn:8-128-4096-16-8-512-True-False-False-128 11.540 18.5447 -37.77%
flash_attn:8-128-4096-16-8-64-False-False-True-128 0.344 0.457704 -24.80%
flash_attn:8-128-4096-16-8-64-False-True-False-128 0.301 0.6084 -50.57%
flash_attn:8-128-4096-16-8-64-False-True-True-128 0.267 0.612508 -56.38%
flash_attn:8-128-4096-16-8-64-True-False-True-128 0.332 0.509548 -34.82%

HIGHER (log > baseline)

config log baseline ratio
flash_attn:1-128-4096-16-4-128-False-False-False-0 0.217 0.140296 +54.67%
flash_attn:1-128-4096-16-4-128-False-False-False-128 0.319 0.219622 +45.13%
flash_attn:1-128-4096-16-4-128-True-False-False-0 0.219 0.164788 +32.98%
flash_attn:1-128-4096-16-4-128-True-False-False-128 0.319 0.24622 +29.62%
flash_attn:1-128-4096-16-4-256-False-False-False-128 0.663 0.361348 +83.59%
flash_attn:1-128-4096-16-4-256-True-False-False-128 0.660 0.36699 +79.87%
flash_attn:1-128-4096-16-4-64-False-False-False-128 0.186 0.10036 +84.97%
flash_attn:1-128-4096-16-4-64-True-False-False-128 0.187 0.131872 +41.60%
flash_attn:1-128-4096-16-8-128-False-False-False-0 0.219 0.14794 +48.33%
flash_attn:1-128-4096-16-8-128-False-False-False-128 0.318 0.223444 +42.45%
flash_attn:1-128-4096-16-8-128-False-True-False-0 0.253 0.190892 +32.28%
flash_attn:1-128-4096-16-8-128-False-True-False-128 0.291 0.206778 +40.55%
flash_attn:1-128-4096-16-8-128-True-False-False-0 0.222 0.16666 +33.23%
flash_attn:1-128-4096-16-8-128-True-False-False-128 0.319 0.247468 +28.87%
flash_attn:1-128-4096-16-8-256-False-False-False-128 0.660 0.35776 +84.60%
flash_attn:1-128-4096-16-8-256-True-False-False-128 0.657 0.3627 +81.23%
flash_attn:1-128-4096-16-8-64-False-False-False-128 0.186 0.100412 +85.09%
flash_attn:1-128-4096-16-8-64-True-False-False-128 0.187 0.132236 +41.17%
flash_attn:16-128-4096-16-4-128-False-False-False-0 1.903 1.27982 +48.73%
flash_attn:16-128-4096-16-4-128-False-False-False-128 2.716 1.94303 +39.79%
flash_attn:16-128-4096-16-4-128-True-False-False-0 1.889 1.41034 +33.93%
flash_attn:16-128-4096-16-4-128-True-False-False-128 2.661 2.04274 +30.27%
flash_attn:16-128-4096-16-4-256-False-False-False-128 8.245 4.59264 +79.53%
flash_attn:16-128-4096-16-4-256-True-False-False-128 8.240 4.65218 +77.12%
flash_attn:16-128-4096-16-4-64-False-False-False-128 0.996 0.52286 +90.53%
flash_attn:16-128-4096-16-4-64-True-False-False-128 1.041 0.623584 +66.89%
flash_attn:16-128-4096-16-8-128-False-False-False-0 2.043 1.35132 +51.16%
flash_attn:16-128-4096-16-8-128-False-False-False-128 2.743 2.10626 +30.21%
flash_attn:16-128-4096-16-8-128-True-False-False-0 2.014 1.48231 +35.86%
flash_attn:16-128-4096-16-8-128-True-False-False-128 2.693 2.15673 +24.88%
flash_attn:16-128-4096-16-8-256-False-False-False-128 8.098 4.56009 +77.58%
flash_attn:16-128-4096-16-8-256-True-False-False-128 8.083 4.60444 +75.55%
flash_attn:16-128-4096-16-8-64-False-False-False-128 1.011 0.567112 +78.26%
flash_attn:16-128-4096-16-8-64-True-False-False-128 1.063 0.659048 +61.23%
flash_attn:8-128-4096-16-4-128-False-False-False-0 1.069 0.724204 +47.60%
flash_attn:8-128-4096-16-4-128-False-False-False-128 1.559 1.09975 +41.73%
flash_attn:8-128-4096-16-4-128-False-True-False-0 0.944 0.873366 +8.11%
flash_attn:8-128-4096-16-4-128-True-False-False-0 1.057 0.800904 +32.00%
flash_attn:8-128-4096-16-4-128-True-False-False-128 1.501 1.14431 +31.21%
flash_attn:8-128-4096-16-4-256-False-False-False-128 4.387 2.45762 +78.51%
flash_attn:8-128-4096-16-4-256-True-False-False-128 4.395 2.49759 +75.96%
flash_attn:8-128-4096-16-4-64-False-False-False-128 0.513 0.286 +79.53%
flash_attn:8-128-4096-16-4-64-True-False-False-128 0.536 0.34034 +57.37%
flash_attn:8-128-4096-16-8-128-False-False-False-0 1.166 0.771576 +51.17%
flash_attn:8-128-4096-16-8-128-False-False-False-128 1.564 1.1985 +30.49%
flash_attn:8-128-4096-16-8-128-False-True-False-0 1.107 0.941304 +17.65%
flash_attn:8-128-4096-16-8-128-True-False-False-0 1.151 0.845234 +36.14%
flash_attn:8-128-4096-16-8-128-True-False-False-128 1.517 1.22829 +23.53%
flash_attn:8-128-4096-16-8-256-False-False-False-128 4.303 2.41098 +78.48%
flash_attn:8-128-4096-16-8-256-True-False-False-128 4.298 2.44899 +75.52%
flash_attn:8-128-4096-16-8-64-False-False-False-128 0.521 0.32071 +62.59%
flash_attn:8-128-4096-16-8-64-True-False-False-128 0.544 0.364676 +49.28%

EQUAL

None

Copilot AI review requested due to automatic review settings July 16, 2026 09:23
Copilot AI reviewed Jul 16, 2026
View reviewed changes

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Pull request overview

Updates the benchmark performance baselines used by CI comparison workflows, reflecting the latest improved timing results (while leaving regressions unchanged) so future runs compare against the new “best known” numbers.

Changes:

  • Refreshes fused_moe:* baseline entries where the new benchmark run is faster than the existing baseline.
  • Refreshes flash_attn:* baseline entries where the new benchmark run is faster than the existing baseline.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

Copilot code review Copilot
Copilot review effort
Applies to this pull request for everyone.Learn more about Copilot code review.
Copilot left review comments

At least 1 approving review is required to merge this pull request.

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@MingxuZh