Skip to content

Make MoE dispatch/MLP expert-axis batch sharding configurable (fix Mixtral EP throughput) - #4179

Merged
copybara-service[bot] merged 1 commit into
AI-Hypercomputer:mainfrom
ROCm:fix-moe-expert-parallel-sharding
Jun 23, 2026
Merged

Make MoE dispatch/MLP expert-axis batch sharding configurable (fix Mixtral EP throughput)#4179
copybara-service[bot] merged 1 commit into
AI-Hypercomputer:mainfrom
ROCm:fix-moe-expert-parallel-sharding

Make MoE dispatch/MLP expert-axis batch sharding configurable

ea41360
Select commit
Loading
Failed to load commit list.
Codecov / codecov/patch succeeded Jun 23, 2026 in 1s

88.00% of diff hit (target 51.30%)

View this Pull Request on Codecov

88.00% of diff hit (target 51.30%)

View more details on Codecov