Fix fully reshardable optimizer state slicing with bucket padding - #6342

Fix fully reshardable optimizer state slicing with bucket padding#6342

OlegSudakov wants to merge 1 commit into

NVIDIA:mainNVIDIA/Megatron-LM:mainfrom

OlegSudakov:reshardable_optimizer_state_slicing_fixOlegSudakov/Megatron-LM:reshardable_optimizer_state_slicing_fixCopy head branch name to clipboard