Feature/zero multi loss separate backward - #8135

Open

nathon-lee wants to merge 11 commits into

deepspeedai:masterfrom

nathon-lee:feature/zero-multi-loss-separate-backward

Commits on Jul 12, 2026

zero3: defer param release during retain_graph backward #7352
nathon-lee
committed
0d11b56
fix(zero3): port PR #8045 and apply tohtana review fixes
nathon-lee
committed
a78b005
Merge pull request #26 from nathon-lee/feature/zero-multi-loss-separate-backward-test
nathon-lee
authored
f873f69
fix(engine,zero3): restore pre-8135 behavior for non-#8045 changes
nathon-lee
committed
9dbec98
Merge pull request #27 from nathon-lee/feature/zero-multi-loss-separate-backward-test
nathon-lee
authored
b6bda49

Commits on Jul 15, 2026

Commits on Jul 19, 2026

Merge branch 'master' into feature/zero-multi-loss-separate-backward
nathon-lee
authored
b050536