Skip to content

fix: improve CLI help and external backend shutdown handling - #259

Merged
chen2021673 merged 2 commits into
masterfrom
fix/cli-help-and-test-labels
Nov 6, 2026
Merged

chen2021673 merged 2 commits into
masterfrom
fix/cli-help-and-test-labels

Conversation

@chen2021673

@chen2021673 chen2021673 commented Oct 30, 2026 •

Copy link
Copy Markdown
Collaborator
  • 补充训练示例和 infini_run 的命令行用法说明,并完善退出处理、错误诊断和测试标签。
    修改前和修改后对比:
image image - 为 Mixtral 添加外部后端退出 workaround:在关闭 gflags 前保存判断结果,退出前刷新输出,并在满足条件时跳过全局静态析构。
  • 在分布式优化器空分片错误中输出 DP rank,便于定位异常进程。

  • 移除 CTest 的 accelerator、hardware 标签,保留设备或后端标签,并同步更新测试文档。

@chen2021673
chen2021673 force-pushed the fix/cli-help-and-test-labels branch from dba9062 to 7917f62 Compare October 30, 2026 06:08
- Add usage messages to training examples and infini_run
- Add Mixtral external backend shutdown workaround and flush output before exit
- Include DP rank in distributed optimizer empty-shard errors
- Remove accelerator and hardware test labels and update documentation
@chen2021673

Copy link
Copy Markdown
Collaborator Author

精度测试:
image
性能测试:
image

Comment thread example/gpt2/main.cc Outdated
Comment on lines +730 to +732
gflags::SetUsageMessage(
"Train a GPT-2 model with InfiniTrain.\nUsage: " + std::string(argv[0]) +
" --input_bin=<training.bin> [options]");

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Image 当前直接 ./gpt --help,会把第三方库里的参数也打出来,这里建议usage加一个提示使用 Model options: --helpmatch=example/gpt2/,或者代码里做一下截获

@chen2021673 chen2021673 Nov 6, 2026 •

Copy link
Copy Markdown
Collaborator Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

已修改:现在默认只打印模型参数,指定helpfull时打印完整参数
image

Share model help filtering across the training examples and retain --helpfull for all flags. Document the two help modes in usage output and the README.
@chen2021673

Copy link
Copy Markdown
Collaborator Author

修改后精度性能复测结果:
image
image

@chen2021673
chen2021673 merged commit 44d051a into master Nov 6, 2026
3 checks passed
@chen2021673
chen2021673 deleted the fix/cli-help-and-test-labels branch November 6, 2026 08:18
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants