diff --git a/cookbooks/cosmos3/generator/audiovisual/run_with_sglang.ipynb b/cookbooks/cosmos3/generator/audiovisual/run_with_sglang.ipynb index 86f742f8..3ffdc787 100644 --- a/cookbooks/cosmos3/generator/audiovisual/run_with_sglang.ipynb +++ b/cookbooks/cosmos3/generator/audiovisual/run_with_sglang.ipynb @@ -93,7 +93,19 @@ " --cfg-parallel-size 2\n", "```\n", "\n", - "For Cosmos3, set CFG strength with the request-level `guidance_scale` field. Do not use `true_cfg_scale` for CFG Parallel with these Cosmos3 examples.\n" + "For Cosmos3, set CFG strength with the request-level `guidance_scale` field. Do not use `true_cfg_scale` for CFG Parallel with these Cosmos3 examples.\n", + "\n", + "### FP8\n", + "\n", + "FP8 checkpoint is located in `fp8` branch for Cosmos3 Nano, Super, Super-Text2Image, Super-Image2Video, Super-Text2Image-4Step, and Super-Image2Video-4Step.\n", + "\n", + "```bash\n", + "hf download nvidia/Cosmos3-Super-Text2Image-4Step \\\n", + " --revision fp8 \\\n", + " --local-dir /models/Cosmos3-Super-Text2Image-4Step\n", + "\n", + "sglang serve --model-path /models/Cosmos3-Super-Text2Image-4Step\n", + "```" ] }, {