Skip to content

Replace chunk prefill with AppendKV FMHA prefill - #307

Open
yuankuns wants to merge 16 commits into
sgl-project:mainfrom
yuankuns:fmha-prefill-kvcache-appendkv
Open

Replace chunk prefill with AppendKV FMHA prefill#307
yuankuns wants to merge 16 commits into
sgl-project:mainfrom
yuankuns:fmha-prefill-kvcache-appendkv

Use a standalone prepass for large AppendKV prefill

67e48f6
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs