Skip to content

Support request-level cache for hybrid sliding-window attention - #1545

Open
shihaobai wants to merge 15 commits into
mainfrom
bsh/hybrid-sliding-window-cache
Open

Support request-level cache for hybrid sliding-window attention#1545
shihaobai wants to merge 15 commits into
mainfrom
bsh/hybrid-sliding-window-cache

Optimize Gemma4 sliding-window slot reuse and attention state

47c67bd
Select commit
Loading
Failed to load commit list.

Select a check to view from the sidebar