Skip to content

Add StaticCache: fixed-capacity in-place KV cache for WebGPU - #1745

Open
kylo5aby wants to merge 2 commits into
huggingface:mainfrom
kylo5aby:feat/static-cache
Open

Add StaticCache: fixed-capacity in-place KV cache for WebGPU#1745
kylo5aby wants to merge 2 commits into
huggingface:mainfrom
kylo5aby:feat/static-cache

Add StaticCache

6f671c5
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs