[GGUF] Use the OpenVINO GGUF frontend: tokenizer from rt_info, stateful graph - #4318

Draft

mvafin wants to merge 11 commits into

openvinotoolkit:masterfrom

mvafin:gguf-frontend-tokenizer

Commits on Aug 13, 2026

[GGUF] Build tokenizer from frontend model rt_info; gemma4 support
mvafin
committed
0de192b
[GGUF] Tokenizer: honor special-token ids, add_space_prefix, plamo2; add chat sample
mvafin
committed
87f1cf8
[GGUF] Link openvino::frontend::gguf (current target name)
mvafin
committed
6f02d7f
[GGUF] Add gguf_arch_check sample and commit missing GGUF sample sources
mvafin
committed
a566a1a
[GGUF] Measure prefill, not cache hits, in the GGUF perf sample
mvafin
committed
ffb65d4
[GGUF] Make the model stateful here, not in the frontend
mvafin
committed
0e9f8b7
[GGUF] Tokenizer: add BOS/EOS via CombineSegments on every path

mvafin
and
Copilot
committed
6750c5e
[GGUF] Address review feedback: drop redundant samples, fix lint and tokenizer nits

mvafin
and
Copilot
committed
55f03d7
[GGUF] Keep GGUF on SDPA, and add a legacy-reader escape hatch

mvafin
and
Copilot
committed
2647b2a

Commits on Aug 15, 2026

[GGUF] Run the GGUF accuracy tests in CI, and stop silently skipping tokenizer saves

mvafin
and
Copilot
committed
43028b8
[GGUF] Make the reader a property, and build the tokenizer from metadata not a model

mvafin
and
Copilot
committed
66c2592