Commit Graph
2 Commits
Author SHA1 Message Date
Ruixiang WangandGeorgi Gerganov 571d0d540d model: rotate injected K/V cache for DFlash (#25823)
* dflash: rotate injected K/V cache when using K/V quantization

* Update src/models/dflash.cpp

Co-authored-by: Georgi Gerganov <[email protected]>

* clearer format

* remove trailing whitespace

---------

Co-authored-by: Georgi Gerganov <[email protected]>
2026-07-18 15:02:18 +02:00
Ruixiang WangandKashif Rasul d1b34251bc spec : add DFlash support (#22105)
* spec: add DFlash v2 support

* dflash: support sliding window attention per layer_types

* docs: add dflash section

---------

Co-authored-by: Kashif Rasul <[email protected]>
2026-06-28 16:01:34 +03:00