Aman Gupta 9f682fb640 ggml-cpu: FA split across kv for faster TG (#19209) ...

* ggml-cpu: split across kv for faster TG

* simplify sinks application

* add ref impl

2026-02-03 01:19:55 +08:00

..

ggml-alloc.h

llama: automatically set parameters not set by the user in such a way that maximizes GPU utilization (#16653)

2025-12-15 09:24:59 +01:00

ggml-backend.h

vulkan: extend topk_moe to handle sigmoid w/exp_probs_b for nemotron (#18295)

2026-01-01 08:58:27 +01:00

ggml-blas.h

…

ggml-cann.h

docs : Minor cleanups (#19252)

2026-02-02 08:38:55 +02:00

ggml-cpp.h

…

ggml-cpu.h

ggml-cpu: FA split across kv for faster TG (#19209)

2026-02-03 01:19:55 +08:00

ggml-cuda.h

…

ggml-hexagon.h

Add experimental ggml-hexagon backend for the Hexagon NPU (#16547)

2025-10-22 13:47:09 -07:00

ggml-metal.h

…

ggml-opencl.h

…

ggml-opt.h

…

ggml-rpc.h

rpc : fix alloc size logic (#17116)

2025-12-05 19:39:04 +02:00

ggml-sycl.h

…

ggml-virtgpu.h

ggml: new backend for Virglrenderer API Remoting acceleration (v2) (#18718)

2026-01-28 17:49:40 +08:00

ggml-vulkan.h

…

ggml-webgpu.h

…

ggml-zdnn.h

…

ggml-zendnn.h

ggml-zendnn : add ZenDNN backend for AMD CPUs (#17690)

2025-12-07 00:13:33 +08:00

ggml.h

docs : Minor cleanups (#19252)

2026-02-02 08:38:55 +02:00

gguf.h

…