Superminaren/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-11 04:56:56 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
v0.1.2
llama.cpp/ggml/src
T
History
ynankani 25ae3a9b33 CUDA: MMVQ nwarps=8 for bs=1 for dense models on DGX Spark (#26843) 
* CUDA: MMVQ nwarps=8 for bs=1 for dense models on DGX Spark

Signed-off-by: ynankani <[email protected]>

* skip moe experts and allow others based on k geometry (allow only small idle tail)

Signed-off-by: ynankani <[email protected]>

* rename MMVQ DGX Spark params to GB10 and fix MSVC constexpr lambda capture

Signed-off-by: ynankani <[email protected]>

---------

Signed-off-by: ynankani <[email protected]>
2026-08-18 09:45:53 +05:30
..
ggml-blas
llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)
2026-08-11 09:20:46 +03:00
ggml-cann
llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)
2026-08-11 09:20:46 +03:00
ggml-cpu
ggml : recurrent state rollback for ggml_ssm_scan (#26623)
2026-08-14 17:20:40 +03:00
ggml-cuda
CUDA: MMVQ nwarps=8 for bs=1 for dense models on DGX Spark (#26843)
2026-08-18 09:45:53 +05:30
ggml-et
ggml : recurrent state rollback for ggml_ssm_scan (#26623)
2026-08-14 17:20:40 +03:00
ggml-hexagon
llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)
2026-08-11 09:20:46 +03:00
ggml-hip
ggml-hip : remove -funsafe-math-optimizations (#26696)
2026-08-13 08:38:02 +02:00
ggml-metal
ggml : recurrent state rollback for ggml_ssm_scan (#26623)
2026-08-14 17:20:40 +03:00
ggml-musa
ggml-cuda: native bf16 flash attention for vec kernel (#20525)
2026-03-22 11:05:51 +01:00
ggml-opencl
opencl: default FA c8 cluster width to 16 on X1E (#26433)
2026-08-11 23:10:27 -07:00
ggml-openvino
OpenVINO: Qwen3.5, memory optimization, and test-recurrent-state-rollback (#26952)
2026-08-13 20:30:48 +03:00
ggml-rpc
llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)
2026-08-11 09:20:46 +03:00
ggml-sycl
sycl: fix thread/block count in quantized cpy kernel launches (#27160)
2026-08-17 07:32:16 +03:00
ggml-virtgpu
llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)
2026-08-11 09:20:46 +03:00
ggml-vulkan
vulkan: add SHMEM_STRIDE_PAD/APPLY_SLM_A_RESHAPE for coopmat1 on Intel Xe (#25380)
2026-08-15 11:35:05 +02:00
ggml-webgpu
ggml : recurrent state rollback for ggml_ssm_scan (#26623)
2026-08-14 17:20:40 +03:00
ggml-zdnn
llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)
2026-08-11 09:20:46 +03:00
ggml-zendnn
llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)
2026-08-11 09:20:46 +03:00
CMakeLists.txt
ggml: enable PowerPC backend variants on AIX (#25983)
2026-07-22 17:26:40 +08:00
ggml-alloc.c
ggml-alloc: fix out-of-bounds read in ggml_dyn_tallocr_remove_block (ggml/1492)
2026-05-25 12:38:01 +03:00
ggml-backend-dl.cpp
hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)
2026-01-29 12:33:21 -08:00
ggml-backend-dl.h
hexagon: enable offloading to Hexagon on Windows on Snapdragon (#19150)
2026-01-29 12:33:21 -08:00
ggml-backend-impl.h
ggml: backend-agnostic tensor parallelism (experimental) (#19378)
2026-04-09 16:42:19 +02:00
ggml-backend-meta.cpp
llama: add default load-mode auto, which avoids mmap on iGPUs (#26081)
2026-08-11 09:20:46 +03:00
ggml-backend-reg.cpp
ggml-et: Initial ET backend (#24179)
2026-07-10 12:38:34 +08:00
ggml-backend.cpp
ggml: use dynamic allocation for split graph inputs (#22789)
2026-08-03 18:03:14 +03:00
ggml-common.h
Add Q2_0 quantization: type definition and CPU backend (#24448)
2026-07-07 12:05:47 -07:00
ggml-feats.h
ggml : fix arm builds, unused var (#26991)
2026-08-13 07:57:24 +03:00
ggml-impl.h
ggml: add graph_reused (#21764)
2026-04-16 17:21:28 +08:00
ggml-opt.cpp
fix: free ctx_copy in ggml_opt_free to plug per-training-session leak (#21592)
2026-04-08 17:40:15 +02:00
ggml-quants.c
Add Q2_0 quantization: type definition and CPU backend (#24448)
2026-07-07 12:05:47 -07:00
ggml-quants.h
Add Q2_0 quantization: type definition and CPU backend (#24448)
2026-07-07 12:05:47 -07:00
ggml-threading.cpp
…
ggml-threading.h
remove CMAKE_WINDOWS_EXPORT_ALL_SYMBOLS (#10797)
2024-12-12 19:02:49 +01:00
ggml.c
ggml : recurrent state rollback for ggml_ssm_scan (#26623)
2026-08-14 17:20:40 +03:00
ggml.cpp
ggml : Print backtrace on uncaught C++ exceptions (ggml/1232)
2025-06-01 13:43:57 +03:00
gguf.cpp
gguf : harden loader against malformed tensor dims and metadata types (#25596)
2026-08-12 15:07:48 +03:00