Superminaren/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-11 04:56:56 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
94c3d5304352eef27c33b08a858facdffbb28438
llama.cpp/src
T
History
Francis Couture-Harpin 94c3d53043 kv-cache : remove const_cast when setting inputs for s_copy 
And also fix multi-user inference for recurrent models
by using cell_id instead of i as the kv cell index
when populating s_copy.
2025-05-01 22:18:57 -04:00
..
CMakeLists.txt
cmake : do not include ./src as public for libllama (#13062)
2025-04-24 16:00:10 +03:00
llama-adapter.cpp
llama : make loras compatible with repacking (#12593)
2025-03-27 08:24:10 +02:00
llama-adapter.h
llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)
2025-03-13 12:35:44 +02:00
llama-arch.cpp
Merge branch 'master' into compilade/mamba2
2025-05-01 18:06:09 -04:00
llama-arch.h
Merge branch 'master' into compilade/mamba2
2025-05-01 18:06:09 -04:00
llama-batch.cpp
llama : refactor src/llama.cpp (#10902)
2025-01-03 10:18:53 +02:00
llama-batch.h
llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)
2025-03-13 12:35:44 +02:00
llama-chat.cpp
mtmd : fix glm-edge redundant token count (#13139)
2025-04-28 16:12:56 +02:00
llama-chat.h
llama-chat : fix typo GML --> GLM (#13143)
2025-04-28 10:11:58 +02:00
llama-context.cpp
fix typo: n_ctx_pre_seq -> n_ctx_per_seq (#13221)
2025-04-30 21:28:43 +01:00
llama-context.h
llama : fix K-shift with quantized K and BLAS backend (#13113)
2025-04-25 19:40:11 +02:00
llama-cparams.cpp
llama : refactor src/llama.cpp (#10902)
2025-01-03 10:18:53 +02:00
llama-cparams.h
Load all MoE experts during warmup (#11571)
2025-03-14 13:47:05 +01:00
llama-grammar.cpp
tool-call: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034)
2025-03-05 13:05:13 +00:00
llama-grammar.h
tool-call: fix Qwen 2.5 Coder support, add micro benchmarks, support trigger patterns for lazy grammars (#12034)
2025-03-05 13:05:13 +00:00
llama-graph.cpp
kv-cache : remove const_cast when setting inputs for s_copy
2025-05-01 22:18:57 -04:00
llama-graph.h
Merge branch 'master' into compilade/mamba2
2025-05-01 18:06:09 -04:00
llama-hparams.cpp
Merge branch 'master' into compilade/mamba2
2025-05-01 18:06:09 -04:00
llama-hparams.h
Merge branch 'master' into compilade/mamba2
2025-05-01 18:06:09 -04:00
llama-impl.cpp
GGUF: C++ refactor, backend support, misc fixes (#11030)
2025-01-07 18:01:58 +01:00
llama-impl.h
cleanup: fix compile warnings associated with gnu_printf (#11811)
2025-02-12 10:06:53 -04:00
llama-io.cpp
llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)
2025-03-13 12:35:44 +02:00
llama-io.h
llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)
2025-03-13 12:35:44 +02:00
llama-kv-cache.cpp
kv-cache : remove const_cast when setting inputs for s_copy
2025-05-01 22:18:57 -04:00
llama-kv-cache.h
kv-cache : remove const_cast when setting inputs for s_copy
2025-05-01 22:18:57 -04:00
llama-memory.cpp
llama : refactor llama_context, llama_kv_cache, llm_build_context (#12181)
2025-03-13 12:35:44 +02:00
llama-memory.h
kv-cache : simplify + fix warning for recurrent models (#12756)
2025-04-04 21:48:10 +03:00
llama-mmap.cpp
mmap : skip resource limit checks on AIX (#12541)
2025-03-24 12:17:10 +02:00
llama-mmap.h
llama-mmap: fix missing include (#11796)
2025-02-10 20:58:18 +02:00
llama-model-loader.cpp
model : print tensor size during load (#12711)
2025-04-02 16:38:54 +03:00
llama-model-loader.h
llama : add option to override model tensor buffers (#11397)
2025-04-02 14:52:01 +02:00
llama-model.cpp
metal : single-user mamba2 inference works
2025-05-01 21:27:12 -04:00
llama-model.h
Merge branch 'master' into compilade/mamba2
2025-05-01 18:06:09 -04:00
llama-quant.cpp
quantize: Handle user-defined quantization levels for additional tensors (#12511)
2025-04-13 21:29:28 +03:00
llama-quant.h
llama : refactor src/llama.cpp (#10902)
2025-01-03 10:18:53 +02:00
llama-sampling.cpp
sampling : when top-k <= 0 -> noop (#13173)
2025-04-29 20:22:57 +03:00
llama-sampling.h
llama : add llama_vocab, functions -> methods, naming (#11110)
2025-01-12 11:32:42 +02:00
llama-vocab.cpp
mtmd : Support Pixtral 12B (#13065)
2025-04-23 20:21:59 +02:00
llama-vocab.h
llama : remove notion of CLS token (#11064)
2025-01-12 12:15:53 +02:00
llama.cpp
llama : add option to override model tensor buffers (#11397)
2025-04-02 14:52:01 +02:00
unicode-data.cpp
server : better security control for public deployments (#9776)
2024-10-08 13:27:04 +02:00
unicode-data.h
llama : reduce compile time and binary size (#9712)
2024-10-02 15:49:55 +02:00
unicode.cpp
repo : update links to new url (#11886)
2025-02-15 16:40:57 +02:00
unicode.h
unicode : improve naming style (#10838)
2024-12-16 12:31:45 +02:00