Superminaren/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-07 20:47:30 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
a07359ef93d19067baf7faa539bf3133eb133f30
llama.cpp/tools
T
History
Aleksander Grygier a07359ef93 ui : simplify model memory estimation 
Replace the device-memory tier machinery with a plain file-size
estimate: required runtime memory is the model file size with
headroom for KV cache and allocator overhead (estimateModelMemoryBytes).
Callers present the requirement; there is no device detection and no
fit-versus-budget verdict.

Drops resolveDeviceMemoryGb, deviceMemoryBudgetMb,
computeFileCompatibilityTiers and the CompatibilityTier type, and the
barrel keeps only the new estimator.

Assisted-by: pi
2026-09-01 00:22:57 +02:00
..
batched-bench
cmake : add install() for impl libraries + fix apple builds (#23511)
2026-05-22 11:46:26 +03:00
cli
common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969)
2026-08-30 09:18:10 +03:00
completion
common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969)
2026-08-30 09:18:10 +03:00
cvector-generator
cmake : introduce semantic versioning (#26839)
2026-08-12 14:15:03 +02:00
export-lora
docs: fix export-lora --lora-scaled syntax [no release] (#24703)
2026-06-18 16:46:17 +02:00
fit-params
fit: also take into account n_streams (#27496)
2026-08-22 16:16:06 +02:00
gguf-split
cmake : introduce semantic versioning (#26839)
2026-08-12 14:15:03 +02:00
imatrix
imatrix.cpp: Move finite check and only check touched experts (#26861)
2026-08-11 11:18:19 -04:00
llama-bench
common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969)
2026-08-30 09:18:10 +03:00
mtmd
args: add --video-* CLI arguments (#24318)
2026-08-27 12:11:12 +02:00
perplexity
quant : Optimise memory usage by evicting weights after processing each layer (#22877)
2026-08-18 16:22:32 +02:00
quantize
quantize: cap working memory size to avoid loading big tensors onto RAM (#27795)
2026-08-27 18:31:13 +02:00
results
libs : rename libcommon -> libllama-common (#21936)
2026-04-17 11:11:46 +03:00
rpc
rpc: avoid serializing buffers from other servers (#26500)
2026-08-30 20:26:16 +03:00
server
common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969)
2026-08-30 09:18:10 +03:00
tokenize
tokenize : drop --stdin mutual-exclusion check (#25672)
2026-07-15 18:41:51 +02:00
tts
args: add --video-* CLI arguments (#24318)
2026-08-27 12:11:12 +02:00
tuning
metal : per-device tuned (Q, NE) for flash-attn vec (#26570)
2026-08-24 19:22:27 +03:00
ui
ui : simplify model memory estimation
2026-09-01 00:22:57 +02:00
CMakeLists.txt
metal : per-device tuned (Q, NE) for flash-attn vec (#26570)
2026-08-24 19:22:27 +03:00