Aleksander Grygier af98525e4c ui : add model compatibility estimation ...

Port the hardware-compatibility estimator from ggml-org/llama-macos:
map every GGUF file in a repo to a full/limited/none tier based on
the device memory budget (GPU working set approximated from RAM, less
fit slack and an OS floor) and the estimated weight + context memory.

Main quants are tiered individually; shards, mmproj and quant-matched
draft sidecars inherit their main quant's tier. Sidecar picking
mirrors the server's find_best_sibling ranking (deepest directory,
exact quant tag, closest bit depth).

Also port detectToolUseSupport (infers tool-calling support from a
chat template) and the browser get_info fallback helper.

Assisted-by: pi

2026-09-01 00:22:57 +02:00

..

batched-bench

cmake : add install() for impl libraries + fix apple builds (#23511)

2026-05-22 11:46:26 +03:00

cli

common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969)

2026-08-30 09:18:10 +03:00

completion

common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969)

2026-08-30 09:18:10 +03:00

cvector-generator

cmake : introduce semantic versioning (#26839)

2026-08-12 14:15:03 +02:00

export-lora

docs: fix export-lora --lora-scaled syntax [no release] (#24703)

2026-06-18 16:46:17 +02:00

fit-params

fit: also take into account n_streams (#27496)

2026-08-22 16:16:06 +02:00

gguf-split

cmake : introduce semantic versioning (#26839)

2026-08-12 14:15:03 +02:00

imatrix

imatrix.cpp: Move finite check and only check touched experts (#26861)

2026-08-11 11:18:19 -04:00

llama-bench

common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969)

2026-08-30 09:18:10 +03:00

mtmd

args: add --video-* CLI arguments (#24318)

2026-08-27 12:11:12 +02:00

perplexity

quant : Optimise memory usage by evicting weights after processing each layer (#22877)

2026-08-18 16:22:32 +02:00

quantize

quantize: cap working memory size to avoid loading big tensors onto RAM (#27795)

2026-08-27 18:31:13 +02:00

results

libs : rename libcommon -> libllama-common (#21936)

2026-04-17 11:11:46 +03:00

rpc

rpc: avoid serializing buffers from other servers (#26500)

2026-08-30 20:26:16 +03:00

server

common: rename --tensor-read-lazy to --lazy-mode, add -lzm shorthand (#27969)

2026-08-30 09:18:10 +03:00

tokenize

tokenize : drop --stdin mutual-exclusion check (#25672)

2026-07-15 18:41:51 +02:00

tts

args: add --video-* CLI arguments (#24318)

2026-08-27 12:11:12 +02:00

tuning

metal : per-device tuned (Q, NE) for flash-attn vec (#26570)

2026-08-24 19:22:27 +03:00

ui

ui : add model compatibility estimation

2026-09-01 00:22:57 +02:00

CMakeLists.txt

metal : per-device tuned (Q, NE) for flash-attn vec (#26570)

2026-08-24 19:22:27 +03:00