Superminaren/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-04 10:47:38 +02:00
Code Issues Packages Projects Releases Wiki Activity
10,201 Commits 759 Branches 7,325 Tags
b10201
Commit Graph
11 Commits
Author SHA1 Message Date
Xuan-Son Nguyen 4b4d13ae72 server: (router) add model management API (#23976) 
* wip

* server: (router) add SSE realtime updates API

* nits

* wip

* add download API

* add download api

* update docs

* add delete endpoint

* fix std::terminate

* fix crash

* fix 2

* add tests

* nits
 2026-06-17 18:04:58 +02:00
Adrien Gallouët 45b455e66f common : remove hf cache migration (#23266) 
Signed-off-by: Adrien Gallouët <[email protected]>
 2026-05-18 17:11:47 +02:00
Adrien Gallouët beb42fffa4 common : check for null getpwuid in hf-cache (#22550) 
Signed-off-by: Adrien Gallouët <[email protected]>
 2026-04-30 21:32:41 +02:00
Georgi Gerganov de71b5f81c server : refactor "use checkpoint" logic (#22114) 2026-04-20 08:42:37 +03:00
Georgi Gerganov 6990e2f1f7 libs : rename libcommon -> libllama-common (#21936) 
* cmake : allow libcommon to be shared

* cmake : rename libcommon to libllama-common

* cont : set -fPIC for httplib

* cont : export all symbols

* cont : fix build_info exports

* libs : add libllama-common-base

* log : add common_log_get_verbosity_thold()
 2026-04-17 11:11:46 +03:00
Adrien Gallouët 287b5b1eab common : add getpwuid fallback for HF cache when HOME is not set (#21035) 
Signed-off-by: Adrien Gallouët <[email protected]>
 2026-03-26 20:34:23 +01:00
Adrien Gallouët 93dfbc1291 common : make LLAMA_CACHE the one cache for everything (#21009) 
Signed-off-by: Adrien Gallouët <[email protected]>
 2026-03-26 12:04:57 +01:00
Adrien Gallouët 3cba8bba18 common : fix split model migration (#21019) 
Sadly the manifest does not list all required files, i honestly thought
it was the case

Without the files listed we don't have the sha256, so if the first file
is valid, and all others have the correct size, then we can assume we
are good and do the migration...

Here my test:

    $ find /home/angt/.cache/llama.cpp
    /home/angt/.cache/llama.cpp
    /home/angt/.cache/llama.cpp/angt_test-split-model-stories260K_stories260K-f32-00002-of-00002.gguf
    /home/angt/.cache/llama.cpp/angt_test-split-model-stories260K_stories260K-f32-00001-of-00002.gguf
    /home/angt/.cache/llama.cpp/angt_test-split-model-stories260K_stories260K-f32-00001-of-00002.gguf.etag
    /home/angt/.cache/llama.cpp/angt_test-split-model-stories260K_stories260K-f32-00002-of-00002.gguf.etag
    /home/angt/.cache/llama.cpp/manifest=angt=test-split-model-stories260K=latest.json

    $ build/bin/llama-server
    ================================================================================
    WARNING: Migrating cache to HuggingFace cache directory
      Old cache: /home/angt/.cache/llama.cpp/
      New cache: /home/angt/.cache/huggingface/hub
    This one-time migration moves models previously downloaded with -hf
    from the legacy llama.cpp cache to the standard HuggingFace cache.
    Models downloaded with --model-url are not affected.
    ================================================================================
    migrate_file: migrated angt_test-split-model-stories260K_stories260K-f32-00001-of-00002.gguf -> /home/angt/.cache/huggingface/hub/models--angt--test-split-model-stories260K/snapshots/68c3ea2061e8c7688455fab07597dde0f4d7f0db/stories260K-f32-00001-of-00002.gguf
    migrate_file: migrated angt_test-split-model-stories260K_stories260K-f32-00002-of-00002.gguf -> /home/angt/.cache/huggingface/hub/models--angt--test-split-model-stories260K/snapshots/68c3ea2061e8c7688455fab07597dde0f4d7f0db/stories260K-f32-00002-of-00002.gguf
    migrate_old_cache_to_hf_cache: migration complete, deleting manifest: /home/angt/.cache/llama.cpp/manifest=angt=test-split-model-stories260K=latest.json

    $ find /home/angt/.cache/llama.cpp /home/angt/.cache/huggingface
    /home/angt/.cache/llama.cpp
    /home/angt/.cache/huggingface
    /home/angt/.cache/huggingface/hub
    /home/angt/.cache/huggingface/hub/models--angt--test-split-model-stories260K
    /home/angt/.cache/huggingface/hub/models--angt--test-split-model-stories260K/blobs
    /home/angt/.cache/huggingface/hub/models--angt--test-split-model-stories260K/blobs/50d019817c2626eb9e8a41f361ff5bfa538757e6f708a3076cd3356354a75694
    /home/angt/.cache/huggingface/hub/models--angt--test-split-model-stories260K/blobs/7b273e1dbfab11dc67dce479deb5923fef27c39cbf56a20b3a928a47b77dab3c
    /home/angt/.cache/huggingface/hub/models--angt--test-split-model-stories260K/refs
    /home/angt/.cache/huggingface/hub/models--angt--test-split-model-stories260K/refs/main
    /home/angt/.cache/huggingface/hub/models--angt--test-split-model-stories260K/snapshots
    /home/angt/.cache/huggingface/hub/models--angt--test-split-model-stories260K/snapshots/68c3ea2061e8c7688455fab07597dde0f4d7f0db
    /home/angt/.cache/huggingface/hub/models--angt--test-split-model-stories260K/snapshots/68c3ea2061e8c7688455fab07597dde0f4d7f0db/stories260K-f32-00002-of-00002.gguf
    /home/angt/.cache/huggingface/hub/models--angt--test-split-model-stories260K/snapshots/68c3ea2061e8c7688455fab07597dde0f4d7f0db/stories260K-f32-00001-of-00002.gguf

Signed-off-by: Adrien Gallouët <[email protected]>
 2026-03-26 12:04:37 +01:00
Adrien Gallouët c0159f9c1f common : do not delete old files from the old cache when updating (#21000) 
Signed-off-by: Adrien Gallouët <[email protected]>
 2026-03-25 22:28:04 +01:00
Adrien Gallouët 2d2d9c2062 common : add a WARNING for HF cache migration (#20935) 
Signed-off-by: Adrien Gallouët <[email protected]>
 2026-03-24 09:24:39 +01:00
Adrien Gallouët 8c7957ca33 common : add standard Hugging Face cache support (#20775) 
* common : add standard Hugging Face cache support

- Use HF API to find all files
- Migrate all manifests to hugging face cache at startup

Signed-off-by: Adrien Gallouët <[email protected]>

* Check with the quant tag

Signed-off-by: Adrien Gallouët <[email protected]>

* Cleanup

Signed-off-by: Adrien Gallouët <[email protected]>

* Improve error handling and report API errors

Signed-off-by: Adrien Gallouët <[email protected]>

* Restore common_cached_model_info and align mmproj filtering

Signed-off-by: Adrien Gallouët <[email protected]>

* Prefer main when getting cached ref

Signed-off-by: Adrien Gallouët <[email protected]>

* Use cached files when HF API fails

Signed-off-by: Adrien Gallouët <[email protected]>

* Use final_path..

Signed-off-by: Adrien Gallouët <[email protected]>

* Check all inputs

Signed-off-by: Adrien Gallouët <[email protected]>

---------

Signed-off-by: Adrien Gallouët <[email protected]>
 2026-03-24 07:30:33 +01:00