Superminaren/llama.cpp

Fork 0

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-04 10:47:38 +02:00

Files

T

History

b97bc3966e llama : support Llama 3 HF conversion (#6745 )

* Support Llama 3 conversion

The tokenizer is BPE.

* style

* Accept suggestion

Co-authored-by: Sourab Mangrulkar <[email protected]>

* llama : add llama_token_is_eog()

ggml-ci

* llama : auto-detect more EOT tokens when missing in KV data

* convert : replacing EOS token is a hack

* llama : fix codegemma EOT token + add TODOs

* llama : fix model type string for 8B model

---------

Co-authored-by: Sourab Mangrulkar <[email protected]>
Co-authored-by: Georgi Gerganov <[email protected]>

2024-04-21 14:50:41 +03:00

CMakeLists.txt

build : link against build info instead of compiling against it (#3879 )

2023-11-02 08:50:16 +02:00

parallel.cpp

llama : support Llama 3 HF conversion (#6745 )

2024-04-21 14:50:41 +03:00

README.md

Fix some documentation typos/grammar mistakes (#4032 )

2023-11-11 23:04:58 -07:00

README.md

llama.cpp/example/parallel

Simplified simulation of serving incoming requests in parallel