Files
llama.cpp/examples/passkey
b97bc3966e llama : support Llama 3 HF conversion (#6745)
* Support Llama 3 conversion

The tokenizer is BPE.

* style

* Accept suggestion

Co-authored-by: Sourab Mangrulkar <[email protected]>

* llama : add llama_token_is_eog()

ggml-ci

* llama : auto-detect more EOT tokens when missing in KV data

* convert : replacing EOS token is a hack

* llama : fix codegemma EOT token + add TODOs

* llama : fix model type string for 8B model

---------

Co-authored-by: Sourab Mangrulkar <[email protected]>
Co-authored-by: Georgi Gerganov <[email protected]>
2024-04-21 14:50:41 +03:00
..
2024-01-08 11:14:04 +02:00

llama.cpp/example/passkey

See the following PRs for more info:

Usage

make -j && ./passkey ./models/llama-7b-v2/ggml-model-f16.gguf 250