Vinesh JanarthananandGeorgi Gerganov 27e8a23300 sampling: add Top-nσ sampler (#11223) ...

* initial sampling changes:

* completed top nsigma sampler implementation

* apply parameter to only llama-cli

* updated readme

* added tests and fixed nsigma impl

* cleaned up pr

* format

* format

* format

* removed commented tests

* cleanup pr and remove explicit floats

* added top-k sampler to improve performance

* changed sigma to float

* fixed string format to float

* Update src/llama-sampling.cpp

Co-authored-by: Georgi Gerganov <[email protected]>

* Update common/sampling.cpp

Co-authored-by: Georgi Gerganov <[email protected]>

* Update src/llama-sampling.cpp

Co-authored-by: Georgi Gerganov <[email protected]>

* Update src/llama-sampling.cpp

Co-authored-by: Georgi Gerganov <[email protected]>

* Update src/llama-sampling.cpp

Co-authored-by: Georgi Gerganov <[email protected]>

* Update src/llama-sampling.cpp

Co-authored-by: Georgi Gerganov <[email protected]>

* added llama_sampler_init

---------

Co-authored-by: Georgi Gerganov <[email protected]>

2025-02-13 08:45:57 +02:00

..

llama-cpp.h

llama : add llama_vocab, functions -> methods, naming (#11110)

2025-01-12 11:32:42 +02:00

llama.h

sampling: add Top-nσ sampler (#11223)

2025-02-13 08:45:57 +02:00