 Georgi Gerganov
|
254098a279
|
common : refactor common_sampler + grammar logic changes (#17937)
* common : refactor common_sampler + grammar logic changes
* tests : increase max_tokens to get needed response
* batched : fix uninitialized samplers
|
2025-12-14 10:11:13 +02:00 |
|
 Georgi GerganovandJohannes Gäßler
|
e92d53b29e
|
sampling : optimize samplers by reusing bucket sort (#15665)
* sampling : optimize sorting using bucket sort in more places
ggml-ci
* sampling : do not sort in dist sampler
ggml-ci
* sampling : avoid heap allocations for sort buffers
ggml-ci
* common : add option to sort sampling candidates by probability
ggml-ci
* sampling : revert the change for preserving sort buffers
* sampling : use std::copy instead of memcpy
* sampling : clarify purpose of partial sort helpers
ggml-ci
* cont : remove wrong comment [no ci]
* common : update comment
Co-authored-by: Johannes Gäßler <[email protected]>
---------
Co-authored-by: Johannes Gäßler <[email protected]>
|
2025-08-31 20:41:02 +03:00 |
|
|
Georgi Gerganov
|
d2fcd91cf9
|
server : disable context shift by default (#15416)
* server : disable context shift by default
ggml-ci
* server : make scopr of test parameters local
|
2025-08-19 16:46:37 +03:00 |
|
|
Georgi Gerganov
|
53f925074d
|
sync : vendor (#13901)
* sync : vendor
ggml-ci
* cont : fix httplib version
ggml-ci
* cont : fix lint
* cont : fix lint
* vendor : move to common folder /vendor
ggml-ci
* cont : fix lint
* cont : move httplib to /vendor + use json_fwd.hpp
ggml-ci
* cont : fix server build
ggml-ci
* cont : add missing headers
ggml-ci
* cont : header clean-up
ggml-ci
|
2025-05-30 16:25:45 +03:00 |
|
|
Georgi Gerganov
|
8a1d206f1d
|
tts : fix n_ubatch + make WavTokenizer cache-less (#13713)
ggml-ci
|
2025-05-22 22:21:07 +03:00 |
|
  Diego DevesaandXuan Son Nguyen
|
1d36b3670b
|
llama : move end-user examples to tools directory (#13249)
* llama : move end-user examples to tools directory
---------
Co-authored-by: Xuan Son Nguyen <[email protected]>
|
2025-05-02 20:27:13 +02:00 |
|