
Georgi GerganovandJohannes Gäßler
e92d53b29e
sampling : optimize samplers by reusing bucket sort (#15665)
* sampling : optimize sorting using bucket sort in more places
ggml-ci
* sampling : do not sort in dist sampler
ggml-ci
* sampling : avoid heap allocations for sort buffers
ggml-ci
* common : add option to sort sampling candidates by probability
ggml-ci
* sampling : revert the change for preserving sort buffers
* sampling : use std::copy instead of memcpy
* sampling : clarify purpose of partial sort helpers
ggml-ci
* cont : remove wrong comment [no ci]
* common : update comment
Co-authored-by: Johannes Gäßler <[email protected]>
---------
Co-authored-by: Johannes Gäßler <[email protected]>
2025-08-31 20:41:02 +03:00
..
2025-04-01 23:44:05 +02:00
2025-08-21 06:12:28 +02:00
2025-01-12 11:32:42 +02:00
2024-12-04 23:19:20 +01:00
2025-08-30 16:32:10 +02:00
2025-07-30 15:12:02 +03:00
2025-08-28 15:27:36 -05:00
2024-11-29 21:54:58 +01:00
2025-01-07 18:01:58 +01:00
2025-01-07 18:01:58 +01:00
2025-06-16 14:14:00 +03:00
2025-06-30 10:17:18 +02:00
2025-06-06 14:11:15 +03:00
2025-06-06 14:11:15 +03:00
2025-08-20 13:30:46 +03:00
2025-06-06 14:11:15 +03:00
2025-08-28 09:26:48 +02:00
2025-07-18 17:33:41 +03:00
2025-08-21 06:12:28 +02:00
2025-08-21 06:12:28 +02:00
2025-07-30 15:12:02 +03:00
2025-05-19 13:25:41 +03:00
2025-07-02 14:12:07 +03:00
2025-02-15 16:40:57 +02:00
2025-08-31 20:41:02 +03:00
2025-08-13 12:44:40 +02:00
2025-08-21 06:12:28 +02:00
2025-08-14 12:03:57 +02:00
2025-06-30 10:17:18 +02:00
2025-06-30 10:17:18 +02:00
2025-06-30 10:17:18 +02:00
2025-06-30 10:17:18 +02:00
2025-08-21 12:16:54 +02:00
2024-11-13 21:10:38 +11:00
2025-04-26 10:10:20 +02:00
2025-08-22 12:22:13 +03:00
2025-06-30 10:17:18 +02:00
2025-05-02 20:27:13 +02:00
2025-06-30 10:17:18 +02:00
2025-04-08 19:54:51 +03:00
2025-06-30 10:17:18 +02:00
2025-06-30 10:17:18 +02:00