Superminaren/llama.cpp
1
0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-07 20:47:30 +02:00
Code Issues Packages Projects Releases Wiki Activity
1,381 Commits 780 Branches 7,352 Tags
4a7f43f28caee3da6890d3447a48126ead86313f
Commit Graph
3 Commits
Author SHA1 Message Date
Georgi Gerganov 4a7f43f28c speculative : refactor sampling 2023-10-15 22:53:54 +03:00
Georgi Gerganov 5261aee8d8 sampling : one sequence per sampling context 
ggml-ci
 2023-10-12 20:36:44 +03:00
Kerfuffle 70c29da118 common : fix mirostat state when using multiple sequences (#3543) 
* Fix mirostat state when using multiple sequences

* Fix mirostat by completely refactoring sampling!

* Try to fix zig build.

* Export function to fetch/create default sampler states

Code formatting cleanups and add some comments

Silence a warning about id not being used when logging is disabled

* Apply some renaming suggestions.

Fix comments that were out of sync with the pull.

* Use more consistant naming convention for sampling contexts
 2023-10-11 22:35:46 +03:00