Logo
Explore Help
Sign In
Superminaren/llama.cpp
Watch 1
Star 0
Fork 0
mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-04 02:37:27 +02:00
Code Issues Packages Projects Releases Wiki Activity
Files
rev-sampling
llama.cpp/examples/parallel
T
History
Georgi Gerganov 5261aee8d8 sampling : one sequence per sampling context
ggml-ci
2023-10-12 20:36:44 +03:00
..
CMakeLists.txt
llama : custom attention mask + parallel decoding + no context swaps (#3228)
2023-09-28 19:04:36 +03:00
parallel.cpp
sampling : one sequence per sampling context
2023-10-12 20:36:44 +03:00
README.md
llama : custom attention mask + parallel decoding + no context swaps (#3228)
2023-09-28 19:04:36 +03:00

README.md

llama.cpp/example/parallel

Simplified simluation for serving incoming requests in parallel

Reference in New Issue View Git Blame Copy Permalink
Powered by Gitea Version: 1.27.2 Page: 702ms Template: 9ms
Auto
English
Bahasa Indonesia Deutsch English Español Français Gaeilge Italiano Latviešu Magyar nyelv Nederlands Polski Português de Portugal Português do Brasil Suomi Svenska Türkçe Čeština Ελληνικά Български Русский Українська فارسی മലയാളം 日本語 简体中文 繁體中文(台灣) 繁體中文(香港) 한국어
Licenses API