llama.cpp/examples/parallel at 467e307931ef353676f092be4bb3b2bb3c7d3bbf - llama.cpp - Gitea: Git with a cup of tea

Superminaren/llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-07 20:47:30 +02:00

Files

T

History

Georgi Gerganov fa0e677820 llama : extend batch API to select which logits to output

2023-09-19 00:24:13 +03:00

..

CMakeLists.txt

parallel : example for serving multiple users in parallel

2023-09-18 20:37:28 +03:00

parallel.cpp

llama : extend batch API to select which logits to output

2023-09-19 00:24:13 +03:00