  Xuan-Son Nguyenandbandoti
|
6c2131773c
|
cli: new CLI experience (#17824)
* wip
* wip
* fix logging, add display info
* handle commands
* add args
* wip
* move old cli to llama-completion
* rm deprecation notice
* move server to a shared library
* move ci to llama-completion
* add loading animation
* add --show-timings arg
* add /read command, improve LOG_ERR
* add args for speculative decoding, enable show timings by default
* add arg --image and --audio
* fix windows build
* support reasoning_content
* fix llama2c workflow
* color default is auto
* fix merge conflicts
* properly fix color problem
Co-authored-by: bandoti <[email protected]>
* better loading spinner
* make sure to clean color on force-exit
* also clear input files on "/clear"
* simplify common_log_flush
* add warning in mtmd-cli
* implement console writter
* fix data race
* add attribute
* fix llama-completion and mtmd-cli
* add some notes about console::log
* fix compilation
---------
Co-authored-by: bandoti <[email protected]>
|
2025-12-10 15:28:59 +01:00 |
|
|
Xuan-Son Nguyen
|
951520ddb0
|
server: delegate result_state creation to server_task (#17835)
* server: delegate result_state creation to server_task
* remove unued states
* add more docs
|
2025-12-08 17:04:38 +01:00 |
|
 Xuan-Son NguyenandGeorgi Gerganov
|
c4c10bfb86
|
server: move msg diffs tracking to HTTP thread (#17740)
* server: move msg diffs tracking to HTTP thread
* wip
* tool call tests ok
* minor : style
* cont : fix
* move states to server_response_reader
* add safe-guard
* fix
* fix 2
---------
Co-authored-by: Georgi Gerganov <[email protected]>
|
2025-12-04 15:46:08 +01:00 |
|
|
Xuan-Son NguyenandGeorgi Gerganov
|
ab49f094d2
|
server: move server-context to its own cpp|h (#17595)
* git mv
* add server-context.h
* add server-context.h
* clean up headers
* cont : cleanup
* also expose server_response_reader (to be used by CLI)
* fix windows build
* decouple server_routes and server_http
---------
Co-authored-by: Georgi Gerganov <[email protected]>
|
2025-11-29 22:04:44 +01:00 |
|
|
Xuan-Son NguyenandGeorgi Gerganov
|
b8372eecd9
|
server: split server.cpp code into server/common/task/queue (#17362)
* add server-task, server-common
* add server-queue
* rm redundant includes
* move enum stop_type to server-task
* server : headers cleanup
---------
Co-authored-by: Georgi Gerganov <[email protected]>
|
2025-11-24 14:41:53 +01:00 |
|