llama.cpp TTS

This is a tool to demonstrate audio generation capability in llama.cpp via libmtmd. It was added via PR #26254

Note: this tool used to serve as a demo for OuteTTS, but it was converted to a more model-agnostic tool.

Common usage

Simple usage:

llama-tts -hf ggml-org/Qwen3-TTS-12Hz-1.7B-Base-GGUF -p "Hello world" --output out.wav

Common params:

Sampling params such as --top-k, --top-p, --temp, etc.
-n <number_of_frames> limits the output length, e.g. -n 500. Note that how many milliseconds each frame represents varies by model
Core inference params such as -ngl, -b, -ub, etc.

Qwen3-TTS

Available params:

--tts-lang can be cn, en, ge, it, po, sp, ja, ko, fr, ru (default: en)
--tts-speaker-file should point to a speaker reference audio file (wav, mp3)

Example usage:

llama-tts -hf ggml-org/Qwen3-TTS-12Hz-1.7B-Base-GGUF \
    -p "Hello world" \
    --tts-lang english \
    --tts-speaker-file speaker.mp3 \
    --output out.wav