llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-04 10:47:38 +02:00

Files

T

Pascal 0f3a71be15 mtmd: Fix Qwen3-tts-0.6b (#28231 )

* mtmd: load the qwen3-tts code predictor proj_in as optional

The talker and the code predictor share the hidden size on the 0.6B
checkpoints, so the reference builds no small_to_mtp_projection and
the conversion emits no tensor for it. The graph already falls back
to identity when the weight is missing, the loader now agrees.

* mtmd: keep the qwen3-tts code predictor ffn_down in F32

The code predictor carries a massive activation: its layer 2 FFN
intermediate peaks around 1.5e5, well past the 65504 ceiling of F16.
mul_mat casts its input to the weight type, so an F16 ffn_down turns
that peak into inf, the residual follows, and the next rms_norm yields
NaN. Reference forward in float32 gives 145109 against 145396 measured
in the graph.

2026-09-02 12:46:16 +02:00

__init__.py

model: add Qwen3.8-Flash-Next (qwen4exp) (#27742 )

2026-08-27 21:32:31 +02:00

afmoe.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

arctic.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

baichuan.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

bailingmoe3.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

bailingmoe.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

base.py

model: add Qwen3.8-Flash-Next (qwen4exp) (#27742 )

2026-08-27 21:32:31 +02:00

bert.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

bitnet.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

bloom.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

chameleon.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

chatglm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

codeshell.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

cogvlm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

command_r.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

dbrx.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

deci.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

deepseek.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

dots1.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

dots3.py

mtmd: support dots3-note vision+audio (#27524 )

2026-08-22 10:35:50 +02:00

dotsocr.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

dream.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

ernie.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

exaone.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

falcon_h1.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

falcon.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

gemma.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

glm.py

convert: fix GLM regression in index_tensors (#27655 )

2026-08-24 13:21:00 +03:00

gpt2.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

gpt_oss.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

gptneox.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

granite.py

model : GraniteSWAForCausalLM / GraniteMoeSWAForCausalLM (#25505 )

2026-08-19 16:53:31 +02:00

grok.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

grovemoe.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

hunyuan.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

internlm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

internvl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

jais.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

jamba.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

januspro.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

kimi_k3.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

kimi_linear.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

kimivl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

laguna.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

lfm2.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

lighton_ocr.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

llada.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

llama4.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

llama.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

llava.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

maincoder.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

mamba.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

mellum.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

mimo.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

minicpm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

minimax.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

mistral3.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

mistral.py

convert : fix conversion for Mistral-Medium-3.5-128B (#24268 )

2026-06-07 21:41:39 +02:00

mpt.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

muse_glimmer.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

nanbeige.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

nemotron.py

convert : fix Nemotron-H LoRA GGUF conversion (#27356 )

2026-08-27 14:41:24 +02:00

olmo.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

openelm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

orion.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

pangu.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

phi.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

pixtral.py

Refactor: convert_hf_to_gguf.py (#17114 )

2026-05-15 15:18:12 +02:00

plamo.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

plm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

pockettts.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

qwen3tts.py

mtmd: Fix Qwen3-tts-0.6b (#28231 )

2026-09-02 12:46:16 +02:00

qwen3vl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

qwen4exp.py

model: add Qwen3.8-Flash-Next (qwen4exp) (#27742 )

2026-08-27 21:32:31 +02:00

qwen.py

model: add DSpark support for Nemotron3.5 (#27804 )

2026-08-28 01:49:27 +02:00

qwenvl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

refact.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

rwkv.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

sarashina2.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

smallthinker.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

smolvlm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

stablelm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

starcoder.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

step3.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

t5.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

talkie.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

ultravox.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

wavtokenizer.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

xverse.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

youtuvl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00