llama.cpp

mirror of https://github.com/ggml-org/llama.cpp.git synced 2026-09-11 04:56:56 +02:00

Files

T

danielhanchen 331fa7e560 llama: load qwen4exp (Qwen3.8-Flash-Next) hparams and tensors

Adds LLM_ARCH_QWEN4EXP with its hparams and tensor loading. The graph
comes in the next commit; this makes the model load and report correct
metadata.

- hyper-connections set n_embd_out_impl = hc_count * n_embd, so the
  residual stream is 4x wide and there is no output_norm: the final
  mixer's hc_norm is the last norm in the model.
- registered as hybrid and given the same recurrent/attention memory
  filters as Qwen3-Next and Qwen3.5.
- reuses the existing indexer, per_layer_token_embd, SSM and
  compress_ratios keys as-is.
- the PLE table row count is read back from the file rather than
  recomputing the vocab padding rule.

llama-model-loader gains UINT64 array support. That branch previously
threw, so no existing caller changes behaviour; it is needed because the
PLE hash multipliers do not fit in int32.

2026-08-26 13:40:35 +00:00

__init__.py

gguf: add qwen4exp (Qwen3.8-Flash-Next) arch and converter

2026-08-26 13:40:35 +00:00

afmoe.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

arctic.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

baichuan.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

bailingmoe3.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

bailingmoe.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

base.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

bert.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

bitnet.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

bloom.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

chameleon.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

chatglm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

codeshell.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

cogvlm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

command_r.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

dbrx.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

deci.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

deepseek.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

dots1.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

dots3.py

mtmd: support dots3-note vision+audio (#27524 )

2026-08-22 10:35:50 +02:00

dotsocr.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

dream.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

ernie.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

exaone.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

falcon_h1.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

falcon.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

gemma.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

glm.py

convert: fix GLM regression in index_tensors (#27655 )

2026-08-24 13:21:00 +03:00

gpt2.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

gpt_oss.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

gptneox.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

granite.py

model : GraniteSWAForCausalLM / GraniteMoeSWAForCausalLM (#25505 )

2026-08-19 16:53:31 +02:00

grok.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

grovemoe.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

hunyuan.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

internlm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

internvl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

jais.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

jamba.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

januspro.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

kimi_k3.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

kimi_linear.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

kimivl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

laguna.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

lfm2.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

lighton_ocr.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

llada.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

llama4.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

llama.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

llava.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

maincoder.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

mamba.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

mellum.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

mimo.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

minicpm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

minimax.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

mistral3.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

mistral.py

convert : fix conversion for Mistral-Medium-3.5-128B (#24268 )

2026-06-07 21:41:39 +02:00

mpt.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

muse_glimmer.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

nanbeige.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

nemotron.py

conversion : fix Nemotron 3.5 Lightning layers (#27729 )

2026-08-26 12:05:31 +02:00

olmo.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

openelm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

orion.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

pangu.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

phi.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

pixtral.py

Refactor: convert_hf_to_gguf.py (#17114 )

2026-05-15 15:18:12 +02:00

plamo.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

plm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

pockettts.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

qwen3tts.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

qwen3vl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

qwen4exp.py

llama: load qwen4exp (Qwen3.8-Flash-Next) hparams and tensors

2026-08-26 13:40:35 +00:00

qwen.py

model : support DSpark for bailingmoe3 (#27508 )

2026-08-22 12:19:48 +03:00

qwenvl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

refact.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

rwkv.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

sarashina2.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

smallthinker.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

smolvlm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

stablelm.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

starcoder.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

step3.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

t5.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

talkie.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

ultravox.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

wavtokenizer.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

xverse.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00

youtuvl.py

convert: add @ModelBase.example (#27208 )

2026-08-17 10:15:11 +02:00