Titaniumtown 6509138622 sycl: fuse mul_mat(gate) + mul_mat(up) + GLU for q4_K dense FFN (#26779) ...

Measured on Arc Pro B70 (Battlemage, Level Zero), llama-bench -r 20, two
interleaved rounds, tg128:

    qwen2.5-3B-Instruct Q4_K_M    154.18 -> 158.53 t/s   +2.8%
    gemma-2-2b-it Q4_K_M          162.45 -> 165.62 t/s   +2.0%

llama-batched-bench on qwen2.5-3B, S_TG by batch size:

      B=1   142.72 -> 147.57 t/s    +3.4%
      B=2   243.72 -> 268.26 t/s   +10.1%
      B=4   359.58 -> 398.02 t/s   +10.7%
      B=8   449.75 -> 505.63 t/s   +12.4%

2026-08-14 02:26:23 -04:00

..

peg-parser

common/peg : suppress incomplete escape sequences (#26780)

2026-08-11 07:10:31 +03:00

snapshots

tests : avoid building get-model.cpp many times (#26317)

2026-07-30 19:34:04 +03:00

.gitignore

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

CMakeLists.txt

tests: add model resolution test on synthetic repo listings (#26172)

2026-08-03 18:58:15 +02:00

gguf-model-data.cpp

ci : add [no release] keyword + fix sanitizer builds (#23728)

2026-05-26 19:05:48 +03:00

gguf-model-data.h

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

test-alloc.cpp

tests: Harmonize header use (#25616)

2026-07-13 15:36:51 +03:00

test-arg-parser.cpp

llama : support multi-output backend sampling (#25532)

2026-08-10 16:58:56 +03:00

test-autorelease.cpp

tests : avoid building get-model.cpp many times (#26317)

2026-07-30 19:34:04 +03:00

test-backend-ops.cpp

sycl: fuse mul_mat(gate) + mul_mat(up) + GLU for q4_K dense FFN (#26779)

2026-08-14 02:26:23 -04:00

test-backend-sampler.cpp

tests : disable backend sampler hip multi output (#26878)

2026-08-11 07:21:32 +03:00

test-barrier.cpp

…

test-batch-alloc.cpp

llama-batch: add unit test (#25471)

2026-07-10 11:04:31 +08:00

test-c.c

…

test-chat-auto-parser.cpp

chat : Align Laguna-S-2.1 chat template to huggingface (#26232)

2026-08-10 05:20:59 -05:00

test-chat-peg-parser.cpp

chat : add qwen3 specialized parser (#26252)

2026-08-02 04:13:20 -05:00

test-chat-template.cpp

jinja: add --dump-prog for debugging (#25086)

2026-06-28 15:50:31 +02:00

test-chat.cpp

chat : fix muse-glimmer detection of tool calls after EOM (#26879)

2026-08-11 15:15:20 -05:00

test-col2im-1d.cpp

ggml : add GGML_OP_COL2IM_1D (#24206)

2026-06-09 12:01:37 +03:00

test-double-float.cpp

…

test-export-graph-ops.cpp

tests: export-graph-ops: exit gracefully when called w/o arguments (#25619)

2026-07-14 13:15:41 +03:00

test-gbnf-validator.cpp

…

test-gguf-model-data.cpp

tests : add unit test coverage for llama_tensor_get_type (#20112)

2026-04-02 22:53:58 +02:00

test-gguf.cpp

gguf : harden loader against malformed tensor dims and metadata types (#25596)

2026-08-12 15:07:48 +03:00

test-grammar-integration.cpp

common/grammar: fix grammar parsing issues to prevent stack overflow and hangs (#18604)

2026-03-21 18:43:35 +01:00

test-grammar-llguidance.cpp

…

test-grammar-parser.cpp

grammar : degrade max repetition >= 2000 to unbounded (#26613)

2026-08-05 07:39:10 -05:00

test-jinja.cpp

common: add subproc.h wrapper, disabled on android/ios (#26102)

2026-07-26 20:54:25 +02:00

test-json-schema-to-grammar.cpp

common/json-schema-to-grammar : align spacing rules with parsers (#24835)

2026-06-20 17:43:04 -05:00

test-llama-archs.cpp

model: Muse Glimmer Support (#26841)

2026-08-10 13:07:27 +02:00

test-llama-grammar.cpp

common/grammar: fix grammar parsing issues to prevent stack overflow and hangs (#18604)

2026-03-21 18:43:35 +01:00

test-log.cpp

common: Intentionally leak logger instance to fix hanging on Windows (#22273)

2026-04-29 10:58:43 +03:00

test-lora-conversion-inference.sh

…

test-model-load-cancel.cpp

tests : avoid building get-model.cpp many times (#26317)

2026-07-30 19:34:04 +03:00

test-model-resolution.cpp

Mitigate crashing issue on Windows MSYS2 UCRT64 environment (GCC 16.1.0) (#26555)

2026-08-07 11:17:16 +02:00

test-mtmd-c-api.c

mtmd: add chunk save/load function (#26645)

2026-08-06 19:46:40 +02:00

test-opt.cpp

…

test-peg-parser.cpp

Autoparser - complete refactoring of parser architecture (#18675)

2026-03-06 21:01:00 +01:00

test-quant-type-selection.cpp

tests : avoid building get-model.cpp many times (#26317)

2026-07-30 19:34:04 +03:00

test-quantize-fns.cpp

Add Q2_0 quantization: type definition and CPU backend (#24448)

2026-07-07 12:05:47 -07:00

test-quantize-perf.cpp

…

test-quantize-stats.cpp

cmake : introduce semantic versioning (#26839)

2026-08-12 14:15:03 +02:00

test-reasoning-budget.cpp

common : add support for multiple end sequences in the reasoning budget sampler (#25544)

2026-07-25 11:58:09 +02:00

test-recurrent-state-rollback.cpp

DeepseekV4 MTP + DSpark (#25784)

2026-08-02 20:55:34 +08:00

test-rope.cpp

…

test-rset-release.cpp

tests : avoid building get-model.cpp many times (#26317)

2026-07-30 19:34:04 +03:00

test-sampling.cpp

llama : support multi-output backend sampling (#25532)

2026-08-10 16:58:56 +03:00

test-save-load-state.cpp

tests : remove unnecessary sync in test-save-load-state (#26166)

2026-07-27 13:11:20 +03:00

test-state-restore-fragmented.cpp

common : only load backends when required (#22290)

2026-05-05 09:23:50 +02:00

test-thread-safety.cpp

tests : synchronize contexts at end of test-thread-safety (#24935)

2026-06-25 09:22:51 +03:00

test-tokenizer-0.cpp

…

test-tokenizer-0.py

requirements : update transformers to 5.5.1 (#21617)

2026-04-09 12:36:29 +02:00

test-tokenizer-0.sh

model : add Jina Embeddings v5 Nano (partial EuroBERT) support (#19826)

2026-02-26 12:14:09 +01:00

test-tokenizer-1-bpe.cpp

…

test-tokenizer-1-spm.cpp

…

test-tokenizer-random.py

requirements : update transformers to 5.5.1 (#21617)

2026-04-09 12:36:29 +02:00

test-tokenizers-repo.sh

…

testing.h

common : implement new jinja template engine (#18462)

2026-01-16 11:22:06 +01:00