Default Branch

f114f91f9e · tests : initialize the L2_NORM batch array (#28553) · Updated 2026-09-07 19:54:13 +02:00

Branches

55cf48de1e · cuda : fix multi-seq, quantized FA · Updated 2025-07-22 19:48:53 +02:00    Superminaren

4918
2

386892ec61 · sync : ggml · Updated 2025-07-19 10:46:12 +02:00    Superminaren

4913
1

cfe5e98423 · graph : fix graph reuse reset of params · Updated 2025-07-18 16:50:32 +02:00    Superminaren

4916
1

9106d7595d · model : fix build after merge conflict · Updated 2025-07-18 10:50:59 +02:00    Superminaren

4919
1

05baa62a73 · kv-cache : fix k-shift for multiple streams · Updated 2025-07-17 19:18:36 +02:00    Superminaren

4928
1

07908a824a · server : pre-calculate EOG logit biases · Updated 2025-07-16 12:47:05 +02:00    Superminaren

4941
1

9f8d285901 · server : fix handling of the ignore_eos flag · Updated 2025-07-16 06:37:18 +02:00    Superminaren

4946
1

f68669d50f · fix and opt kernel launch · Updated 2025-07-15 13:28:26 +02:00    Superminaren

4981
3

942c55cd57 · imatrix : avoid using imatrix.dat in README · Updated 2025-07-12 22:50:10 +02:00    Superminaren

4966
32

1180752835 · cuda : support Falcon-H1 state size for SSM_SCAN · Updated 2025-07-09 18:18:37 +02:00    Superminaren

4996
1

4d6a179c68 · gguf-py : avoid adding duplicate tensor mappings for Jamba · Updated 2025-07-09 17:58:35 +02:00    Superminaren

4996
61

b7c6ece5b5 · ggml-ci · Updated 2025-07-09 14:13:34 +02:00    Superminaren

5001
24

7634d14d7a · test-model-random : fix seq_id buffer overflow · Updated 2025-07-09 00:23:58 +02:00    Superminaren

5001
18

2ff3354c33 · memory : fix broken batch splits for recurrent cache · Updated 2025-07-08 03:23:14 +02:00    Superminaren

5012
1

996195299e · up. · Updated 2025-07-07 23:42:40 +02:00    Superminaren

5164
6

bf8b39015f · metal : reuse graphs · Updated 2025-07-07 20:37:07 +02:00    Superminaren

5020
3

886da0a2c5 · kv-cache : prepare K/V buffers for separation · Updated 2025-07-04 09:13:16 +02:00    Superminaren

5031
1

dfceb012ee · llama : add "virtual sequences" · Updated 2025-07-02 19:26:55 +02:00    Superminaren

5042
8

71bef66591 · cuda : graceful fallback for Mamba-1 models with weird embd size · Updated 2025-07-02 09:49:36 +02:00    Superminaren

5051
44

6179578988 · batch : require non-coupled batch with sequential split_equal · Updated 2025-06-25 16:20:46 +02:00    Superminaren

5108
29