3 people e9f824d8c0 llama : add llama_prec_policy + model-driven W4A4 path (#24364) ...

* Rebase and update based on #26675

Signed-off-by: ynankani <[email protected]>

* CI failure fix(launh_bounds overload on HIP) and cleanup

Signed-off-by: ynankani <[email protected]>

* Address review comments

Signed-off-by: ynankani <[email protected]>

* Use ggml tensor instead of name in act policy map

Signed-off-by: ynankani <[email protected]>

* Address review comments and cleanup

Signed-off-by: ynankani <[email protected]>

* Address review comments

Signed-off-by: ynankani <[email protected]>

* Rename changes

Signed-off-by: ynankani <[email protected]>

* Update ggml/src/ggml-cuda/mmq.cu

Co-authored-by: Georgi Gerganov <[email protected]>

* MXFP4 dispatch changes for higher src prec

Signed-off-by: ynankani <[email protected]>

* Refactor and address review comments

Signed-off-by: ynankani <[email protected]>

* Updates based on review comments

Signed-off-by: ynankani <[email protected]>

* Apply batched suggestions from code review

Co-authored-by: Johannes Gäßler <[email protected]>

* Address review comments

Signed-off-by: ynankani <[email protected]>

* Apply patch from review

Signed-off-by: ynankani <[email protected]>

---------

Signed-off-by: ynankani <[email protected]>
Co-authored-by: Georgi Gerganov <[email protected]>
Co-authored-by: Johannes Gäßler <[email protected]>

2026-09-25 11:36:35 +03:00

..

android

android: fix missing screenshots for Android.md (#18156)

2025-12-19 09:32:04 +02:00

backend

[SYCL] support sparse FA (#28796)

2026-09-25 10:17:51 +03:00

development

common : implement common_schema internal representation for JSON schemas (#28736)

2026-09-12 16:14:50 -05:00

multimodal

docs : fix duplicated "the" in granitevision and model-conversion docs (#23767)

2026-05-27 09:34:06 +02:00

ops

cuda : add conv3d with implicit GEMM (#29137)

2026-09-24 10:24:57 +03:00

android.md

kleidiai : Update KleidiAI Documentation (#26078)

2026-09-01 10:45:13 +02:00

autoparser.md

[Model] Support for Spark2_5ForCausalLM implementation (#27868)

2026-09-06 17:43:58 +02:00

build-profiling.md

cmake : add PCH and unity build to improve build times (#28091)

2026-09-11 13:01:29 +02:00

build-riscv64-spacemit.md

ci : update spacemit toolchain url and enhance curl command (#23642)

2026-05-25 10:43:24 +02:00

build-s390x.md

ggml-cpu(s390x): add Q1_0 vector intrinsic support (#28606)

2026-09-10 09:50:28 +03:00

build.md

llama : add llama_prec_policy + model-driven W4A4 path (#24364)

2026-09-25 11:36:35 +03:00

completions.md

readme : refresh (#26280)

2026-07-30 16:14:37 +03:00

docker.md

sycl : Improve SYCL doc (#23025)

2026-06-04 08:02:54 +03:00

function-calling.md

docs: Update documentation with Granite 4.0/4.1 (#23404)

2026-05-22 20:35:46 +08:00

install.md

docs: Adapt conda-forge package name (#26229)

2026-07-28 16:51:20 +02:00

llguidance.md

llguidance build fixes for Windows (#11664)

2025-02-14 12:46:08 -08:00

models.md

readme : refresh (#26280)

2026-07-30 16:14:37 +03:00

multi-gpu.md

Write a readme on Multi-GPU usage in llama.cpp (#22729)

2026-05-07 17:48:40 +02:00

multimodal.md

mtmd: refactor preprocessor, add mtmd_image_preproc_out (#24736)

2026-06-18 12:04:39 +02:00

ops.md

cuda : add conv3d with implicit GEMM (#29137)

2026-09-24 10:24:57 +03:00

preset.md

common: add system-level config file (#26118)

2026-08-13 00:02:27 +02:00

release.md

ci : allow make-release to target a specific commit (#27234)

2026-08-17 11:52:46 +03:00

speculative.md

spec: Add benchmark-only synthetic speculative acceptance options (#27711)

2026-08-27 13:53:42 +03:00

xcframework.md

readme : refresh (#26280)

2026-07-30 16:14:37 +03:00