ggml : refactor llamafile_sgemm PPC code (#14673)

Browse Source

Remove un-necessary templates from class definition and packing functions
Reduce deeply nested conditionals, if-else switching in mnapck function
Replace repetitive code with inline functions in Packing functions

2 ~ 7% improvement in Q8 Model
15 ~ 50% improvement in Q4 Model

Signed-off-by: Shalini Salomi Bodapati <[email protected]>

...

This commit is contained in:

shalinib-ibm

2025-07-14 16:16:42 +03:00

committed by GitHub

parent 9c9e4fc635

commit 55c509daf5

1 changed files with 340 additions and 1091 deletions

Show all changes Ignore whitespace when comparing lines Ignore changes in amount of whitespace Ignore changes in whitespace at EOL

Download Patch File Download Diff File Expand all files Collapse all files

ggml/src/ggml-cpu/llamafile/sgemm.cpp

+340 -1091

File diff suppressed because it is too large Load Diff