14 Commits

Author SHA1 Message Date
Dong Wang
500ef5fa7c
fix: map mmapped weights through Metal buffers instead of CPU buffers (#2037) 2026-09-24 00:53:49 +08:00
leejet
adcac69650
perf: pad small attention heads to 64 for MMA Flash Attention (#1992) 2026-09-18 23:59:58 +08:00
George
0bd72f075a
feat: add Wan2.2 S2V (audio+img-to-video) support (#1925)
Co-authored-by: leejet <leejet714@gmail.com>
2026-09-13 23:33:50 +08:00
leejet
44dd13716d
feat: preserve explicit backend assignments during auto-fit (#1967) 2026-09-13 17:40:38 +08:00
leejet
31ab2b2e08
refactor: split ggml extensions and move implementations to cpp files (#1945) 2026-09-07 23:34:45 +08:00
leejet
a8a91b24cd
feat: add ADetailer support (#1785) 2026-07-14 23:59:11 +08:00
Piotr Wilkin (ilintar)
68f3d6df9f
feat: support for cross-device row split (#1735) 2026-07-04 16:31:18 +08:00
Piotr Wilkin (ilintar)
7bcd189639
feat: add multi-device layer split (--backend "diffusion=cuda0&cuda1") (#1734) 2026-07-04 16:06:33 +08:00
stduhpf
1a13107bac
feat: add imatrix support (#633) 2026-07-01 23:26:37 +08:00
leejet
bb90bfa00f feat: support backend-specific max-vram budgets 2026-06-14 22:46:32 +08:00
stduhpf
c2df4e1228
feat: add RPC support (#1629) 2026-06-14 17:30:23 +08:00
leejet
5db680c2c7
refactor: route cpu placement through backend specs (#1654) 2026-06-14 15:52:24 +08:00
leejet
bdb431ad95
feat: support disk params backend (#1651) 2026-06-14 14:48:50 +08:00
leejet
f3fd359b58
refactor: reorganize src model layout (#1615) 2026-06-07 03:21:12 +08:00