Commit Graph
119 Commits
Author SHA1 Message Date
leejet 5531c8878a chore: fotmat code 2026-11-01 13:40:36 +08:00
leejet 6edeac1b20 fix: include math helpers directly in SageAttention utilities 2026-11-01 13:39:29 +08:00
leejet 75e8157b01 revert: restore public backend extension integration 2026-11-01 04:09:12 +08:00
leejet a013932674 revert: restore public graph helper usage 2026-11-01 04:08:53 +08:00
leejet ee12f0ea97 refactor: consolidate graph helpers in sd.cpp 2026-11-01 04:01:57 +08:00
leejet 6cfc3572f7 refactor: reuse ggml internals in backend extensions 2026-11-01 04:01:26 +08:00
leejet 95773aa216 refactor: move CUTLASS ownership into sd.cpp 2026-11-01 04:00:32 +08:00
leejet 8d3587965a refactor: externalize Sol-Attn and use public graph APIs 2026-11-01 03:03:53 +08:00
leejet 15da7f4fe1 refactor: implement SageAttention through backend extensions 2026-11-01 02:25:21 +08:00
leejet f0204a7eaa refactor: preserve INT8 APIs through backend extensions 2026-11-01 01:55:51 +08:00
leejet 051b49751e refactor: use custom RoPE Apply nodes exclusively 2026-11-01 01:11:17 +08:00
leejet d07d48d466 refactor: separate CPU kernels from shared operator extensions 2026-11-01 00:44:28 +08:00
leejet d11410eee7 refactor: share CUDA-style extension kernels across backends 2026-11-01 00:21:35 +08:00
leejet 7ab323ef25 refactor: move Vulkan RoPE kernels into extensions 2026-10-31 23:39:19 +08:00
leejet 5c5535d01d refactor: register CUDA affine fusion extensions 2026-10-31 22:59:06 +08:00
leejet 7ad74e6490 refactor: register CUDA INT8 GEMM and epilogue extensions 2026-10-31 22:29:12 +08:00
leejet d8964d0302 refactor: enable CUDA graph replay for extensions 2026-10-31 21:52:28 +08:00
leejet ba2188624e refactor: move CUDA ConvRot fusion into extensions 2026-10-31 21:18:40 +08:00
leejet 773b11caa7 refactor: move CUDA INT8 residual fusion into extensions 2026-10-31 20:55:44 +08:00
leejet b71db9a314 feat: add CUDA execution for custom INT8 operators 2026-10-31 20:24:30 +08:00
leejet 2f68a92505 refactor: register CPU INT8 GEMM and ConvRot extensions 2026-10-31 20:10:56 +08:00
leejet ab232a474b refactor: register INT8 projection and attention fusion 2026-10-31 20:01:41 +08:00
leejet 1d2d31ffb6 refactor: register CUDA RoPE kernels and fusion in sd.cpp 2026-10-31 19:18:40 +08:00
leejet 4b274821e9 refactor: register CuTe attention and fusion in sd.cpp 2026-10-31 19:00:24 +08:00
leejet f4a1902061 refactor: register RoPE kernels and fusion outside ggml 2026-10-31 18:18:33 +08:00
leejet 0a067120b3 perf: optimize Vulkan kernels, graph fusion, and workspace reuse (#2251) 2026-10-31 14:55:58 +08:00
leejet e239e4b0fd refactor: replace manual gated activations with native ggml GLU (#2250) 2026-10-30 01:32:46 +08:00
leejet 37bc88b5e9 perf: optimize H3 inference and segmented weight prefetch (#2240) 2026-10-30 00:38:14 +08:00
leejet 77b72a2efe perf: accelerate INT8 diffusion inference with CUDA fusions (#2235) 2026-10-28 22:02:46 +08:00
project516 2032526e8c fix: include integrated GPUs in automatic memory planning (#2228) 2026-10-28 01:28:11 +08:00
Mirekandleejet e6370bf093 perf: avoid redundant MOSS QKV and value layout copies (#2209)
Co-authored-by: leejet <leejet714@gmail.com>
2026-10-25 16:54:51 +08:00
leejet ea209dbfcf perf: cache CPU position embeddings across DiT runners (#2211) 2026-10-25 05:18:30 +08:00
leejet e0ed724e28 chore: format code 2026-10-24 01:23:42 +08:00
losewayy 40b1788476 feat: allow grouped temporal decoding for Wan2.2 TI2V 5B (#2196) 2026-10-24 01:09:05 +08:00
boriselec ddd6b3aa35 fix: correct Linux sysfs path for physical core detection (#2186) 2026-10-22 22:53:18 +08:00
leejet b15c8aac39 fix: include RPC devices in --list-devices (#2182) 2026-10-21 23:47:50 +08:00
vmobilis 939895f00e feat: display remaining time (#2076) 2026-10-21 23:29:05 +08:00
leejet af0fc72c96 chore: sync ggml and remove obsolete conv1d workarounds (#2147) 2026-10-17 02:39:51 +08:00
therealshulgin 8c442fb0ad fix: open model files with UTF-8 paths on Windows (#2144) 2026-10-17 00:50:09 +08:00
leejet e47426c044 fix: benchmark Vulkan direct convolution in auto mode (#2141) 2026-10-15 23:08:30 +08:00
leejet 46362fc4c0 feat: add automatic direct convolution selection (#2134) 2026-10-13 23:25:19 +08:00
leejet d763dae3b8 feat: add per-module automatic flash attention selection (#2132) 2026-10-13 22:58:45 +08:00
losewayy ce95c09ce1 fix: halve VAE decode tile size on OOM retry instead of clamping to 256px (#2120) 2026-10-10 22:33:37 +08:00
leejet a1ded76da5 chore: resolve MSVC warnings in ggml extensions 2026-10-06 20:10:36 +08:00
leejet fd43b542a6 refactor: escape newlines in prompt logs and clarify source separators (#2106) 2026-10-06 19:51:12 +08:00
stduhpfandleejet 96f67fe631 feat: Server: Add support for previews via sdcpp API (#2093)
Co-authored-by: leejet <leejet714@gmail.com>
2026-10-06 19:20:02 +08:00
leejet 203a882a28 refactor: shorten log levels and move source locations to the end (#2104) 2026-10-06 18:26:49 +08:00
leejet 42ab1c12f1 fix: keep scaled INT8 convrot matmuls on Vulkan (#2070) 2026-09-27 20:43:06 +08:00
leejet 19bbbca1c7 refactor: define VAE tile dimensions in image pixels (#2059) 2026-09-25 18:20:32 +08:00
leejet 0a9340c599 fix: scale Qwen Image 2.1 VAE convolutions (#2054) 2026-09-25 15:52:35 +08:00