refactor: move model-specific operators and fusions into backend extensions (#2253)

This commit is contained in:
leejet authored and GitHub committed 2026-11-01 21:18:37 +08:00
1 parent c6dfa9def1
commit 45a63ac460
68 files changed
+12173 -151

No files matched your search

+3 -2
View File
@@ -4,8 +4,9 @@
the high-noise diffusion model when present. Python, PyTorch, and Triton are not
required at build time or runtime.
The CUDA backend automatically selects a kernel supported by both the GPU and
the compiled CUDA toolkit:
The sd.cpp CUDA extension registers SageAttention through GGML's generic
operator API. It selects a kernel supported by the GPU, compiled CUDA target,
and toolkit:
| GPU / toolkit | Implementation |
| --- | --- |