feat: run conditional and unconditional CFG in one batched UNet forward (#2085)

This commit is contained in:
Daniele authored and GitHub committed 2026-10-10 23:35:58 +08:00
1 parent b7a74e68d7
commit 1b0ba10893
7 files changed
+148 -23

No files matched your search

+10
View File
@@ -21,6 +21,16 @@ CPU fallback. It excludes weights and cache buffers. Within a runner lifecycle,
the summary is printed only on the first graph or when backend capacities or the
segment count change.
## Run conditional and unconditional CFG in one batched UNet forward.
For UNet models, the conditional and unconditional guidance branches are
concatenated into a single batch of two and run through one UNet forward per
step instead of two separate forwards. This is enabled by default whenever the
run qualifies for it.
Use `--batched-cfg off` to force separate conditional and unconditional
forwards.
## Use VAE tiling to reduce encode and decode memory usage.
`--vae-tiling` enables spatial tiling for both VAE encoding and decoding. The