fix: handle GPU memory reports and LLM encoding failures (#2020)

This commit is contained in:
leejet authored and GitHub committed 2026-09-22 00:28:52 +08:00
1 parent 97d932b8f8
commit 6dcb5bbd42
4 files changed
+25 -10

No files matched your search

+5 -2
View File
@@ -156,8 +156,11 @@ the runner's graph-cut capacity checks.
Runtime capacity checks also leave 512 MiB of currently free device memory for
backend scratch buffers and pipelines, including with explicit backend assignments.
They cap stale free-memory reports by the device's total memory minus tracked
resident allocations and reject reports that exceed the device's total memory.
They cap free-memory reports by the device's total memory minus tracked
resident allocations. Vulkan reports exceeding total memory are rejected because
its heap-budget subtraction can underflow. Other backends use the cap instead of
treating such reports as zero free memory. Failed checks log the reported free and
total memory alongside tracked weight and runtime allocations.
Components are considered in `diffusion`, `te`, `vae` order so that repeatedly
used diffusion weights have priority. Each component's weights use the first