mirror of
https://github.com/leejet/stable-diffusion.cpp.git
synced 2026-11-14 12:56:33 +00:00
feat: unify text encoder selection across H3 variants (#2340)
This commit is contained in:
1 parent
8b1e9df27d
commit
b9d7176bf8
14 files changed
+123
-57
No files matched your search
+25
-4
@@ -12,12 +12,31 @@ Pass the four MiniMax-H3 components separately:
|
||||
- `--diffusion-model`: MiniMax-H3 diffusion transformer
|
||||
- `--vae`: MiniMax-H3 video VAE
|
||||
- `--audio-vae`: MiniMax-H3 audio VAE
|
||||
- `--llm`: the MiniMax-H3 Qwen3-VL-32B text encoder checkpoint
|
||||
- `--llm`: the MiniMax-H3 Qwen3-VL-32B text encoder, or Qwen3-VL-4B with the P-H3 text connector
|
||||
|
||||
The text encoder must be the MiniMax-H3 variant: Qwen3-VL-32B truncated to 50
|
||||
For the 32B option, use the MiniMax-H3 variant: Qwen3-VL-32B truncated to 50
|
||||
language layers and exported without the final language-model normalization.
|
||||
Its Qwen3-VL vision tower, including the three DeepStack mergers, must also be
|
||||
present. If the vision tower is stored separately, pass it with `--llm_vision`.
|
||||
|
||||
For the smaller 4B option, pass the P-H3-Image text encoder, which bundles the
|
||||
connector, with `--llm`. Alternatively, pass Qwen3-VL-4B with `--llm` and the
|
||||
[separate P-H3 text connector](https://huggingface.co/PrunaAI/P-H3-Image/blob/main/text_connector/diffusion_pytorch_model.safetensors)
|
||||
with `--embeddings-connectors`. For example, replace the `--llm` argument in the
|
||||
commands below with either:
|
||||
|
||||
```sh
|
||||
--llm ..\models\text_encoders\p-h3-image_text_encoder_int8_convrot.safetensors
|
||||
```
|
||||
|
||||
or:
|
||||
|
||||
```sh
|
||||
--llm ..\models\text_encoders\qwen3vl_4b.gguf --embeddings-connectors ..\models\text_encoders\p-h3-image_text_connector.safetensors
|
||||
```
|
||||
|
||||
Reference-image and reference-video conditioning needs the matching encoder's
|
||||
Qwen3-VL vision tower, including the three DeepStack mergers. If stored
|
||||
separately, pass it with `--llm_vision`. Keep using the MiniMax-H3 video and audio
|
||||
VAEs with either text encoder.
|
||||
|
||||
Both the original time-embedder DiT and the smaller AdaLN curve-table variant
|
||||
are detected from their weights.
|
||||
@@ -30,6 +49,8 @@ are detected from their weights.
|
||||
- Download qwen3vl_32b_minimax_h3
|
||||
- safetensors: https://huggingface.co/Comfy-Org/MiniMax-H3/tree/main/text_encoders
|
||||
- gguf: https://huggingface.co/leejet/MiniMax-H3-GGUF/tree/main
|
||||
- Or download the P-H3-Image text encoder (Qwen3-VL-4B with the text connector)
|
||||
- safetensors: https://huggingface.co/PrunaAI/P-H3-Image-Comfy/tree/main/text_encoders
|
||||
- Download vae
|
||||
- safetensors: https://huggingface.co/Comfy-Org/MiniMax-H3/tree/main/vae
|
||||
- Download audio vae
|
||||
|
||||
+14
-1
@@ -1,6 +1,6 @@
|
||||
# How to Use
|
||||
|
||||
P-H3-Image supports text-to-image and reference-image editing. It uses a MiniMax-H3 diffusion transformer, a single-frame VAE, and Qwen3-VL-4B with a text connector. Prompt enhancement is not included.
|
||||
P-H3-Image supports text-to-image and reference-image editing. It uses a MiniMax-H3 diffusion transformer, a single-frame VAE, and either Qwen3-VL-4B with a text connector or the MiniMax-H3 Qwen3-VL-32B text encoder. Prompt enhancement is not included.
|
||||
|
||||
## Download weights
|
||||
|
||||
@@ -10,9 +10,22 @@ P-H3-Image supports text-to-image and reference-image editing. It uses a MiniMax
|
||||
- safetensors: https://huggingface.co/PrunaAI/P-H3-Image-Comfy/tree/main/vae
|
||||
- Download Qwen3-VL-4B with the text connector
|
||||
- https://huggingface.co/PrunaAI/P-H3-Image-Comfy/tree/main/text_encoders
|
||||
- Or download the MiniMax-H3 Qwen3-VL-32B text encoder
|
||||
- safetensors: https://huggingface.co/Comfy-Org/MiniMax-H3/tree/main/text_encoders
|
||||
- gguf: https://huggingface.co/leejet/MiniMax-H3-GGUF/tree/main
|
||||
|
||||
Alternatively, reuse Qwen3-VL-4B, including its vision tower, with the [separate text connector](https://huggingface.co/PrunaAI/P-H3-Image/blob/main/text_connector/diffusion_pytorch_model.safetensors). Save the connector as `p-h3-image_text_connector.safetensors` and pass it with `--embeddings-connectors`.
|
||||
|
||||
The MiniMax-H3 Qwen3-VL-32B encoder does not need a text connector. To use it in
|
||||
either example below, omit `--embeddings-connectors` and replace `--llm` with:
|
||||
|
||||
```sh
|
||||
--llm ..\models\text_encoders\qwen3vl_32b_minimax_h3-Q4_K_M.gguf
|
||||
```
|
||||
|
||||
Reference-image editing needs the matching encoder's vision tower. If stored
|
||||
separately, pass it with `--llm_vision`.
|
||||
|
||||
Use the P-H3 image VAE; the MiniMax-H3 video VAE is not compatible. No audio VAE is needed.
|
||||
|
||||
## Examples
|
||||
|
||||
Reference in new issue
Block a user