Add stock MiniMax-H3 video and audio VAEs
Browse files
NOTICE
CHANGED
|
@@ -8,3 +8,7 @@ ComfyUI layout, selectively quantized to INT8 ConvRot, and compressed with a
|
|
| 8 |
4,097-row FP32 rank-16 table of the AdaLN time-conditioning curve. It uses the
|
| 9 |
standard MiniMax-H3 table path in ComfyUI and does not require modified runtime
|
| 10 |
code.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 8 |
4,097-row FP32 rank-16 table of the AdaLN time-conditioning curve. It uses the
|
| 9 |
standard MiniMax-H3 table path in ComfyUI and does not require modified runtime
|
| 10 |
code.
|
| 11 |
+
|
| 12 |
+
The two safetensors files under vae/ are unmodified, bit-identical copies of
|
| 13 |
+
the Comfy-Org MiniMax-H3 ComfyUI repackages. They retain the MiniMax H3 license
|
| 14 |
+
and are included as standard runtime companions to the modified FL2VA model.
|
README.md
CHANGED
|
@@ -32,16 +32,18 @@ standard MiniMax-H3 `adaln_t_table` format and loads in an unmodified ComfyUI.
|
|
| 32 |
| Path | Purpose |
|
| 33 |
|---|---|
|
| 34 |
| [`FL2VA/minimax-h3-fl2va-int8-lean-convrot-table-k16-g4097-quality21.safetensors`](FL2VA/minimax-h3-fl2va-int8-lean-convrot-table-k16-g4097-quality21.safetensors) | Stock-compatible FL2VA diffusion transformer, 20.940 GiB |
|
|
|
|
|
|
|
| 35 |
| [`reports/layer_policy.json`](reports/layer_policy.json) | Exact per-layer precision policy |
|
| 36 |
| [`reports/validation.json`](reports/validation.json) | Structural, numerical, and CPU-load results |
|
| 37 |
| [`reports/mm_quant_profile_fl2va.json`](reports/mm_quant_profile_fl2va.json) | Row-sampled reconstruction profile for all 200 main matrices |
|
| 38 |
|
| 39 |
-
This repository intentionally does **not** include the MiniMax-H3 text encoder
|
| 40 |
-
|
| 41 |
-
|
| 42 |
-
|
| 43 |
-
|
| 44 |
-
|
| 45 |
|
| 46 |
## What was changed
|
| 47 |
|
|
@@ -139,9 +141,22 @@ reconstruction result, **not** a perceptual or generation benchmark.
|
|
| 139 |
1. Use a current ComfyUI checkout with MiniMax-H3 and native INT8 ConvRot
|
| 140 |
support. This release was CPU-load-tested on a clean, unmodified ComfyUI
|
| 141 |
commit `14b05228cef127ce529bc0c08660770d4af3e9a8`.
|
| 142 |
-
2. Place the safetensors file in
|
| 143 |
-
|
| 144 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 145 |
|
| 146 |
No custom node or core patch is required for this checkpoint.
|
| 147 |
|
|
@@ -158,6 +173,14 @@ Completed:
|
|
| 158 |
the 4,096 interval midpoints;
|
| 159 |
- full CPU load through a clean, unmodified ComfyUI as
|
| 160 |
`ModelPatcher -> MiniMaxH3Model`, table mode `(4097, 16)`.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 161 |
|
| 162 |
Not completed at release time:
|
| 163 |
|
|
@@ -182,6 +205,17 @@ The official
|
|
| 182 |
was used only as a layout reference and as the source of the FP32
|
| 183 |
`rope.inv_freq` tensor absent from the raw Diffusers state dict.
|
| 184 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 185 |
## Limitations and intended use
|
| 186 |
|
| 187 |
This release is intended for research and local ComfyUI inference. It is a
|
|
|
|
| 32 |
| Path | Purpose |
|
| 33 |
|---|---|
|
| 34 |
| [`FL2VA/minimax-h3-fl2va-int8-lean-convrot-table-k16-g4097-quality21.safetensors`](FL2VA/minimax-h3-fl2va-int8-lean-convrot-table-k16-g4097-quality21.safetensors) | Stock-compatible FL2VA diffusion transformer, 20.940 GiB |
|
| 35 |
+
| [`vae/minimax_h3_video_vae_fp16.safetensors`](vae/minimax_h3_video_vae_fp16.safetensors) | Stock ComfyUI MiniMax-H3 visual VAE, FP16, 4.850 GiB |
|
| 36 |
+
| [`vae/minimax_h3_audio_vae_fp32.safetensors`](vae/minimax_h3_audio_vae_fp32.safetensors) | Stock ComfyUI MiniMax-H3 stereo audio VAE, FP32, 0.564 GiB |
|
| 37 |
| [`reports/layer_policy.json`](reports/layer_policy.json) | Exact per-layer precision policy |
|
| 38 |
| [`reports/validation.json`](reports/validation.json) | Structural, numerical, and CPU-load results |
|
| 39 |
| [`reports/mm_quant_profile_fl2va.json`](reports/mm_quant_profile_fl2va.json) | Row-sampled reconstruction profile for all 200 main matrices |
|
| 40 |
|
| 41 |
+
This repository intentionally does **not** include the MiniMax-H3 text encoder.
|
| 42 |
+
It is being prepared as a separate repository. ComfyUI does not require the
|
| 43 |
+
Diffusers scheduler, tokenizer, processor, or remote-code Python bundles as
|
| 44 |
+
separate downloads: the standard workflow needs this diffusion model, the two
|
| 45 |
+
included VAEs, and a compatible MiniMax-H3 text encoder. Ref2VA is not included
|
| 46 |
+
in this release.
|
| 47 |
|
| 48 |
## What was changed
|
| 49 |
|
|
|
|
| 141 |
1. Use a current ComfyUI checkout with MiniMax-H3 and native INT8 ConvRot
|
| 142 |
support. This release was CPU-load-tested on a clean, unmodified ComfyUI
|
| 143 |
commit `14b05228cef127ce529bc0c08660770d4af3e9a8`.
|
| 144 |
+
2. Place the FL2VA safetensors file in
|
| 145 |
+
`ComfyUI/models/diffusion_models/`.
|
| 146 |
+
3. Place both files from `vae/` in `ComfyUI/models/vae/`.
|
| 147 |
+
4. Load the three files with the standard diffusion-model and VAE loaders in a
|
| 148 |
+
MiniMax-H3 FL2VA workflow. Supply a compatible text encoder separately.
|
| 149 |
+
|
| 150 |
+
```text
|
| 151 |
+
ComfyUI/models/
|
| 152 |
+
|-- diffusion_models/
|
| 153 |
+
| `-- minimax-h3-fl2va-int8-lean-convrot-table-k16-g4097-quality21.safetensors
|
| 154 |
+
|-- vae/
|
| 155 |
+
| |-- minimax_h3_video_vae_fp16.safetensors
|
| 156 |
+
| `-- minimax_h3_audio_vae_fp32.safetensors
|
| 157 |
+
`-- text_encoders/
|
| 158 |
+
`-- <MiniMax-H3 text encoder from its separate repository>
|
| 159 |
+
```
|
| 160 |
|
| 161 |
No custom node or core patch is required for this checkpoint.
|
| 162 |
|
|
|
|
| 173 |
the 4,096 interval midpoints;
|
| 174 |
- full CPU load through a clean, unmodified ComfyUI as
|
| 175 |
`ModelPatcher -> MiniMaxH3Model`, table mode `(4097, 16)`.
|
| 176 |
+
- both companion VAE files fully loaded on CPU through the same clean ComfyUI:
|
| 177 |
+
`MiniMaxH3VideoVAE` in FP16 with native internal tiling, and
|
| 178 |
+
`MiniMaxH3AudioVAE` in FP32 with 32 kHz stereo output;
|
| 179 |
+
- companion VAE SHA-256 checksums match the official Comfy-Org repackaged files:
|
| 180 |
+
`7c1f131492e7eddacaac9069a61b81bdd39de5cc96561e677c5eab1cdce5e522`
|
| 181 |
+
(video) and
|
| 182 |
+
`8e505d95dd1561d47abd43d4238fd40d9bb1ae9e147ed0a4cba778d76ae4db48`
|
| 183 |
+
(audio).
|
| 184 |
|
| 185 |
Not completed at release time:
|
| 186 |
|
|
|
|
| 205 |
was used only as a layout reference and as the source of the FP32
|
| 206 |
`rope.inv_freq` tensor absent from the raw Diffusers state dict.
|
| 207 |
|
| 208 |
+
The two files under `vae/` are unmodified, bit-identical copies of the standard
|
| 209 |
+
[`Comfy-Org/MiniMax-H3`](https://huggingface.co/Comfy-Org/MiniMax-H3/tree/main/vae)
|
| 210 |
+
repackages. The original remote-code VAE bundles are more complicated: the
|
| 211 |
+
visual VAE constructs a causal 3D-CNN encoder and 36-layer ViT decoder from
|
| 212 |
+
Python and configuration files, while the audio VAE constructs a DAC-lineage
|
| 213 |
+
encoder and BigVGAN decoder. ComfyUI implements both architectures natively.
|
| 214 |
+
The single-file visual repack casts all 560 source weight tensors from FP32 to
|
| 215 |
+
FP16 and embeds the latent statistics; the audio repack preserves 743 tensors,
|
| 216 |
+
folds 172 weight-normalized pairs into ordinary FP32 weights, and embeds its
|
| 217 |
+
latent statistics. No remote Python code or external VAE config is required.
|
| 218 |
+
|
| 219 |
## Limitations and intended use
|
| 220 |
|
| 221 |
This release is intended for research and local ComfyUI inference. It is a
|