DmitryDB commited on
Commit
dfa3dbf
·
verified ·
1 Parent(s): ae62d69

Add stock MiniMax-H3 video and audio VAEs

Browse files
Files changed (2) hide show
  1. NOTICE +4 -0
  2. README.md +43 -9
NOTICE CHANGED
@@ -8,3 +8,7 @@ ComfyUI layout, selectively quantized to INT8 ConvRot, and compressed with a
8
  4,097-row FP32 rank-16 table of the AdaLN time-conditioning curve. It uses the
9
  standard MiniMax-H3 table path in ComfyUI and does not require modified runtime
10
  code.
 
 
 
 
 
8
  4,097-row FP32 rank-16 table of the AdaLN time-conditioning curve. It uses the
9
  standard MiniMax-H3 table path in ComfyUI and does not require modified runtime
10
  code.
11
+
12
+ The two safetensors files under vae/ are unmodified, bit-identical copies of
13
+ the Comfy-Org MiniMax-H3 ComfyUI repackages. They retain the MiniMax H3 license
14
+ and are included as standard runtime companions to the modified FL2VA model.
README.md CHANGED
@@ -32,16 +32,18 @@ standard MiniMax-H3 `adaln_t_table` format and loads in an unmodified ComfyUI.
32
  | Path | Purpose |
33
  |---|---|
34
  | [`FL2VA/minimax-h3-fl2va-int8-lean-convrot-table-k16-g4097-quality21.safetensors`](FL2VA/minimax-h3-fl2va-int8-lean-convrot-table-k16-g4097-quality21.safetensors) | Stock-compatible FL2VA diffusion transformer, 20.940 GiB |
 
 
35
  | [`reports/layer_policy.json`](reports/layer_policy.json) | Exact per-layer precision policy |
36
  | [`reports/validation.json`](reports/validation.json) | Structural, numerical, and CPU-load results |
37
  | [`reports/mm_quant_profile_fl2va.json`](reports/mm_quant_profile_fl2va.json) | Row-sampled reconstruction profile for all 200 main matrices |
38
 
39
- This repository intentionally does **not** include the MiniMax-H3 text encoder,
40
- tokenizer, or video/audio VAEs. The text encoder is being prepared as a separate
41
- repository. Obtain the remaining standard components from the
42
- [`MiniMaxAI/MiniMax-H3`](https://huggingface.co/MiniMaxAI/MiniMax-H3) or
43
- [`Comfy-Org/MiniMax-H3`](https://huggingface.co/Comfy-Org/MiniMax-H3)
44
- repositories. Ref2VA is not included in this release.
45
 
46
  ## What was changed
47
 
@@ -139,9 +141,22 @@ reconstruction result, **not** a perceptual or generation benchmark.
139
  1. Use a current ComfyUI checkout with MiniMax-H3 and native INT8 ConvRot
140
  support. This release was CPU-load-tested on a clean, unmodified ComfyUI
141
  commit `14b05228cef127ce529bc0c08660770d4af3e9a8`.
142
- 2. Place the safetensors file in `ComfyUI/models/diffusion_models/`.
143
- 3. Load it with the standard diffusion-model loader in a MiniMax-H3 FL2VA
144
- workflow. Supply the text encoder and video/audio VAEs separately.
 
 
 
 
 
 
 
 
 
 
 
 
 
145
 
146
  No custom node or core patch is required for this checkpoint.
147
 
@@ -158,6 +173,14 @@ Completed:
158
  the 4,096 interval midpoints;
159
  - full CPU load through a clean, unmodified ComfyUI as
160
  `ModelPatcher -> MiniMaxH3Model`, table mode `(4097, 16)`.
 
 
 
 
 
 
 
 
161
 
162
  Not completed at release time:
163
 
@@ -182,6 +205,17 @@ The official
182
  was used only as a layout reference and as the source of the FP32
183
  `rope.inv_freq` tensor absent from the raw Diffusers state dict.
184
 
 
 
 
 
 
 
 
 
 
 
 
185
  ## Limitations and intended use
186
 
187
  This release is intended for research and local ComfyUI inference. It is a
 
32
  | Path | Purpose |
33
  |---|---|
34
  | [`FL2VA/minimax-h3-fl2va-int8-lean-convrot-table-k16-g4097-quality21.safetensors`](FL2VA/minimax-h3-fl2va-int8-lean-convrot-table-k16-g4097-quality21.safetensors) | Stock-compatible FL2VA diffusion transformer, 20.940 GiB |
35
+ | [`vae/minimax_h3_video_vae_fp16.safetensors`](vae/minimax_h3_video_vae_fp16.safetensors) | Stock ComfyUI MiniMax-H3 visual VAE, FP16, 4.850 GiB |
36
+ | [`vae/minimax_h3_audio_vae_fp32.safetensors`](vae/minimax_h3_audio_vae_fp32.safetensors) | Stock ComfyUI MiniMax-H3 stereo audio VAE, FP32, 0.564 GiB |
37
  | [`reports/layer_policy.json`](reports/layer_policy.json) | Exact per-layer precision policy |
38
  | [`reports/validation.json`](reports/validation.json) | Structural, numerical, and CPU-load results |
39
  | [`reports/mm_quant_profile_fl2va.json`](reports/mm_quant_profile_fl2va.json) | Row-sampled reconstruction profile for all 200 main matrices |
40
 
41
+ This repository intentionally does **not** include the MiniMax-H3 text encoder.
42
+ It is being prepared as a separate repository. ComfyUI does not require the
43
+ Diffusers scheduler, tokenizer, processor, or remote-code Python bundles as
44
+ separate downloads: the standard workflow needs this diffusion model, the two
45
+ included VAEs, and a compatible MiniMax-H3 text encoder. Ref2VA is not included
46
+ in this release.
47
 
48
  ## What was changed
49
 
 
141
  1. Use a current ComfyUI checkout with MiniMax-H3 and native INT8 ConvRot
142
  support. This release was CPU-load-tested on a clean, unmodified ComfyUI
143
  commit `14b05228cef127ce529bc0c08660770d4af3e9a8`.
144
+ 2. Place the FL2VA safetensors file in
145
+ `ComfyUI/models/diffusion_models/`.
146
+ 3. Place both files from `vae/` in `ComfyUI/models/vae/`.
147
+ 4. Load the three files with the standard diffusion-model and VAE loaders in a
148
+ MiniMax-H3 FL2VA workflow. Supply a compatible text encoder separately.
149
+
150
+ ```text
151
+ ComfyUI/models/
152
+ |-- diffusion_models/
153
+ | `-- minimax-h3-fl2va-int8-lean-convrot-table-k16-g4097-quality21.safetensors
154
+ |-- vae/
155
+ | |-- minimax_h3_video_vae_fp16.safetensors
156
+ | `-- minimax_h3_audio_vae_fp32.safetensors
157
+ `-- text_encoders/
158
+ `-- <MiniMax-H3 text encoder from its separate repository>
159
+ ```
160
 
161
  No custom node or core patch is required for this checkpoint.
162
 
 
173
  the 4,096 interval midpoints;
174
  - full CPU load through a clean, unmodified ComfyUI as
175
  `ModelPatcher -> MiniMaxH3Model`, table mode `(4097, 16)`.
176
+ - both companion VAE files fully loaded on CPU through the same clean ComfyUI:
177
+ `MiniMaxH3VideoVAE` in FP16 with native internal tiling, and
178
+ `MiniMaxH3AudioVAE` in FP32 with 32 kHz stereo output;
179
+ - companion VAE SHA-256 checksums match the official Comfy-Org repackaged files:
180
+ `7c1f131492e7eddacaac9069a61b81bdd39de5cc96561e677c5eab1cdce5e522`
181
+ (video) and
182
+ `8e505d95dd1561d47abd43d4238fd40d9bb1ae9e147ed0a4cba778d76ae4db48`
183
+ (audio).
184
 
185
  Not completed at release time:
186
 
 
205
  was used only as a layout reference and as the source of the FP32
206
  `rope.inv_freq` tensor absent from the raw Diffusers state dict.
207
 
208
+ The two files under `vae/` are unmodified, bit-identical copies of the standard
209
+ [`Comfy-Org/MiniMax-H3`](https://huggingface.co/Comfy-Org/MiniMax-H3/tree/main/vae)
210
+ repackages. The original remote-code VAE bundles are more complicated: the
211
+ visual VAE constructs a causal 3D-CNN encoder and 36-layer ViT decoder from
212
+ Python and configuration files, while the audio VAE constructs a DAC-lineage
213
+ encoder and BigVGAN decoder. ComfyUI implements both architectures natively.
214
+ The single-file visual repack casts all 560 source weight tensors from FP32 to
215
+ FP16 and embeds the latent statistics; the audio repack preserves 743 tensors,
216
+ folds 172 weight-normalized pairs into ordinary FP32 weights, and embeds its
217
+ latent statistics. No remote Python code or external VAE config is required.
218
+
219
  ## Limitations and intended use
220
 
221
  This release is intended for research and local ComfyUI inference. It is a