FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1300

A FastH3 Preview v1 ablation from FastVideo. It generates synchronized video and audio from text with four transformer forwards. This step-1300 model was trained with DMD2 on synthetic Base H3 videos and uses VSA-H3 at 90% sparsity.

Blog · Matching LoRA · Recommended checkpoint · FastH3 collection

This checkpoint requires FastVideo's VSA-H3 attention backend.

Run with FastVideo

Install uv, then use the CUDA 13 / Blackwell path below. It selects FastVideo's published CUDA kernel wheel instead of compiling the kernel locally. See the installation guide for other platforms.

git clone https://github.com/hao-ai-lab/FastVideo.git
cd FastVideo
uv venv --python 3.12 --seed
source .venv/bin/activate
UV_TORCH_BACKEND=cu130 uv pip install \
  --no-sources-package fastvideo-kernel \
  -e ".[fasth3]"

python examples/inference/basic/basic_fasth3.py \
  --model-path FastVideo/FastVideo-FastH3-4-step-Preview-v1-VSA-Synthetic-Step1300 \
  --prompt "your prompt" \
  --no-warmup \
  --repeats 1

The tested defaults use four B200 GPUs and the trained four-forward schedule. On other multi-GPU CUDA systems, follow the installation guide and add --no-replicated-dit --vsa-kernel triton --no-fa4. The GPU count must divide H3's 56 attention heads.

Scope

This preview supports text-to-audio-video generation. FL2VA and Ref2VA were not distilled. Difficult motion, fine detail, and some audio may remain below the base MiniMax H3 model. This checkpoint inherits the MiniMax H3 Community License.

Acknowledgements

We thank Nuva Lab for bringing production grounding to FastH3 through its experience with real-world creative video-agent workloads. Its production-aligned post-training insights help bridge open-source research to practical data-assisted distillation for commercial video workflows, with Omni Ref as the next focus.

We thank the NVIDIA FastGen team for the DMD2 framework and H3 reference experiment that helped us align the score clock, modality shifts, and backward simulation.

We also thank MiniMax for releasing H3-Base, and the vLLM project, NVIDIA, and MBZUAI for their continued sponsorship and support of FastVideo.