Perflow-Shuai/Wan2.2-5B-NonAR-DMD-4Step-LoRA-r64-iter1600

Wan2.2-5B non-AR DMD LoRA — Rank 64 · Iter 1600 · 4-step inference

Checkpoint identity / 权重信息

Item	Value
LoRA rank	64
LoRA alpha	64
Training iteration / 训练迭代	1600 (checkpoint_model_001600)
Inference denoising steps / 推理步数	4
Base model	Wan-AI/Wan2.2-TI2V-5B
Architecture	full-sequence non-AR

Important: iter 1600 is the training checkpoint iteration; 4-step is the number of denoising steps used during inference.

This repository contains the inference-time generator LoRA shown in the pure Wan2.2-5B non-AR DMD rank-comparison page. It is the rank-64 result at training iteration 1600, sampled in 4 denoising steps. The gallery compares rank 32/64/128/256 LoRAs against the official Wan2.2-TI2V-5B baseline; no ControlNet is used.

Checkpoint

• Base model: Wan-AI/Wan2.2-TI2V-5B
• Objective: DMD with backward simulation
• Student / teacher / critic attention: full-sequence non-AR
• LoRA rank / alpha / scale: 64 / 64 / 1.0
• Training iteration: 1600 (checkpoint_model_001600)
• Training window: 32 latent frames
• Inference denoising steps: 4 (FlowUniPC, timestep shift 5)
• Targets: 300 Linear modules across 30 transformer blocks
• Per block: self-attention q/k/v/o, cross-attention q/k/v/o, FFN 0/2
• Published adapter: generator only; the training-only critic LoRA is intentionally omitted

The adapter contains 600 finite FP32 tensors (161,218,560 parameters), one LoRA A/B pair for each of the 300 listed target modules. Publication verifies that all tensors are finite and that the native and Safetensors files preserve the same generator keys and values. The pure-Wan gallery includes this rank-64/step-1600 checkpoint across eight validation prompts.

Files

• adapter_model.safetensors: generator-only PEFT adapter, safe portable format
• generator_lora.pt: generator-only native LongLive checkpoint with keys generator_lora and step
• adapter_config.json: rank, alpha, and the exact 300 target-module names
• training_config.yaml: source non-AR DMD training configuration
• inference_overrides.yaml: essential settings for 4-step LongLive inference
• provenance.json: source and published-file checksums

LongLive usage

Download the native checkpoint:

from huggingface_hub import hf_hub_download

lora_path = hf_hub_download(
    repo_id="Perflow-Shuai/Wan2.2-5B-NonAR-DMD-4Step-LoRA-r64-iter1600",
    filename="generator_lora.pt",
)
print(lora_path)

In the LongLive inference config, keep the normal Wan2.2-TI2V-5B base model and apply these settings:

algorithm:
  generator_is_causal: false

model_kwargs:
  model_name: Wan2.2-TI2V-5B
  timestep_shift: 5.0
  num_frame_per_block: 8
  local_attn_size: -1

checkpoints:
  lora_ckpt: /path/to/generator_lora.pt

inference:
  sampling_steps: 4
  sink_size: 0
  multi_shot_rope_offset: 8

adapter:
  type: lora
  rank: 64
  alpha: 64
  dropout: 0.0

The current LongLive loader recognizes generator_lora.pt directly. For other Wan runtimes, use adapter_model.safetensors and map the exact target names from adapter_config.json. The comparison page tested repository-specific CFG values for controlled comparisons; those values should not be treated as a universal recommended CFG recipe.

Provenance and integrity

The original training checkpoint contained equal-size generator and critic LoRAs plus step=1600. Publication extracts the generator tensors without changing their names, shapes, dtypes, or values.

File	Bytes	SHA-256
adapter_model.safetensors	644,949,280	da4a75094b4afdf5fbdf47a07530151b9ef47f2fffebc4c8675683ad049c32dc
generator_lora.pt	645,089,990	2abce9458990af1abe2773409a5b217c3d96b261152381b523ab1716380ef617

Original combined training-checkpoint SHA-256: f4dfbc89ea70351213ed3b153f731025f572705eea36830e6a71f6cd2c2c2115.