metadata
title: Audio-Omni V2A ZeroGPU
emoji: 🎛️
colorFrom: indigo
colorTo: blue
sdk: gradio
sdk_version: 5.50.0
app_file: app.py
python_version: '3.11'
pinned: false
Audio-Omni V2A on ZeroGPU
This Space runs Video-to-Audio (V2A) only, based on
ZeyueT/Audio-Omni.
What it does
- Input: video file + optional text prompt
- Output: generated audio (
.wav) - Task used internally:
model.generate("V2A", prompt=..., video_path=...)
Environment variables (optional)
AUDIO_OMNI_REPO_ID(default:HKUSTAudio/Audio-Omni)AUDIO_OMNI_CACHE_DIR(default:./model)QWEN_OMNI_REPO_ID(default:Qwen/Qwen2.5-Omni-3B)QWEN_OMNI_CACHE_DIR(default:./model/qwen_omni_3b)GPU_DURATION_SECONDS(default:120)MAX_RUNTIME_SECONDS(default:115)MAX_STEPS(default:85)MAX_AUDIO_SECONDS(default:10)MAX_COMPLEXITY(default:800)FIXED_SECONDS_TOTAL(default:10, internal generation length for current Audio-Omni constraints)OUTPUT_SECONDS(default:5, final exported audio length)PREFETCH_ON_START(default:1, run model warmup on page load)PREFETCH_ON_BOOT(default:1, pre-download model assets right at container startup)FORCE_ZERO_SYNC_FEATURES(default:1, stability workaround for current Audio-Omni bug)HF_TOKEN(optional but recommended for faster/stable Hub downloads)
Notes
- First run can be slow due to model download and initialization.
- This demo focuses only on V2A.
- Model weights license: CC BY-NC 4.0 (research use).