Diffusers
Safetensors
OrbitQuantComponentArtifact
orbitquant
quantized
diffusion-transformer
8-bit precision
Instructions to use WaveCut/Wan2.1-T2V-1.3B-Diffusers-OrbitQuant-W4A4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use WaveCut/Wan2.1-T2V-1.3B-Diffusers-OrbitQuant-W4A4 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("WaveCut/Wan2.1-T2V-1.3B-Diffusers-OrbitQuant-W4A4", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Refresh OrbitQuant model cards
Browse files- README.md +1 -1
- SHA256SUMS +1 -1
README.md
CHANGED
|
@@ -36,9 +36,9 @@ artifact_dir = snapshot_download(artifact_id, repo_type="model")
|
|
| 36 |
pipe = load_quantized_pipeline_from_artifact(
|
| 37 |
artifact_dir,
|
| 38 |
torch_dtype=torch.bfloat16,
|
| 39 |
-
device="cuda",
|
| 40 |
runtime_mode="auto_fused",
|
| 41 |
)
|
|
|
|
| 42 |
|
| 43 |
frames = pipe(
|
| 44 |
prompt="A cinematic shot of a small robot walking through a neon market",
|
|
|
|
| 36 |
pipe = load_quantized_pipeline_from_artifact(
|
| 37 |
artifact_dir,
|
| 38 |
torch_dtype=torch.bfloat16,
|
|
|
|
| 39 |
runtime_mode="auto_fused",
|
| 40 |
)
|
| 41 |
+
pipe.enable_model_cpu_offload(device="cuda")
|
| 42 |
|
| 43 |
frames = pipe(
|
| 44 |
prompt="A cinematic shot of a small robot walking through a neon market",
|
SHA256SUMS
CHANGED
|
@@ -1,4 +1,4 @@
|
|
| 1 |
-
|
| 2 |
c7d0a00ee273efd217df7a3d4c38aae28065af27a6d9179d8b8cbfae762f2551 assets/video_generation_comparison_matrix.webp
|
| 3 |
ccf87334e02eee391e4ced63f056c1cc5efeb2ec4d32a7050ab089463e8bc1cd benchmark/summary.json
|
| 4 |
2fe65bda9f0f318516c36ac28d22f76ee645409bc220692926a4311547ca9c4a model.safetensors
|
|
|
|
| 1 |
+
d3986399318d7adf58135c4f9e9ba3fa7f92b26ff2aed25a754b77159717f5b5 README.md
|
| 2 |
c7d0a00ee273efd217df7a3d4c38aae28065af27a6d9179d8b8cbfae762f2551 assets/video_generation_comparison_matrix.webp
|
| 3 |
ccf87334e02eee391e4ced63f056c1cc5efeb2ec4d32a7050ab089463e8bc1cd benchmark/summary.json
|
| 4 |
2fe65bda9f0f318516c36ac28d22f76ee645409bc220692926a4311547ca9c4a model.safetensors
|