Diffusers
Safetensors
OrbitQuantComponentArtifact
orbitquant
quantized
diffusion-transformer
8-bit precision
Instructions to use WaveCut/FLUX.2-klein-4B-OrbitQuant-W2A4 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use WaveCut/FLUX.2-klein-4B-OrbitQuant-W2A4 with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("WaveCut/FLUX.2-klein-4B-OrbitQuant-W2A4", dtype=torch.bfloat16, device_map="cuda") prompt = "Astronaut in a jungle, cold color palette, muted colors, detailed, 8k" image = pipe(prompt).images[0] - Notebooks
- Google Colab
- Kaggle
File size: 820 Bytes
a4957b7 d16e497 16cd752 d16e497 a4957b7 | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 | {
"_class_name": "OrbitQuantComponentArtifact",
"artifact_format": "orbitquant-v1",
"quant_method": "orbitquant",
"source_model_id": "black-forest-labs/FLUX.2-klein-4B",
"source_revision": "e7b7dc27f91deacad38e78976d1f2b499d76a294",
"source_license": "apache-2.0",
"component": "transformer",
"weight_name": "model.safetensors",
"quantization_config": "quantization_config.json",
"manifest": "orbitquant_manifest.json",
"codebooks": "orbitquant_codebooks.safetensors",
"rotations": "orbitquant_rotations.safetensors",
"weight_bits": 2,
"activation_bits": 4,
"target_policy": "flux2",
"runtime_mode": "dequant_bf16",
"activation_kernel_backend": "triton_cuda",
"quantization_device": "cuda",
"weight_quantization_backend": "triton_cuda",
"quantization_staging_mode": "component"
}
|