Instructions to use Disty0/FLUX.2-klein-4B-SDNQ-4bit-dynamic with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use Disty0/FLUX.2-klein-4B-SDNQ-4bit-dynamic with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Disty0/FLUX.2-klein-4B-SDNQ-4bit-dynamic", dtype=torch.bfloat16, device_map="cuda") prompt = "Turn this cat into a dog" input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/cat.png") image = pipe(image=input_image, prompt=prompt).images[0] - Notebooks
- Google Colab
- Kaggle
Update README.md
Browse files
README.md
CHANGED
|
@@ -1,5 +1,5 @@
|
|
| 1 |
---
|
| 2 |
-
license:
|
| 3 |
license_name: flux-non-commercial-license
|
| 4 |
license_link: LICENSE.md
|
| 5 |
base_model:
|
|
@@ -60,5 +60,4 @@ Original BF16 vs SDNQ quantization comparison:
|
|
| 60 |
| Quantization | Model Size | Visualization |
|
| 61 |
| --- | --- | --- |
|
| 62 |
| Original BF16 | 7.8 GB |  |
|
| 63 |
-
| SDNQ 4 Bit | 2.5 GB |  |
|
| 64 |
-
|
|
|
|
| 1 |
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
license_name: flux-non-commercial-license
|
| 4 |
license_link: LICENSE.md
|
| 5 |
base_model:
|
|
|
|
| 60 |
| Quantization | Model Size | Visualization |
|
| 61 |
| --- | --- | --- |
|
| 62 |
| Original BF16 | 7.8 GB |  |
|
| 63 |
+
| SDNQ 4 Bit | 2.5 GB |  |
|
|
|