This is FLUX.2 [klein] 4B optimized using SDNQ with INT8 dynamic quantization and Hadamard Rotation (Group size: 256).

Sample

Prompt:

A cat holding a sign that says hello world

Seed: 922520

Usage

Install Torch, Diffusers (Git), SDNQ 0.2.0 and Triton.

Use CFG 1 and 4 steps.

Downloads last month
-
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for SamuelTallet/FLUX.2-klein-4B-SDNQ-8bit-dynamic-hadamard256

Quantized
(25)
this model