Hugging Face's logo

Bedovyy
/
Anima-FP8

Text-to-Image
Diffusion Single File
comfyui
Model card Files
xet
 Community
5
Anima-FP8
File size: 2,706 Bytes
0ca7492
 
 
 
 
 
 
cab6908
 
 
776d100
0ca7492
 
c1998fa
0ca7492
c1998fa
b3b5635
c1998fa
8f000df
 
 
 
c1998fa
 
8f000df
c1998fa
 
 
 
 
9625f2a
8f000df
 
 
c1998fa
 
 
 
c136c60
 
 
 
 
9f44a8d
 
 
 
 
 
 
9625f2a
 
f6435fa
 
 
9625f2a
8f000df
0ca7492
b3b5635
02a0f75
 
b3b5635
0ca7492
 
 
9625f2a
0ca7492
02a0f75
 
0ca7492
 
 
 
 
9625f2a
b3b5635
 
 
 
 
02a0f75
 
 
b3b5635
 
776d100
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
---
license: other
license_name: circlestone-labs-non-commercial-license
license_link: https://huggingface.co/circlestone-labs/Anima/blob/main/LICENSE.md
base_model:
- circlestone-labs/Anima
base_model_relation: quantized
tags:
- comfyui
- diffusion-single-file
pipeline_tag: text-to-image
---

# FP8/MXFP8 Quantized model of ANIMA

To use torch.compile on FP8/MXFP8 models, set to `max-autotune-no-cudagraphs` mode and dynamic to `false`.

![image](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/MtmXjEgH9Nhww-pxelMO2.png)

## Generation speed

Tested on
- RTX5090 (400W), ComfyUI(commit id `c96fcdd`) with `--fast` option, torch2.12.0+cu130
- Generates 832x1216, 30steps, cfg 5.0, er_sde, simple

| quant | sage+torch.compile  |
|-------|---------------------|
| bf16  | 5.03s, 6.15it/s     |
| fp8   | **4.52s, 6.88it/s** |
| mxfp8 | 4.71s, 6.58it/s     |


## Sample

### anima-base-v1.0

![20260603_014607-Anima_00001_](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/V0NFlqj0y3nGw6jY7Va4C.webp)

### anima-preview3-base

![26-04-09-Anima_00005_](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/KHK64RUk50RYApie6vNzp.webp)


### anima-preview2

![26-03-12-Anima_00008_](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/hSj_U55dR1Pglw5dvWgOa.webp)


### anima-preview

| quant      | sample               |
|------------|----------------------|
| **bf16**       | ![anima-preview-bf16](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/MUYIxQjZZxX5wGGwPHS3G.webp)  |
| **fp8**        | ![anima-preview-fp8](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/b09IufBT31yDxg_BRZR3w.webp)   |
| **nvfp4mixed** | ![anima-preview-nvfp4](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/FMcirkGeDMAdbzkniOARF.webp) |


## Quantized layers

quantized by [comfy-dit-quantizer](https://github.com/bedovyy/comfy-dit-quantizer)

### fp8
```json
{
  "format": "comfy_quant",
  "block_names": ["net.blocks."],
  "rules": [
    { "policy": "keep", "match": ["blocks.0.", "blocks.1.", "blocks.27.", "adaln_modulation"] },
    { "policy": "float8_e4m3fn", "match": ["q_proj", "k_proj", "v_proj", "output_proj", ".mlp"] },
    { "policy": "nvfp4", "match": [] }
  ]
}
```

### nvfp4mixed
```json
{
  "format": "comfy_quant",
  "block_names": ["net.blocks."],
  "rules": [
    { "policy": "keep", "match": ["blocks.0.", "blocks.1.", "blocks.27.", "adaln_modulation"] },
    { "policy": "mxfp8", "match": ["q_proj", "k_proj", "v_proj", "output_proj", ".mlp"] },
    { "policy": "nvfp4", "match": [] }
  ]
}
```