---
license: other
license_name: circlestone-labs-non-commercial-license
license_link: https://huggingface.co/circlestone-labs/Anima/blob/main/LICENSE.md
base_model:
- circlestone-labs/Anima
base_model_relation: quantized
tags:
- comfyui
- diffusion-single-file
pipeline_tag: text-to-image
---

# FP8/MXFP8 Quantized model of ANIMA

To use torch.compile on FP8/MXFP8 models, set to `max-autotune-no-cudagraphs` mode and dynamic to `false`.

![image](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/MtmXjEgH9Nhww-pxelMO2.png)

## Generation speed

Tested on
- RTX5090 (400W), ComfyUI(commit id `c96fcdd`) with `--fast` option, torch2.12.0+cu130
- Generates 832x1216, 30steps, cfg 5.0, er_sde, simple

| quant | sage+torch.compile  |
|-------|---------------------|
| bf16  | 5.03s, 6.15it/s     |
| fp8   | **4.52s, 6.88it/s** |
| mxfp8 | 4.71s, 6.58it/s     |


## Sample

### anima-base-v1.0

![20260603_014607-Anima_00001_](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/V0NFlqj0y3nGw6jY7Va4C.webp)

### anima-preview3-base

![26-04-09-Anima_00005_](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/KHK64RUk50RYApie6vNzp.webp)


### anima-preview2

![26-03-12-Anima_00008_](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/hSj_U55dR1Pglw5dvWgOa.webp)


### anima-preview

| quant      | sample               |
|------------|----------------------|
| **bf16**       | ![anima-preview-bf16](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/MUYIxQjZZxX5wGGwPHS3G.webp)  |
| **fp8**        | ![anima-preview-fp8](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/b09IufBT31yDxg_BRZR3w.webp)   |
| **nvfp4mixed** | ![anima-preview-nvfp4](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/FMcirkGeDMAdbzkniOARF.webp) |


## Quantized layers

quantized by [comfy-dit-quantizer](https://github.com/bedovyy/comfy-dit-quantizer)

### fp8
```json
{
  "format": "comfy_quant",
  "block_names": ["net.blocks."],
  "rules": [
    { "policy": "keep", "match": ["blocks.0.", "blocks.1.", "blocks.27.", "adaln_modulation"] },
    { "policy": "float8_e4m3fn", "match": ["q_proj", "k_proj", "v_proj", "output_proj", ".mlp"] },
    { "policy": "nvfp4", "match": [] }
  ]
}
```

### nvfp4mixed
```json
{
  "format": "comfy_quant",
  "block_names": ["net.blocks."],
  "rules": [
    { "policy": "keep", "match": ["blocks.0.", "blocks.1.", "blocks.27.", "adaln_modulation"] },
    { "policy": "mxfp8", "match": ["q_proj", "k_proj", "v_proj", "output_proj", ".mlp"] },
    { "policy": "nvfp4", "match": [] }
  ]
}
```