---
license: other
license_name: circlestone-labs-non-commercial-license
license_link: https://huggingface.co/circlestone-labs/Anima/blob/main/LICENSE.md
base_model:
- circlestone-labs/Anima
base_model_relation: quantized
---

# FP8 Quantized model of ANIMA

There are two models - FP8 and FP8Mixed.

FP8Mixed quantized fewer layers, so expects better quality.

## Quantized layers

### fp8
```json
{
  "format": "comfy_quant",
  "block_names": [""],
  "rules": [
    { "policy": "keep", "match": ["blocks.0", "blocks.27"] },
    { "policy": "float8_e4m3fn", "match": ["q_proj", "k_proj", "v_proj", "o_proj", "output_proj", "mlp"] },
    { "policy": "nvfp4", "match": [] }
  ]
}
```

### fp8mixed
```json
{
  "format": "comfy_quant",
  "block_names": ["net.blocks."],
  "rules": [
    { "policy": "keep", "match": ["blocks.0.", "blocks.1.", "blocks.27.", "adaln_modulation", "v_proj"] },
    { "policy": "float8_e4m3fn", "match": ["q_proj", "k_proj", "output_proj", "mlp"] },
    { "policy": "nvfp4", "match": [] }
  ]
}
```

## Generation speed

Tested on
- RTX5090 (400W), ComfyUI with torch2.10.0+cu130
- Generates 832x1216, 30steps, cfg 4.0, er sde, simple

| Dtype (Quant) | Sage Attn | it/s | Time (s) | Relative Speedup (%) |
| ------------- | --------- | ---- | -------- | -------------------- |
| bf16          | X         | 4.33 | 7.07     | 0%                   |
| bf16          | O         | 4.66 | 6.59     | +7.6%                |
| fp8mixed      | X         | 4.79 | 6.42     | +10.6%               |
| fp8mixed      | O         | 5.25 | 5.87     | +21.3%               |
| fp8           | X         | 4.94 | 6.23     | +14.1%               |
| fp8           | O         | 5.40 | 5.72     | +24.7%               |


## Sample

| bf16 | fp8mixed | fp8 |
|-----|------|------|
|![ComfyUI_temp_onhsj_00007_](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/4OzIFBhl_FipyILF3ZXyb.png)|![ComfyUI_temp_gqpfh_00024_](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/GiVW4VHm1AnMB73q1mv1w.png)|![ComfyUI_temp_onhsj_00006_](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/Bk0o1slEWvdbO9NynBWGr.png)|
|![anima_bf16_1](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/_u2hrgEulSMOPiNux9bYI.png)|![anima_fp8mixed_1](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/dWEUFK3lFLK8_wsiRDMzJ.png)|![anima_fp8_1](https://cdn-uploads.huggingface.co/production/uploads/63fbf6951b4b1bd4e706fed1/b769101lzVGLjPIGJApJp.png)|