---
base_model:
- aoxo/flux.1dev-abliteratedv2
library_name: gguf
pipeline_tag: text-to-image
tags:
- gguf
- flux
- flux.1-dev
- quantized
- image-generation
- text-to-image
- comfyui
- comfyui-gguf
- abliterated
license: fair-noncommercial-research-license
---

# Flux-12B Abliterated V2 — GGUF Q4_K_M

A **GGUF Q4_K_M quantization** of [`aoxo/flux.1dev-abliteratedv2`](https://huggingface.co/aoxo/flux.1dev-abliteratedv2), prepared for **local inference with ComfyUI and ComfyUI-GGUF**.

This repository provides a compact quantized version of the Flux.1-dev Abliterated V2 model while preserving the original model's image-generation capabilities as closely as possible.

> **This is a quantized conversion, not the original model.**
> Please refer to the original repository for the source model, license, and full model information.

---

## ✨ Model

**Base model:** [`aoxo/flux.1dev-abliteratedv2`](https://huggingface.co/aoxo/flux.1dev-abliteratedv2)

**Architecture:** FLUX.1-dev / 12B

**Format:** GGUF

**Quantization:** `Q4_K_M`

**Task:** Text-to-Image

**Recommended environment:** ComfyUI + ComfyUI-GGUF

---

## 🚀 Why GGUF?

GGUF provides a convenient way to run large models locally with reduced memory requirements.

The `Q4_K_M` quantization provides a strong balance between:

* 🧠 Model quality
* 💾 File size
* ⚡ Inference performance
* 🖥️ VRAM requirements

GGUF is supported by a growing ecosystem of local inference tools and includes model metadata directly inside the file.

---

# 🖥️ ComfyUI

This model is intended primarily for use with **ComfyUI** through **ComfyUI-GGUF**.

### Requirements

* ComfyUI
* ComfyUI-GGUF
* A compatible Flux workflow
* Sufficient system RAM / VRAM for Flux inference

### Installation

1. Install **ComfyUI**.
2. Install the **ComfyUI-GGUF** custom node.
3. Download the `.gguf` file from the **Files and versions** section of this repository.
4. Place the GGUF model in the appropriate model directory used by your ComfyUI-GGUF setup.
5. Load a Flux workflow that supports GGUF models.
6. Select the downloaded `Q4_K_M` model.

> The exact folder may depend on your ComfyUI-GGUF configuration and workflow.

---

# 📦 Quantization

This repository currently provides:

| Quantization | Format |
| ------------ | ------ |
| **Q4_K_M**   | GGUF   |

`Q4_K_M` is a 4-bit K-quantization variant designed to provide a useful compromise between model size and quality. Hugging Face documents Q4_K as a 4-bit quantization family, with K-quant variants designed around block/super-block quantization.

---

# 🎨 Usage

The model is designed for local image generation.

A typical workflow is:

```text
Prompt
   ↓
Flux Text Encoder
   ↓
Flux GGUF Q4_K_M
   ↓
Sampler
   ↓
VAE
   ↓
Generated Image
```

Use your preferred Flux.1-dev workflow and replace the transformer/model component with the GGUF version where supported.

---

# ⚙️ Performance

Actual performance depends heavily on:

* GPU model
* Available VRAM
* System RAM
* ComfyUI configuration
* Resolution
* Number of sampling steps
* CPU/GPU offloading
* Flux workflow

Because of this, VRAM and generation-speed figures are intentionally not specified here unless they have been measured on a particular hardware configuration.

---

# 🧪 Model Status

This is an **unofficial GGUF conversion** of the original abliterated Flux model.

The goal of this release is to make the model more accessible to users who want to run it locally with a smaller memory footprint.

If you encounter:

* corrupted output,
* loading errors,
* unexpected artifacts,
* incorrect tensor loading,
* or other compatibility problems,

please open an issue or leave feedback on the repository.

---

# 📜 Credits

### Original model

**aoxo/flux.1dev-abliteratedv2**

https://huggingface.co/aoxo/flux.1dev-abliteratedv2

All credit for the original model and its underlying work belongs to the original authors.

### GGUF conversion

**anlord**

This repository contains the GGUF quantized conversion published by **anlord**.

---

# ⚠️ License

The original model is distributed under:

**Fair Noncommercial Research License**

Please read and comply with the original model's license before downloading, using, modifying, or redistributing this model.

The license of the original model takes precedence over any assumptions made from this README.

---

# ⭐ Feedback

If this model is useful to you, consider leaving a ⭐ on the repository.

Feedback, generation examples, bug reports, and suggestions for additional quantizations are welcome.

---

## 🔗 Links

* **This GGUF:** https://huggingface.co/anlord/Flux-12B-abliterated-V2-GGUF
* **Original model:** https://huggingface.co/aoxo/flux.1dev-abliteratedv2
* **Hugging Face GGUF documentation:** https://huggingface.co/docs/hub/gguf

---

### About this release

**Flux-12B Abliterated V2 — GGUF Q4_K_M**

A community GGUF quantization prepared by **anlord** for convenient local inference.