anlord commited on
Commit
f3374ad
Β·
verified Β·
1 Parent(s): cbde184

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +177 -26
README.md CHANGED
@@ -1,26 +1,29 @@
1
  ---
2
- license: fair-noncommercial-research-license
3
- base_model: aoxo/flux.1dev-abliteratedv2
4
  library_name: gguf
 
5
  tags:
6
- - flux
7
- - flux.1-dev
8
- - gguf
9
- - quantized
10
- - image-generation
11
- - text-to-image
12
- - comfyui
13
- - comfyui-gguf
14
- - abliterated
 
15
  ---
16
 
17
- # FLUX.1-dev Abliterated V2 β€” Q4_K_M GGUF
18
 
19
- > **A GGUF Q4_K_M quantization of [aoxo/flux.1dev-abliteratedv2](https://huggingface.co/aoxo/flux.1dev-abliteratedv2), optimized for local inference with limited VRAM.**
20
 
21
- This repository provides a **Q4_K_M GGUF** version of the FLUX.1-dev Abliterated V2 model.
22
 
23
- The goal of this quantization is to make the model significantly more accessible on consumer hardware while retaining the overall capabilities and characteristics of the original model.
 
24
 
25
  ---
26
 
@@ -28,28 +31,176 @@ The goal of this quantization is to make the model significantly more accessible
28
 
29
  **Base model:** [`aoxo/flux.1dev-abliteratedv2`](https://huggingface.co/aoxo/flux.1dev-abliteratedv2)
30
 
31
- **Original architecture:** FLUX.1-dev
 
 
32
 
33
  **Quantization:** `Q4_K_M`
34
 
35
- **Format:** `GGUF`
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
36
 
37
- **Intended use:** Local image generation / text-to-image
38
 
39
- **Primary frontend:** ComfyUI + ComfyUI-GGUF
 
 
 
 
 
 
 
40
 
41
  ---
42
 
43
- ## πŸ“¦ File
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
44
 
45
- | File | Quantization | Format |
46
- |---|---|---|
47
- | `flux-abliterated-v2-Q4_K_M.gguf` | Q4_K_M | GGUF |
 
 
 
 
 
 
 
 
 
 
48
 
49
- The Q4_K_M quantization is intended to provide a practical balance between **model size, memory usage and generation quality**.
50
 
51
  ---
52
 
53
- # πŸš€ ComfyUI
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
54
 
55
- This model is designed to work with **[ComfyUI](https://github.com/comfyanonymous/ComfyUI)** using **[ComfyUI-GGUF](https://github.com/city96/ComfyUI-GGUF)**.
 
1
  ---
2
+ base_model:
3
+ - aoxo/flux.1dev-abliteratedv2
4
  library_name: gguf
5
+ pipeline_tag: text-to-image
6
  tags:
7
+ - gguf
8
+ - flux
9
+ - flux.1-dev
10
+ - quantized
11
+ - image-generation
12
+ - text-to-image
13
+ - comfyui
14
+ - comfyui-gguf
15
+ - abliterated
16
+ license: fair-noncommercial-research-license
17
  ---
18
 
19
+ # Flux-12B Abliterated V2 β€” GGUF Q4_K_M
20
 
21
+ A **GGUF Q4_K_M quantization** of [`aoxo/flux.1dev-abliteratedv2`](https://huggingface.co/aoxo/flux.1dev-abliteratedv2), prepared for **local inference with ComfyUI and ComfyUI-GGUF**.
22
 
23
+ This repository provides a compact quantized version of the Flux.1-dev Abliterated V2 model while preserving the original model's image-generation capabilities as closely as possible.
24
 
25
+ > **This is a quantized conversion, not the original model.**
26
+ > Please refer to the original repository for the source model, license, and full model information.
27
 
28
  ---
29
 
 
31
 
32
  **Base model:** [`aoxo/flux.1dev-abliteratedv2`](https://huggingface.co/aoxo/flux.1dev-abliteratedv2)
33
 
34
+ **Architecture:** FLUX.1-dev / 12B
35
+
36
+ **Format:** GGUF
37
 
38
  **Quantization:** `Q4_K_M`
39
 
40
+ **Task:** Text-to-Image
41
+
42
+ **Recommended environment:** ComfyUI + ComfyUI-GGUF
43
+
44
+ ---
45
+
46
+ ## πŸš€ Why GGUF?
47
+
48
+ GGUF provides a convenient way to run large models locally with reduced memory requirements.
49
+
50
+ The `Q4_K_M` quantization provides a strong balance between:
51
+
52
+ * 🧠 Model quality
53
+ * πŸ’Ύ File size
54
+ * ⚑ Inference performance
55
+ * πŸ–₯️ VRAM requirements
56
+
57
+ GGUF is supported by a growing ecosystem of local inference tools and includes model metadata directly inside the file.
58
+
59
+ ---
60
+
61
+ # πŸ–₯️ ComfyUI
62
+
63
+ This model is intended primarily for use with **ComfyUI** through **ComfyUI-GGUF**.
64
+
65
+ ### Requirements
66
+
67
+ * ComfyUI
68
+ * ComfyUI-GGUF
69
+ * A compatible Flux workflow
70
+ * Sufficient system RAM / VRAM for Flux inference
71
 
72
+ ### Installation
73
 
74
+ 1. Install **ComfyUI**.
75
+ 2. Install the **ComfyUI-GGUF** custom node.
76
+ 3. Download the `.gguf` file from the **Files and versions** section of this repository.
77
+ 4. Place the GGUF model in the appropriate model directory used by your ComfyUI-GGUF setup.
78
+ 5. Load a Flux workflow that supports GGUF models.
79
+ 6. Select the downloaded `Q4_K_M` model.
80
+
81
+ > The exact folder may depend on your ComfyUI-GGUF configuration and workflow.
82
 
83
  ---
84
 
85
+ # πŸ“¦ Quantization
86
+
87
+ This repository currently provides:
88
+
89
+ | Quantization | Format |
90
+ | ------------ | ------ |
91
+ | **Q4_K_M** | GGUF |
92
+
93
+ `Q4_K_M` is a 4-bit K-quantization variant designed to provide a useful compromise between model size and quality. Hugging Face documents Q4_K as a 4-bit quantization family, with K-quant variants designed around block/super-block quantization.
94
+
95
+ ---
96
+
97
+ # 🎨 Usage
98
+
99
+ The model is designed for local image generation.
100
+
101
+ A typical workflow is:
102
 
103
+ ```text
104
+ Prompt
105
+ ↓
106
+ Flux Text Encoder
107
+ ↓
108
+ Flux GGUF Q4_K_M
109
+ ↓
110
+ Sampler
111
+ ↓
112
+ VAE
113
+ ↓
114
+ Generated Image
115
+ ```
116
 
117
+ Use your preferred Flux.1-dev workflow and replace the transformer/model component with the GGUF version where supported.
118
 
119
  ---
120
 
121
+ # βš™οΈ Performance
122
+
123
+ Actual performance depends heavily on:
124
+
125
+ * GPU model
126
+ * Available VRAM
127
+ * System RAM
128
+ * ComfyUI configuration
129
+ * Resolution
130
+ * Number of sampling steps
131
+ * CPU/GPU offloading
132
+ * Flux workflow
133
+
134
+ Because of this, VRAM and generation-speed figures are intentionally not specified here unless they have been measured on a particular hardware configuration.
135
+
136
+ ---
137
+
138
+ # πŸ§ͺ Model Status
139
+
140
+ This is an **unofficial GGUF conversion** of the original abliterated Flux model.
141
+
142
+ The goal of this release is to make the model more accessible to users who want to run it locally with a smaller memory footprint.
143
+
144
+ If you encounter:
145
+
146
+ * corrupted output,
147
+ * loading errors,
148
+ * unexpected artifacts,
149
+ * incorrect tensor loading,
150
+ * or other compatibility problems,
151
+
152
+ please open an issue or leave feedback on the repository.
153
+
154
+ ---
155
+
156
+ # πŸ“œ Credits
157
+
158
+ ### Original model
159
+
160
+ **aoxo/flux.1dev-abliteratedv2**
161
+
162
+ https://huggingface.co/aoxo/flux.1dev-abliteratedv2
163
+
164
+ All credit for the original model and its underlying work belongs to the original authors.
165
+
166
+ ### GGUF conversion
167
+
168
+ **anlord**
169
+
170
+ This repository contains the GGUF quantized conversion published by **anlord**.
171
+
172
+ ---
173
+
174
+ # ⚠️ License
175
+
176
+ The original model is distributed under:
177
+
178
+ **Fair Noncommercial Research License**
179
+
180
+ Please read and comply with the original model's license before downloading, using, modifying, or redistributing this model.
181
+
182
+ The license of the original model takes precedence over any assumptions made from this README.
183
+
184
+ ---
185
+
186
+ # ⭐ Feedback
187
+
188
+ If this model is useful to you, consider leaving a ⭐ on the repository.
189
+
190
+ Feedback, generation examples, bug reports, and suggestions for additional quantizations are welcome.
191
+
192
+ ---
193
+
194
+ ## πŸ”— Links
195
+
196
+ * **This GGUF:** https://huggingface.co/anlord/Flux-12B-abliterated-V2-GGUF
197
+ * **Original model:** https://huggingface.co/aoxo/flux.1dev-abliteratedv2
198
+ * **Hugging Face GGUF documentation:** https://huggingface.co/docs/hub/gguf
199
+
200
+ ---
201
+
202
+ ### About this release
203
+
204
+ **Flux-12B Abliterated V2 β€” GGUF Q4_K_M**
205
 
206
+ A community GGUF quantization prepared by **anlord** for convenient local inference.