Hugging Face's logo

Atomic-Germ
/
Qwen2.5-3B-Fable-Agent-Heretic-NPU2

Text Generation
English
qwen2
qwen2.5
agentic
heretic
uncensored
fastflowlm
q4nx
npu
conversational
Model card Files
xet
 Community
Atomic-Germ mradermacher commited on
Commit
5378a1a
·
0 Parent(s):

Duplicate from mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF

Browse files

Co-authored-by: team mradermacher <mradermacher@users.noreply.huggingface.co>

Files changed (27) hide show
  1. .gitattributes +60 -0
  2. README.md +95 -0
  3. fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ1_M.gguf +3 -0
  4. fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ1_S.gguf +3 -0
  5. fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_M.gguf +3 -0
  6. fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_S.gguf +3 -0
  7. fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_XS.gguf +3 -0
  8. fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_XXS.gguf +3 -0
  9. fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_M.gguf +3 -0
  10. fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_S.gguf +3 -0
  11. fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_XS.gguf +3 -0
  12. fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_XXS.gguf +3 -0
  13. fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ4_NL.gguf +3 -0
  14. fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ4_XS.gguf +3 -0
  15. fable-qwen2.5-3b-agentic-merged-heretic.i1-Q2_K.gguf +3 -0
  16. fable-qwen2.5-3b-agentic-merged-heretic.i1-Q2_K_S.gguf +3 -0
  17. fable-qwen2.5-3b-agentic-merged-heretic.i1-Q3_K_L.gguf +3 -0
  18. fable-qwen2.5-3b-agentic-merged-heretic.i1-Q3_K_M.gguf +3 -0
  19. fable-qwen2.5-3b-agentic-merged-heretic.i1-Q3_K_S.gguf +3 -0
  20. fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_0.gguf +3 -0
  21. fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_1.gguf +3 -0
  22. fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_K_M.gguf +3 -0
  23. fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_K_S.gguf +3 -0
  24. fable-qwen2.5-3b-agentic-merged-heretic.i1-Q5_K_M.gguf +3 -0
  25. fable-qwen2.5-3b-agentic-merged-heretic.i1-Q5_K_S.gguf +3 -0
  26. fable-qwen2.5-3b-agentic-merged-heretic.i1-Q6_K.gguf +3 -0
  27. fable-qwen2.5-3b-agentic-merged-heretic.imatrix.gguf +3 -0
.gitattributes ADDED
@@ -0,0 +1,60 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ *.7z filter=lfs diff=lfs merge=lfs -text
2
+ *.arrow filter=lfs diff=lfs merge=lfs -text
3
+ *.bin filter=lfs diff=lfs merge=lfs -text
4
+ *.bz2 filter=lfs diff=lfs merge=lfs -text
5
+ *.ckpt filter=lfs diff=lfs merge=lfs -text
6
+ *.ftz filter=lfs diff=lfs merge=lfs -text
7
+ *.gz filter=lfs diff=lfs merge=lfs -text
8
+ *.h5 filter=lfs diff=lfs merge=lfs -text
9
+ *.joblib filter=lfs diff=lfs merge=lfs -text
10
+ *.lfs.* filter=lfs diff=lfs merge=lfs -text
11
+ *.mlmodel filter=lfs diff=lfs merge=lfs -text
12
+ *.model filter=lfs diff=lfs merge=lfs -text
13
+ *.msgpack filter=lfs diff=lfs merge=lfs -text
14
+ *.npy filter=lfs diff=lfs merge=lfs -text
15
+ *.npz filter=lfs diff=lfs merge=lfs -text
16
+ *.onnx filter=lfs diff=lfs merge=lfs -text
17
+ *.ot filter=lfs diff=lfs merge=lfs -text
18
+ *.parquet filter=lfs diff=lfs merge=lfs -text
19
+ *.pb filter=lfs diff=lfs merge=lfs -text
20
+ *.pickle filter=lfs diff=lfs merge=lfs -text
21
+ *.pkl filter=lfs diff=lfs merge=lfs -text
22
+ *.pt filter=lfs diff=lfs merge=lfs -text
23
+ *.pth filter=lfs diff=lfs merge=lfs -text
24
+ *.rar filter=lfs diff=lfs merge=lfs -text
25
+ *.safetensors filter=lfs diff=lfs merge=lfs -text
26
+ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
27
+ *.tar.* filter=lfs diff=lfs merge=lfs -text
28
+ *.tar filter=lfs diff=lfs merge=lfs -text
29
+ *.tflite filter=lfs diff=lfs merge=lfs -text
30
+ *.tgz filter=lfs diff=lfs merge=lfs -text
31
+ *.wasm filter=lfs diff=lfs merge=lfs -text
32
+ *.xz filter=lfs diff=lfs merge=lfs -text
33
+ *.zip filter=lfs diff=lfs merge=lfs -text
34
+ *.zst filter=lfs diff=lfs merge=lfs -text
35
+ *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ fable-qwen2.5-3b-agentic-merged-heretic.imatrix.gguf filter=lfs diff=lfs merge=lfs -text
37
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ1_M.gguf filter=lfs diff=lfs merge=lfs -text
38
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ1_S.gguf filter=lfs diff=lfs merge=lfs -text
39
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_M.gguf filter=lfs diff=lfs merge=lfs -text
40
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_S.gguf filter=lfs diff=lfs merge=lfs -text
41
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_XXS.gguf filter=lfs diff=lfs merge=lfs -text
43
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_M.gguf filter=lfs diff=lfs merge=lfs -text
44
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_S.gguf filter=lfs diff=lfs merge=lfs -text
45
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
46
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_XXS.gguf filter=lfs diff=lfs merge=lfs -text
47
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ4_NL.gguf filter=lfs diff=lfs merge=lfs -text
48
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
49
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
50
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-Q2_K_S.gguf filter=lfs diff=lfs merge=lfs -text
51
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
52
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
53
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
54
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_0.gguf filter=lfs diff=lfs merge=lfs -text
55
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_1.gguf filter=lfs diff=lfs merge=lfs -text
56
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
57
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_K_S.gguf filter=lfs diff=lfs merge=lfs -text
58
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-Q5_K_M.gguf filter=lfs diff=lfs merge=lfs -text
59
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-Q5_K_S.gguf filter=lfs diff=lfs merge=lfs -text
60
+ fable-qwen2.5-3b-agentic-merged-heretic.i1-Q6_K.gguf filter=lfs diff=lfs merge=lfs -text
README.md ADDED
@@ -0,0 +1,95 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: richardyoung/fable-qwen2.5-3b-agentic-merged-heretic
3
+ language:
4
+ - en
5
+ library_name: transformers
6
+ license: apache-2.0
7
+ mradermacher:
8
+ readme_rev: 1
9
+ quantized_by: mradermacher
10
+ tags:
11
+ - text-generation-inference
12
+ - transformers
13
+ - unsloth
14
+ - qwen2
15
+ - heretic
16
+ - uncensored
17
+ - decensored
18
+ - abliterated
19
+ - reproducible
20
+ ---
21
+ ## About
22
+
23
+ <!-- ### quantize_version: 2 -->
24
+ <!-- ### output_tensor_quantised: 1 -->
25
+ <!-- ### convert_type: hf -->
26
+ <!-- ### vocab_type: -->
27
+ <!-- ### tags: nicoboss -->
28
+ <!-- ### quants: Q2_K IQ3_M Q4_K_S IQ3_XXS Q3_K_M small-IQ4_NL Q4_K_M IQ2_M Q6_K IQ4_XS Q2_K_S IQ1_M Q3_K_S IQ2_XXS Q3_K_L IQ2_XS Q5_K_S IQ2_S IQ1_S Q5_K_M Q4_0 IQ3_XS Q4_1 IQ3_S -->
29
+ <!-- ### quants_skip: -->
30
+ <!-- ### skip_mmproj: -->
31
+ weighted/imatrix quants of https://huggingface.co/richardyoung/fable-qwen2.5-3b-agentic-merged-heretic
32
+
33
+ <!-- provided-files -->
34
+
35
+ ***For a convenient overview and download list, visit our [model page for this model](https://hf.tst.eu/model#fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF).***
36
+
37
+ static quants are available at https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-GGUF
38
+ ## Usage
39
+
40
+ If you are unsure how to use GGUF files, refer to one of [TheBloke's
41
+ READMEs](https://huggingface.co/TheBloke/KafkaLM-70B-German-V0.1-GGUF) for
42
+ more details, including on how to concatenate multi-part files.
43
+
44
+ ## Provided Quants
45
+
46
+ (sorted by size, not necessarily quality. IQ-quants are often preferable over similar sized non-IQ quants)
47
+
48
+ | Link | Type | Size/GB | Notes |
49
+ |:-----|:-----|--------:|:------|
50
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.imatrix.gguf) | imatrix | 0.1 | imatrix file (for creating your own quants) |
51
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ1_S.gguf) | i1-IQ1_S | 0.9 | for the desperate |
52
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ1_M.gguf) | i1-IQ1_M | 1.0 | mostly desperate |
53
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_XXS.gguf) | i1-IQ2_XXS | 1.0 | |
54
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_XS.gguf) | i1-IQ2_XS | 1.1 | |
55
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_S.gguf) | i1-IQ2_S | 1.2 | |
56
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_M.gguf) | i1-IQ2_M | 1.2 | |
57
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-Q2_K_S.gguf) | i1-Q2_K_S | 1.3 | very low quality |
58
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-Q2_K.gguf) | i1-Q2_K | 1.4 | IQ3_XXS probably better |
59
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_XXS.gguf) | i1-IQ3_XXS | 1.4 | lower quality |
60
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_XS.gguf) | i1-IQ3_XS | 1.5 | |
61
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-Q3_K_S.gguf) | i1-Q3_K_S | 1.6 | IQ3_XS probably better |
62
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_S.gguf) | i1-IQ3_S | 1.6 | beats Q3_K* |
63
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_M.gguf) | i1-IQ3_M | 1.6 | |
64
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-Q3_K_M.gguf) | i1-Q3_K_M | 1.7 | IQ3_S probably better |
65
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-Q3_K_L.gguf) | i1-Q3_K_L | 1.8 | IQ3_M probably better |
66
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ4_XS.gguf) | i1-IQ4_XS | 1.8 | |
67
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ4_NL.gguf) | i1-IQ4_NL | 1.9 | prefer IQ4_XS |
68
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_0.gguf) | i1-Q4_0 | 1.9 | fast, low quality |
69
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_K_S.gguf) | i1-Q4_K_S | 1.9 | optimal size/speed/quality |
70
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_K_M.gguf) | i1-Q4_K_M | 2.0 | fast, recommended |
71
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_1.gguf) | i1-Q4_1 | 2.1 | |
72
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-Q5_K_S.gguf) | i1-Q5_K_S | 2.3 | |
73
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-Q5_K_M.gguf) | i1-Q5_K_M | 2.3 | |
74
+ | [GGUF](https://huggingface.co/mradermacher/fable-qwen2.5-3b-agentic-merged-heretic-i1-GGUF/resolve/main/fable-qwen2.5-3b-agentic-merged-heretic.i1-Q6_K.gguf) | i1-Q6_K | 2.6 | practically like static Q6_K |
75
+
76
+ Here is a handy graph by ikawrakow comparing some lower-quality quant
77
+ types (lower is better):
78
+
79
+ ![image.png](https://www.nethype.de/huggingface_embed/quantpplgraph.png)
80
+
81
+ And here are Artefact2's thoughts on the matter:
82
+ https://gist.github.com/Artefact2/b5f810600771265fc1e39442288e8ec9
83
+
84
+ ## FAQ / Model Request
85
+
86
+ See https://huggingface.co/mradermacher/model_requests for some answers to
87
+ questions you might have and/or if you want some other model quantized.
88
+
89
+ ## Thanks
90
+
91
+ I thank my company, [nethype GmbH](https://www.nethype.de/), for letting
92
+ me use its servers and providing upgrades to my workstation to enable
93
+ this work in my free time. Additional thanks to [@nicoboss](https://huggingface.co/nicoboss) for giving me access to his private supercomputer, enabling me to provide many more imatrix quants, at much higher quality, than I would otherwise be able to.
94
+
95
+ <!-- end -->
fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ1_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fd138ec8670870321ef3b730ff121c1b0c926535311f2abef76d7eabb29a0e47
3
+ size 850028320
fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ1_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:df8cd7fce692fdc9967d9f1883ff1c9c9bcfe6e9aa62a0f97ca2b255176e90a6
3
+ size 791095072
fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:68c3d26b947d1ef07c8dc8d9a6a6f817675f506f8891cc56d456f307de8e71da
3
+ size 1140516640
fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:82ad66d3e46e21f6a7158cf084a28e2e6d0edc753558fac6578e5049ee7b3c64
3
+ size 1061938976
fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:cf4106c6bd3ae34ae920b4cefba2d4a8dc9144eb23d304345a4bfaa8f431220a
3
+ size 1031546656
fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ2_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4b88cd9836eb6f29c5035f874a005e8209c684aa088c65539fd8c7836cca8e3f
3
+ size 948250400
fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b53024ca1d0f88e8641dac3d075d47a5711ca24396630b9101223f6a263a4175
3
+ size 1488895776
fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:46e2c735c8f8caf83bda44c11b68f2ea512ad77f05c09b390f54e3d4debbc6ef
3
+ size 1456865056
fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:121d761a046bbd670600ba029966975d60c4a8a010a13dc45ba18e7d1001a59e
3
+ size 1391836960
fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ3_XXS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b8ab6373d34eb95b2c26427435fd4cdf412ce31f98600f3c7843f5b64d98663
3
+ size 1282828064
fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ4_NL.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f67801880b1efd4a3fe8113a2cc226e19575468d2eedff2db4b0252303dd7cc9
3
+ size 1825210144
fable-qwen2.5-3b-agentic-merged-heretic.i1-IQ4_XS.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:6f74c19510610d095f533f0c7ac033c8d4ef7f8edfc8da80a08ba3078ef93dc7
3
+ size 1739095840
fable-qwen2.5-3b-agentic-merged-heretic.i1-Q2_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:d446619bfd217195032baef03c40fd3c8fc31a3af35538ec88727eea486affe2
3
+ size 1274756896
fable-qwen2.5-3b-agentic-merged-heretic.i1-Q2_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:4ccd0c3e564edc9b5cedb90462ceaca6474be06ec825d1aaa887eb6eb5240e28
3
+ size 1198128928
fable-qwen2.5-3b-agentic-merged-heretic.i1-Q3_K_L.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31e3cab82e663199b88999a7d137f9ddb922e924fa312eb2a45b43747944de79
3
+ size 1707392800
fable-qwen2.5-3b-agentic-merged-heretic.i1-Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3da99cd6fe41a3ccbf4f9005c4b9ab33f8f62a9f13f46287e286c156fd6343de
3
+ size 1590476576
fable-qwen2.5-3b-agentic-merged-heretic.i1-Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5447dc055bf48a6400598882df10d43fd4be6854397a4e2bf9755c88e83fc9ef
3
+ size 1454358304
fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:45ff0925f3adc908bd4e351b2978a9762dd2ce261c1585e55959f1b63f21f841
3
+ size 1828486944
fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_1.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:309cabf20cd376edb1bc1d8275c266489ce7693d596b14bb4bd8391c0fc17143
3
+ size 1996259104
fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:41d1d03e9eacf0ffb87ac426bb94582010e3589efde1851800f00a9a62d8d36b
3
+ size 1929903904
fable-qwen2.5-3b-agentic-merged-heretic.i1-Q4_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a5d363d4d48bb597c9d226c498a737a581d45c4f68c1cb7ee3aaecc51d9ce4b2
3
+ size 1834385184
fable-qwen2.5-3b-agentic-merged-heretic.i1-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:bcbcc0d9d31117feddd3df6fe66c4f02f126e2c2772ede92614445a28c835e49
3
+ size 2224815904
fable-qwen2.5-3b-agentic-merged-heretic.i1-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c9357f9baf02dd8732dec5acea4207b0803c8816af61ef3bf70975f33c6dfbcb
3
+ size 2169667360
fable-qwen2.5-3b-agentic-merged-heretic.i1-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:0b1c4ab2a6ef73456c2fa15f7872fb67289dc5ce547cff2bac3f40eb78eeb42f
3
+ size 2538159904
fable-qwen2.5-3b-agentic-merged-heretic.imatrix.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:5a69b86408106f60960c5fcc30b12b205d39704f74aa814a1786002b3ec7698f
3
+ size 3393408