Hugging Face's logo

turboderp
/
LFM2.5-8B-A1B-exl3

exl3
Model card Files
xet
 Community
1
turboderp commited on
Commit
0343e3e
·
verified ·
1 Parent(s): 1da79aa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -10,7 +10,16 @@ tags:
10
 
11
  EXL3 quants of [LFM2.5-8B-A1B](https://huggingface.co/LiquidAI/LFM2.5-8B-A1B)
12
 
13
- ⚠️ Requires ExLlamaV3 v0.0.38 (or v0.0.37 `dev` branch)
 
 
 
 
 
 
 
 
 
14
 
15
  [2.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/2.10bpw)
16
  [2.53 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/2.53bpw)
 
10
 
11
  EXL3 quants of [LFM2.5-8B-A1B](https://huggingface.co/LiquidAI/LFM2.5-8B-A1B)
12
 
13
+ **mul1 quants**
14
+
15
+ [2.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/2.10bpw_mul1)
16
+ [3.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/3.10bpw_mul1)
17
+ [4.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/4.10bpw_mul1)
18
+ [5.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/5.10bpw_mul1)
19
+ [6.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/6.10bpw_mul1)
20
+ [8.00 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/8.00bpw_mul1)
21
+
22
+ **Legacy (mcg) quants:**
23
 
24
  [2.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/2.10bpw)
25
  [2.53 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/2.53bpw)