Hugging Face's logo

turboderp
/
LFM2.5-8B-A1B-exl3

exl3
Model card Files
xet
 Community
1
turboderp commited on
Commit
1bbd464
·
verified ·
1 Parent(s): 34a0955

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -13
README.md CHANGED
@@ -1,24 +1,25 @@
1
  ---
2
  license: other
3
- license_name: lfm1.0
4
- base_model: LiquidAI/LFM2.5-8B-A1B
5
  base_model_relation: quantized
6
  quantized_by: turboderp
7
  tags:
8
  - exl3
9
  ---
10
 
11
- EXL3 quants of [LFM2.5-8B-A1B](https://huggingface.co/LiquidAI/LFM2.5-8B-A1B)
12
 
13
- ⚠️ Requires ExLlamaV3 v0.0.38 (or v0.0.37 `dev` branch)
14
 
15
- [2.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/2.10bpw)
16
- [2.53 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/2.53bpw)
17
- [3.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/3.10bpw)
18
- [3.53 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/3.53bpw)
19
- [4.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/4.10bpw)
20
- [5.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/5.10bpw)
21
- [6.10 bits per weight](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/6.10bpw)
22
- [8.00 bits per weight / H8](https://huggingface.co/turboderp/LFM2.5-8B-A1B-exl3/tree/8.00bpw)
 
23
 
24
- ![kld](https://cdn-uploads.huggingface.co/production/uploads/6383dc174c48969dcf1b4fce/9Z1SmECRZVHY_rJ0YNmzV.png)
 
1
  ---
2
  license: other
3
+ license_name: apache-2.0
4
+ base_model: google/gemma-4-12B-it
5
  base_model_relation: quantized
6
  quantized_by: turboderp
7
  tags:
8
  - exl3
9
  ---
10
 
11
+ EXL3 quants of [gemma-4-12B-it](https://huggingface.co/google/gemma-4-12B-it)
12
 
13
+ ⚠️ Requires ExLlamaV3 v0.0.40 (or v0.0.39 `dev` branch)
14
 
15
+ [2.00 bits per weight](https://huggingface.co/turboderp/gemma-4-12B-it-exl3/tree/2.00bpw)
16
+ [2.50 bits per weight](https://huggingface.co/turboderp/gemma-4-12B-it-exl3/tree/2.50bpw)
17
+ [3.00 bits per weight](https://huggingface.co/turboderp/gemma-4-12B-it-exl3/tree/3.00bpw)
18
+ [3.50 bits per weight](https://huggingface.co/turboderp/gemma-4-12B-it-exl3/tree/3.50bpw)
19
+ [4.00 bits per weight](https://huggingface.co/turboderp/gemma-4-12B-it-exl3/tree/4.00bpw)
20
+ [4.50 bits per weight](https://huggingface.co/turboderp/gemma-4-12B-it-exl3/tree/4.50bpw)
21
+ [5.00 bits per weight](https://huggingface.co/turboderp/gemma-4-12B-it-exl3/tree/5.00bpw)
22
+ [6.00 bits per weight](https://huggingface.co/turboderp/gemma-4-12B-it-exl3/tree/6.00bpw)
23
+ [8.00 bits per weight / H8](https://huggingface.co/turboderp/gemma-4-12B-it-exl3/tree/8.00bpw)
24
 
25
+ ![kld](https://cdn-uploads.huggingface.co/production/uploads/6383dc174c48969dcf1b4fce/CUFAIHEIVya3GOyS6iSpg.png)