Hugging Face's logo

turboderp
/
gpt-oss-120b-exl3

exl3
Model card Files
xet
 Community
turboderp commited on
Commit
95d6502
·
verified ·
1 Parent(s): d75e11c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +3 -3
README.md CHANGED
@@ -9,12 +9,12 @@ tags:
9
 
10
  EXL3 quants of [gpt-oss-120b](https://huggingface.co/openai/gpt-oss-120b)
11
 
12
- ⚠️ Requires exllamav3 v1.0.0
13
-
14
  [2.00 bits per weight](https://huggingface.co/turboderp/gpt-oss-120b-exl3/tree/2.00bpw)
15
  [2.50 bits per weight](https://huggingface.co/turboderp/gpt-oss-120b-exl3/tree/2.50bpw)
16
  [3.00 bits per weight](https://huggingface.co/turboderp/gpt-oss-120b-exl3/tree/3.00bpw)
17
  [3.50 bits per weight](https://huggingface.co/turboderp/gpt-oss-120b-exl3/tree/3.50bpw)
18
  [4.00 bits per weight](https://huggingface.co/turboderp/gpt-oss-120b-exl3/tree/4.00bpw)
19
 
20
-
 
 
 
9
 
10
  EXL3 quants of [gpt-oss-120b](https://huggingface.co/openai/gpt-oss-120b)
11
 
 
 
12
  [2.00 bits per weight](https://huggingface.co/turboderp/gpt-oss-120b-exl3/tree/2.00bpw)
13
  [2.50 bits per weight](https://huggingface.co/turboderp/gpt-oss-120b-exl3/tree/2.50bpw)
14
  [3.00 bits per weight](https://huggingface.co/turboderp/gpt-oss-120b-exl3/tree/3.00bpw)
15
  [3.50 bits per weight](https://huggingface.co/turboderp/gpt-oss-120b-exl3/tree/3.50bpw)
16
  [4.00 bits per weight](https://huggingface.co/turboderp/gpt-oss-120b-exl3/tree/4.00bpw)
17
 
18
+ ![qb_ppl_vram](https://cdn-uploads.huggingface.co/production/uploads/6383dc174c48969dcf1b4fce/OFydAZ6IYyi3y-k-qybAo.png)
19
+ ![qb_kld_spread_vram](https://cdn-uploads.huggingface.co/production/uploads/6383dc174c48969dcf1b4fce/YdElcQ4UpSqcgh3lz4XWo.png)
20
+ ![qb_kld_hist_combined](https://cdn-uploads.huggingface.co/production/uploads/6383dc174c48969dcf1b4fce/b6d2us43Z67c5dY2Wkhup.png)