Sandbo Chang
Sandbo
AI & ML interests
None yet
Organizations
None yet
Request: 4-bit GPTQ or AWQ quantized version of openai/gpt-oss-20b
πβ€οΈ 19
13
#32 opened about 1 year ago
by
powtac
This quant is giving gibberish result in vLLM
4
#1 opened about 1 year ago
by
Sandbo
Would there by bnb version for the UD quants?
2
#5 opened about 1 year ago
by
Sandbo
I get errors trying to deploy this in vllm or sglang.
ππ 7
3
#1 opened over 1 year ago
by
chriswritescode