?V?I?B?E?T?H?I?N?K?E?R?3B?

#2573
by usermma - opened

WeiboAI/VibeThinker-3B
WeiboAI/VibeThinker-3B
WeiboAI/VibeThinker-3B

DONE!! usermma/VibeThinker-3B-GGUF

https://huggingface.co/usermma/VibeThinker-3B-GGUF

faster than mradermacher !!

yeah, but it's not mradermacher quality =)

didnt do queue today... all day noone and then a bunch of people at the same time, I will be free soon to queue

i dont know from where do i get the quality , i did do Q8,F32,BF16 from convert.py without llama-quantize command...

without getting the F16 and from it doing the F32,Q8,BF16 - It’s like trying to shove a mattress into a filing cabinet—not happening.

It's queued!

You can check for progress at http://hf.tst.eu/status.html or regularly check the model
summary page at https://hf.tst.eu/model#VibeThinker-3B-GGUF for quants to appear.

Sign up or log in to comment