matatonic
/

r1-1776-distill-llama-70b-abliterated-6.5bpw-h8-exl2

Model card Files Files and versions

Can you train this model for 4.5bpw quantization?

#1

by xldistance - opened Mar 2, 2025

Can you train this model for 4.5bpw quantization?

Owner Mar 2, 2025

@xldistance done.
https://huggingface.co/matatonic/r1-1776-distill-llama-70b-abliterated-4.5bpw-exl2

matatonic changed discussion status to closed Mar 2, 2025

Thank you so much.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment