turboderp
/

Hy3-exl3

Model card Files Files and versions

EXL3 quants of Hy3

⚠️ Needs ExLlamav3 v1.1.0 or later

2.52 bits per weight
3.05 bits per weight

(More bitrates, benchmarks etc. to follow, probably)

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for turboderp/Hy3-exl3

Base model

Quantized

(61)

this model

Collection including turboderp/Hy3-exl3

EXL3 models

63 items • Updated 2 days ago • 61