brunopio
/

Qwen2.5-0.5B-Instruct-nbits4-GS64-Axis1-HQQ-T

8-bit precision

Model card Files Files and versions

Use the latest transformers for this model.

Downloads last month: 3

Safetensors

Model size

0.3B params

Tensor type

I64

·

F16

·

U8

·

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for brunopio/Qwen2.5-0.5B-Instruct-nbits4-GS64-Axis1-HQQ-T

Base model

Qwen/Qwen2.5-0.5B

Finetuned

Qwen/Qwen2.5-0.5B-Instruct

Quantized

(222)

this model