Hugging Face's logo

N26134293
/
Qwen3-8B-unsloth-q4_k_m-gguf_2025-08-07

Transformers
GGUF
English
qwen3
text-generation-inference
unsloth
Model card Files
xet
 Community
How to use from the
Use from the
Transformers library
# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("N26134293/Qwen3-8B-unsloth-q4_k_m-gguf_2025-08-07", dtype="auto")
Quick Links

Uploaded model

  • Developed by: N26134293
  • License: apache-2.0
  • Finetuned from model : unsloth/Qwen3-8B-unsloth-bnb-4bit

This qwen3 model was trained 2x faster with Unsloth and Huggingface's TRL library.

Downloads last month
40
GGUF
Hardware compatibility
Log In to add your hardware

4-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for N26134293/Qwen3-8B-unsloth-q4_k_m-gguf_2025-08-07

Base model

Qwen/Qwen3-8B-Base
Finetuned
Qwen/Qwen3-8B
Quantized
unsloth/Qwen3-8B-unsloth-bnb-4bit
Quantized
(51)
this model