Qwen3.8-27B-NQ-SVD-IQ2

⚠️ EXPERIMENTAL REPOSITORY — the model is NOT ready yet and is under active development.

Quantization of Qwen3.8-27B using SVD low-rank factorization with quantized factors, produced with NeuralQuant (NQ).

NQ — NeuralQuant (our quantizer engine)
SVD — low-rank factorization of Linear weights: W ≈ A·B + E (all factors are quantized: A → IQ2/IQ3, B → IQ2, residual E → IQ1/ternary)
IQ2 — 2-bit IQ codebooks for the low-rank factors

Current status: the SVD support in the NeuralQuant library is being implemented. Model weights will be published once the model is validated.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for agiws/Qwen3.8-27B-NQ-SVD-IQ2

Base model

Finetuned

(263)

this model