nvfp4 and fp8 quantization for "qwen3.5 9b"
#9
by makisekurisu-jp - opened
there are quantized models just search, download and run it, easiest way is to install Confyui-ollama nodes
I had trouble getting some nvfp4 to work with the built in nodes but not sure why.
This comment has been hidden (marked as Resolved)
makisekurisu-jp changed discussion title from Request to add nvfp4 and fp8 quantization for the model. to nvfp4 and fp8 quantization for qwen3.5
makisekurisu-jp changed discussion title from nvfp4 and fp8 quantization for qwen3.5 to nvfp4 and fp8 quantization for "qwen3.5"
makisekurisu-jp changed discussion title from nvfp4 and fp8 quantization for "qwen3.5" to nvfp4 and fp8 quantization for "qwen3.5 9b"