Laguna-S-2.1-NVFP4-GGUF model
#1
by lirex - opened
Can we get a Laguna-S-2.1-NVFP4-GGUF version, please? vLLM is great and all but running the NVFP4 gguf version in llama.cpp will be something that a lot of people will appreciate.
There are already plenty of other NVFP4 models converted to gguf and llama.cpp people are really enjoying it. Please do it for this great model as well.
Hi! We're actually already packaging it up: it just slipped under the radar with the other 16 checkpoints we put out today :) It should be ready tomorrow.
Great news! 🥳 Thank you for the great model and the hard work behind it!