--- base_model: LiquidAI/LFM2.5-Audio-1.5B base_model_relation: quantized library_name: gguf tags: - gguf - quantized --- # LFM2.5-Audio-1.5B GGUF Highest quality quant - original LiquidAI's GGUFs are FP16, which may degrade quality by clipping values. (Or maybe not, but why risk it?) In this repo: - Base model in BF16, and Q6_K converted from BF16 - Mmproj in BF16 - Vocoder in BF16 - TTS tokenizer in BF16 and F32 (original tensors are F32) - Combined vocoder+tokenizer in BF16 Base and mmproj converted using base llama.cpp, tokenizer and vocoder converted using the script from https://github.com/ggml-org/llama.cpp/pull/18641 Text and ASR inference works in baseline llama.cpp. For TTS, use their fork.