You have to use the backend from HimariO's branch. Big thanks to add Qwen2.5VL support! Additional discussions
'Make knowledge free for everyone'
Quantized version of: Qwen/Qwen2.5-VL-7B-Instruct
![]()
- Downloads last month
- 349
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
32-bit
Model tree for DevQuasar-6/Qwen.Qwen2.5-VL-7B-Instruct-GGUF
Base model
Qwen/Qwen2.5-VL-7B-Instruct