My guide for deployment
See readme.md in https://github.com/KimRasak/Qwopus3.5-27B-v3-deployment
Kindly press "like" if you think it's useful.
Thx for this deployment recipe pointing out different tool parser needed
Thx for this deployment recipe pointing out different tool parser needed
Hi there, have you tried deploying the qwopus3.5-27b-v3 model using Docker with the vLLM image? Looking forward to your sharing.
Thx for this deployment recipe pointing out different tool parser needed
Hi there, have you tried deploying the qwopus3.5-27b-v3 model using Docker with the vLLM image? Looking forward to your sharing.
I posted https://www.reddit.com/r/Vllm/comments/1skks8n/qwen_35_27b35ba3b_tool_calling_issues_why_it/, it discuss all of my work on deployment so far and will help u in deployment as well.
If u need to deploy with docker, use the latest vllm image that installed transformers >=5 (it is also required by gamma 4). Recent vllm (v0.19.0) still restrict to use transformer 4.59 that wornt support partial RoPE implementation that qwen3.5 needs.
Thx for this deployment recipe pointing out different tool parser needed
Hi there, have you tried deploying the qwopus3.5-27b-v3 model using Docker with the vLLM image? Looking forward to your sharing.
you can seve it with image vllm/vllm-openai:gemma4 confirmed.