Instructions to use xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)# Load model directly from transformers import AutoProcessor, AutoModelForMultimodalLM processor = AutoProcessor.from_pretrained("xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud") model = AutoModelForMultimodalLM.from_pretrained("xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud", device_map="auto") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- vLLM
How to use xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker
docker model run hf.co/xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud
- SGLang
How to use xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud", "messages": [ { "role": "user", "content": [ { "type": "text", "text": "Describe this image in one sentence." }, { "type": "image_url", "image_url": { "url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg" } } ] } ] }' - Docker Model Runner
How to use xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud with Docker Model Runner:
docker model run hf.co/xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud
# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM
processor = AutoProcessor.from_pretrained("xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud")
model = AutoModelForMultimodalLM.from_pretrained("xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud", device_map="auto")
messages = [
{
"role": "user",
"content": [
{"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
{"type": "text", "text": "What animal is on the candy?"}
]
},
]
inputs = processor.apply_chat_template(
messages,
add_generation_prompt=True,
tokenize=True,
return_dict=True,
return_tensors="pt",
).to(model.device)
outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))Qwen3-VL-32B-Abliterated-xCloud
繁體中文 | English below
由 xCloudinfo 以 Qwen/Qwen3-VL-32B-Instruct 為基礎, 移除其過度拒絕(over-refusal)傾向後的多模態視覺語言模型。公開釋出供社群測試與研究。
- 方法:方向消融(directional ablation / abliteration),非重新訓練。依 Arditi et al. (2024),
將「拒絕方向」從殘差寫入矩陣(
self_attn.o_proj、mlp.down_proj,第 50–63 層,共 28 個矩陣)正交化移除,強度 1.0。 - 方向以繁體中文提示對萃取:實測若用英文提示萃取,正交化後會摧毀繁中輸出(繁體 5/8 → 0/8);改用繁中提示對後保住繁中能力。
- 視覺能力沿用原模型(Qwen3-VL 的圖像/影片理解、OCR、視覺 agent 等)。
- 授權:Apache-2.0(沿用 base)。
Responsible use
This model has had its safety-alignment refusal behaviour removed and may respond directly to sensitive or dual-use requests. It is released for community testing and research only. Users are solely responsible for lawful, compliant, and ethical use. xCloudinfo assumes no responsibility for outputs or downstream use.
Qwen3-VL-32B-Abliterated-xCloud — English
An abliterated (reduced over-refusal) multimodal vision-language model produced by xCloudinfo from Qwen/Qwen3-VL-32B-Instruct, released for community testing.
- Method: directional ablation (not retraining). Following Arditi et al. (2024), the refusal direction is
orthogonalized out of residual-writing matrices (
self_attn.o_proj,mlp.down_proj, layers 50–63; 28 tensors), strength 1.0. - The refusal direction was extracted using Traditional-Chinese prompt pairs; extracting with English prompts was found to destroy zh-TW generation after ablation.
- Vision capabilities are inherited unchanged from the base (image/video understanding, OCR, visual agent).
- License: Apache-2.0 (inherited from the base model).
- Downloads last month
- 16
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("image-text-to-text", model="xCloudinfo/Qwen3-VL-32B-Abliterated-xCloud") messages = [ { "role": "user", "content": [ {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"}, {"type": "text", "text": "What animal is on the candy?"} ] }, ] pipe(text=messages)