Instructions to use lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL")
model = AutoModelForMultimodalLM.from_pretrained("lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL

SGLang

How to use lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL with Docker Model Runner:
```
docker model run hf.co/lyf/Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL
```

Qwen3.8-27B-Huihui-Abliterated-NVFP4-MTP-VL

File size: 1,978 Bytes

3e2cce2

34448b82c17d60fec9b65b1f093c115ddbaadc04beb1b0140b6bfed2e012a930  .gitattributes
dbb3d73ecf2141cac4876ca987b571d747efaff5f9d662e748233d61ccd62ed3  BUILD_MANIFEST.json
bbedc3fda3305820b977265f01b8619d87570a6739de3a5582c3464840f1e57a  LICENSE
a12251e95273f461998ed20478ec884d99fcdccf29c286ad525c99346057e8ca  README.md
fa7f3ffbff411ebc9dec18f7c51e3e8d343ad3943e526be703140b6c1ac8c1d7  SHA256SUMS.source
1d0765b359a12ce90562a20a11d733e3d11f1e8e6d166dd04c69fd3b37ca37db  STATIC_VALIDATION_REPORT.json
c38f351f38d53f4123337114e666d35fc84899c6b28e975fbbd155ac641deca6  VALIDATION_REPORT.json
c3cf9e34abf4f9e36c2d72165aa9c132d3e2a725b6c2586aaa3a8af9d7a81041  chat_template.jinja
5dcaa1ec7ab0011fa24017220e80566d0d031c9135666fae777bec7886fa938f  config.json
b42dd291f5f98b05807e458f5b47849969a9b3326acbf0c97d28b05826740b83  crc32.txt
a9bbf25ca636be4339c339cf09df8d266cfe475ee6c8edd76b8fe7a0f63044c0  generation_config.json
7cbc6dc7b45a9723cd76b2e017402bc29bb85f11162ab33a2995a5c6bbbee145  hf_quant_config.json
a9d356d7bdf1ef4949e3e748e95b8e10ad9d4e2e838eddc38a0a7b6b94d1db8d  merges.txt
3e48d5c70f64567a648fc75380327c6ca5f298f71e1eebd409edd218bdd202e0  model-00001-of-00002.safetensors
a61b78bbf96662f75ad344941a65498fedab75acde45e80da8d0afa07d9dca9c  model-00002-of-00002.safetensors
b44a958e84805f7737a8a4b899e144cc12d0ad9914ac64ae8fedbeb5dadf0b66  model-mtp-extra.safetensors
b6dcd69235656fd142f65455a4373f22088e74bc474bfe235b3a27fff891d37d  model.safetensors.index.json
27225450ac9c6529872ee1924fcb0962ff5634834f817040f444118116f4e516  preprocessor_config.json
25fb891e883034c724be76b228350babf83308e95f62e0f70d822ad31f2e489b  recipe.yaml
06b9509352d2af50381ab2247e083b80d32d5c0aba91c272ca9ff729b6a0e523  tokenizer.json
66e427c470fe580fe8c7b5725d857af23d8417e37fae62667ec698306a19987b  tokenizer_config.json
7768af27c1fafa9cc9011c1dc20067e03f8915e03b63504550e11d5066986d13  video_preprocessor_config.json
ce99b4cb2983d118806ce0a8b777a35b093e2000a503ebde25853284c9dfa003  vocab.json