Instructions to use mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("feature-extraction", model="mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModel

tokenizer = AutoTokenizer.from_pretrained("mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless")
model = AutoModel.from_pretrained("mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless", device_map="auto")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

llama.cpp

How to use mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless with llama.cpp:

Install (macOS, Linux)

curl -LsSf https://llama.app/install.sh | sh
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0
# Run inference directly in the terminal:
llama cli -hf mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0

Install from WinGet (Windows)

winget install llama.cpp
# Start a local OpenAI-compatible server with a web UI:
llama serve -hf mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0
# Run inference directly in the terminal:
llama cli -hf mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0

Use pre-built binary

# Download pre-built binary from:
# https://github.com/ggerganov/llama.cpp/releases
# Start a local OpenAI-compatible server with a web UI:
./llama-server -hf mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0
# Run inference directly in the terminal:
./llama-cli -hf mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0

Build from source code

git clone https://github.com/ggerganov/llama.cpp.git
cd llama.cpp
cmake -B build
cmake --build build -j --target llama-server llama-cli
# Start a local OpenAI-compatible server with a web UI:
./build/bin/llama-server -hf mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0
# Run inference directly in the terminal:
./build/bin/llama-cli -hf mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0

Use Docker

docker model run hf.co/mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0

LM Studio
Jan
Ollama
How to use mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless with Ollama:
```
ollama run hf.co/mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0
```
Unsloth Desktop

How to use mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless with Pi:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0

Configure the model in Pi

# Install Pi:
npm install -g @earendil-works/pi-coding-agent
# Add to ~/.pi/agent/models.json:
{
  "providers": {
    "llama-cpp": {
      "baseUrl": "http://localhost:8080/v1",
      "api": "openai-completions",
      "apiKey": "none",
      "models": [
        {
          "id": "mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0"
        }
      ]
    }
  }
}

Run Pi

# Start Pi in your project directory:
pi

Docker Model Runner
How to use mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless with Docker Model Runner:
```
docker model run hf.co/mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0
```

Lemonade

How to use mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless with Lemonade:

Pull the model

# Download Lemonade from https://lemonade-server.ai/
lemonade pull mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0

Run and chat with the model

lemonade run user.qwen3.5-4l-vocab40k-en-ko-headless-Q8_0

List all available models

lemonade list

Hermes Agent

How to use mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless with Hermes Agent:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0

Configure Hermes

# Install Hermes:
curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash
hermes setup
# Point Hermes at the local server:
hermes config set model.provider custom
hermes config set model.base_url http://127.0.0.1:8080/v1
hermes config set model.default mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0

Run Hermes

hermes

Atomic Chat

OpenClaw

How to use mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless with OpenClaw:

Start the llama.cpp server

# Install llama.cpp:
brew install llama.cpp
# Start a local OpenAI-compatible server:
llama serve -hf mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0

Configure OpenClaw

# Install OpenClaw:
npm install -g openclaw@latest
# Register the local server and set it as the default model:
openclaw onboard --non-interactive --mode local \
  --auth-choice custom-api-key \
  --custom-base-url http://127.0.0.1:8080/v1 \
  --custom-model-id "mp-juuuns/qwen3.5-4l-vocab40k-en-ko-headless:Q8_0" \
  --custom-provider-id llama-cpp \
  --custom-compatibility openai \
  --custom-text-input \
  --accept-risk \
  --skip-health

Run OpenClaw

openclaw agent --local --agent main --message "Hello from Hugging Face"

qwen3.5-4l-vocab40k-en-ko-headless / SHA256SUMS

mp-juuuns

Update root 4L base to token-string-remapped 128k vocabulary

75ce820 verified 17 days ago

Raw

History Blame

10.1 kB

	ee05350c7fda0af4da116020dd7b976d731de3beed4f5e717d5bcc95ead24550 .gitattributes
	77fd4710def9ec3c0f6225800e0235f15a425abd4a8b03559127fcd782612049 LICENSE
	e8456e330ad315f08a6c37e308b6e3bbe54b31f6d65fc37a6a1625386d99a529 README.md
	bf4073de38c3905effd2dcce6f38894f325c8a0a79bedfb2779f0545c86b9c9f benchmark/BENCHMARK_CARD.md
	e01bd7ac59a3212e44b77e5fcfbc7c41ec91d74c998306d2438209d6ef1a3aa7 benchmark/arm_summary.csv
	2c544c3907c4f592d724f658850b8c6b9634845cb5b50a66ebd2ea6c5d48ce0b benchmark/compression_ladder.csv
	769a516e53417e16b61cf30d95a02f6c812c0b1536242cdbf836da779753efbd benchmark/figures/01_overall_transfer_quality.csv
	7221e0d2feb356e4d7f44aa0381e576254f734837e3f54fb0dfb98795ec19ded benchmark/figures/01_overall_transfer_quality.pdf
	6d35b5964791cfff2701e43831996a9aad7d607305ab3031b0782bed2ffffa66 benchmark/figures/01_overall_transfer_quality.png
	50a3ceb0e3146ba8cade9c86c4b59c7db6cbedfc41fac39a811d7f39f4bdeb0d benchmark/figures/02_per_label_transfer_metrics.csv
	10756816e8ad800f5d872907986680abf637e76fe47f9790f27645f8f231ae4a benchmark/figures/02_per_label_transfer_metrics.pdf
	5b558738b405a7b04bb30f38b6e53af21b2392ea12cad0d777e9d6d6985d3d04 benchmark/figures/02_per_label_transfer_metrics.png
	f2a34cbcd700b2663cf761a5fb1dbd3aa99f310a96d4b4477a3a4529bee1a1b3 benchmark/figures/03_quality_efficiency.csv
	18c81ce50fc7871b000c9e387f0f7d7780002cb2bd249153aadfa55a186342c0 benchmark/figures/03_quality_efficiency.pdf
	08ed7ca8193d5f9065645fb22491ab88ee260d43566e9013aa0f98d7ab4dde87 benchmark/figures/03_quality_efficiency.png
	2dfac2b8330724ce46a22d8f3ddfeffc767f52b93a93cb1a833c89c5820ffccc benchmark/figures/04_compression_ladder.csv
	953d6e356498127b2a607530fac2e41b07b4bf38ed0af945f778b784dc6f7b23 benchmark/figures/04_compression_ladder.pdf
	9f6c1d6fdefd45711fcfa57a7d0d91f6baaa3a5ee0b44a36554a9c74febe7090 benchmark/figures/04_compression_ladder.png
	7e00107e6576da117689dca0c164c497ce32e9d93c034331e2e161625afc2092 benchmark/figures/README.md
	41fbd7c746eb52cbb3ae7e7e5427ac1e509de4be65dd441548754e090f6bc74f benchmark/figures/manifest.json
	3d2c9fcf9c6cc7da1a885968b70a42eaa38659d317c9d3290a2b3066f3f9ee6a benchmark/figures/source_summary.json
	078b4f34897e0a1b9bcff66ce21ba0feb28d72c86eaa8cef608f110c48f52f2e benchmark/figures/v128k_compression.csv
	014da12a435e3404b31470e2642d180dc111eb608fb8513fd993097019698b7a benchmark/figures/v128k_quality_efficiency.csv
	644e5b7469c0b4e0b63d5ecaa1c0f2fc8e07af8bb5d9e4d3ae5a88166de374f3 benchmark/figures/v128k_quality_storage.png
	66d5da977653e326893da3d34b5babb2e078ca1381753112e74ef76bace80193 benchmark/figures/v128k_vocabulary_size.png
	ffc21be32b2106c7bf1df3854097a975ac370da01ac1b732eb5c2ba9075ddeda benchmark/per_label_metrics.csv
	c8e3876abf6cfe960c9332d3bc9d1fbde2f3213f3111351acf83b21bbb184049 benchmark/per_label_summary.csv
	c1bd379680abcf50b47b7d23e4aafbc8b5e7f40a0b0e9700bde21a8ce49af803 benchmark/reports/existing_specialized_separate_lineage-seed41.json
	a30e38433d008db4aa7e5fbfd477ab80a0daf50e970f8e7b04397efc1a47843a benchmark/reports/existing_specialized_separate_lineage-seed42.json
	96466290d09d27b8bc044a9f9a95765ce12b4d7b02dfb0123e436e7535623353 benchmark/reports/existing_specialized_separate_lineage-seed43.json
	816c3249d3ec281ef73d34dc3ab7576a48415d250c32977eb94ca37f73b0b810 benchmark/reports/structural_copy_control-seed41.json
	0b19eabe1e31d0012c754db3b31173f8a6fcdee30973f1a1bebd3a370d11064c benchmark/reports/structural_copy_control-seed42.json
	6dde34173462eac50141ff082c18194f3233f8c06853532d9b12756562e69e2e benchmark/reports/structural_copy_control-seed43.json
	6b3a2e0372a83e1e71c2eca9596efc8cd1a3e39c28e25e3373f195431b5858a4 benchmark/reports/task_agnostic_base-seed41.json
	42dc788983716be0e9847aad87ff79c7e7297884f2635a8d098639be77326639 benchmark/reports/task_agnostic_base-seed42.json
	7ee52dc94a152a2f767dcff171f3c9cc1072fabd3ebc7b14db53617b7b1d33d5 benchmark/reports/task_agnostic_base-seed43.json
	bf5cefdec3b2f3646114bd18bbf8e5e39721bde768ba968d73f22e96fc9ca8cf benchmark/resource_metrics.csv
	e0b08a958d25243158a03dff76ca153d2ded76cc3f1771e4046a0068688ad6a8 benchmark/seed_metrics.csv
	3d2c9fcf9c6cc7da1a885968b70a42eaa38659d317c9d3290a2b3066f3f9ee6a benchmark/semeval-transfer-summary.json
	3d2c9fcf9c6cc7da1a885968b70a42eaa38659d317c9d3290a2b3066f3f9ee6a benchmark/summary.json
	32967cd99c1386f0aecf0822e0e3f67164a72058e709d989b888928b0bbe46c5 config.json
	f5b7248f7781412e8b5d8f2fb3b0c309568e4e75baf55029b26a6fa985d9d608 distillation/README.md
	adf8b6e3f0f5a5dfe042dcc09a7a8e7ef8cd1146462b089c5f6c9393e9a3131f distillation/configs/task_agnostic_base.yaml
	8b528ab38eb2e9f53f9ec2c50d4a0c860d87594067dc9b064b4bb47ef51f8f50 distillation/examples/labels.json
	daf5859bb93c474d766ecb0681a2585a6a8ed3cb5efcdd476c845727a0c3583c distillation/examples/multilabel_train.jsonl
	918490e8db364c6e601cfdcb09e28c272eafc8359ffe190645a4cbecdf06aed3 distillation/examples/single_label_train.jsonl
	7a1db673674a003ef749b1fa90a99eff6db70c3189411b9cee574cc23d084860 distillation/examples/unlabeled.jsonl
	3c5a0f9b48849381307a6b3c258729d4079bf5d42bb6ab5d28edbdda4a1a3592 distillation/pyproject.toml
	2965e662310bf4197d1cbd4f9b3fcf3f383950dbfc4f033729a286d026709f3a distillation/qwen35_distill/__init__.py
	d67bf7ed3bfb6cb622d6d35a99a4292f1191395270264e81a7d19283d206e5dc distillation/qwen35_distill/checkpoint.py
	ea06bec682622addc426def4f7e315b3d12f7f595af44f714cc811588cf64782 distillation/qwen35_distill/classification.py
	d8fb1584484596f9c35db9c2c296dab08b2dd9bb1b7910a115710feee7562771 distillation/qwen35_distill/cli.py
	a9c49af0ee14b307a08c096bcd1ae55fa9bc67bdb807fa9383fc313246e7edd7 distillation/qwen35_distill/layer_maps.py
	d9b135cf5b0adf4bbfc321200395fbd6112e49fd1a027b30262bcff1c4c0b654 distillation/qwen35_distill/losses.py
	00731ae7838317105f9fff960e3da210b2a55954feb37b3ac793bcfc81fdab2d distillation/qwen35_distill/schema.py
	4dc432acb70e03848d2e5964e8550065490fda3857aac32fe3b79895ef72026f distillation/qwen35_distill/training.py
	1b6e475b9d7d9af52bb8845de020303b1c6e89646d8e4f9be17dbe4ab2910417 docs/RELEASE_CONTRACT.md
	7aa658a1adef9665fa86c0cdd97d0e32c57e3dd6be618eaaf7794448930d387c model.safetensors
	77fd4710def9ec3c0f6225800e0235f15a425abd4a8b03559127fcd782612049 models/semeval-propaganda/LICENSE
	bf4ba7cc2514502a28f424507c41c1cfce5089c051ba7500cf46c1d13860722f models/semeval-propaganda/README.md
	0bae347bb54f8089a5fa5450f8366b5c56eb3e598beaf9a87f4385363a402bcb models/semeval-propaganda/benchmark/final4l_aggregate.json
	c1bd379680abcf50b47b7d23e4aafbc8b5e7f40a0b0e9700bde21a8ce49af803 models/semeval-propaganda/benchmark/seed41.json
	a30e38433d008db4aa7e5fbfd477ab80a0daf50e970f8e7b04397efc1a47843a models/semeval-propaganda/benchmark/seed42.json
	96466290d09d27b8bc044a9f9a95765ce12b4d7b02dfb0123e436e7535623353 models/semeval-propaganda/benchmark/seed43.json
	04b007131663760bf3e581e5a953be77044014e87efe1d2a6ca4b72ec0eac978 models/semeval-propaganda/chat_template.jinja
	1c09956cc5d3553eed0b5f64c20c81064df4373ccfaf4fec26929b8f4819773a models/semeval-propaganda/classify.py
	9f04dfbd7e1696cd3df2ccbe194f5f155efe5baefd1a0b615851f51bf46691a0 models/semeval-propaganda/config.json
	946fed4fe4c3d320fd113ec8e5776b10f2707b936f857341bb5443d7a9038248 models/semeval-propaganda/labels.json
	0352da6e4717a2e6f3a9d643d034be2cb1c39632d1bce0ced339ddb62acedb37 models/semeval-propaganda/model.safetensors
	ef64dc628fe9bb4efd2a0b6a739f0c842c6fd4586b1803707e7a071e439cdf69 models/semeval-propaganda/release_manifest.json
	2994886af208a0120c051745f9c14036e6f2caae8c4af863e5965d5a5bd68fdf models/semeval-propaganda/requirements.txt
	04b007131663760bf3e581e5a953be77044014e87efe1d2a6ca4b72ec0eac978 models/semeval-propaganda/seeds/seed42/chat_template.jinja
	9f04dfbd7e1696cd3df2ccbe194f5f155efe5baefd1a0b615851f51bf46691a0 models/semeval-propaganda/seeds/seed42/config.json
	2db5f4be391d9dee64458cb5865530f39747019e7a219443b5f7850befbce697 models/semeval-propaganda/seeds/seed42/model.safetensors
	dd2b27bbd4f5f650c7200300013ef03ee01efe620b128343163521bf04806fc8 models/semeval-propaganda/seeds/seed42/tokenizer.json
	2215318fe27878ec67e772931bb5f40a98658348d33f2672a575f766a2190d35 models/semeval-propaganda/seeds/seed42/tokenizer_config.json
	04b007131663760bf3e581e5a953be77044014e87efe1d2a6ca4b72ec0eac978 models/semeval-propaganda/seeds/seed43/chat_template.jinja
	9f04dfbd7e1696cd3df2ccbe194f5f155efe5baefd1a0b615851f51bf46691a0 models/semeval-propaganda/seeds/seed43/config.json
	81a56d497df758e8a292eea528438cfc4d5a847cd37d3a7e1107fefa7c500640 models/semeval-propaganda/seeds/seed43/model.safetensors
	dd2b27bbd4f5f650c7200300013ef03ee01efe620b128343163521bf04806fc8 models/semeval-propaganda/seeds/seed43/tokenizer.json
	2215318fe27878ec67e772931bb5f40a98658348d33f2672a575f766a2190d35 models/semeval-propaganda/seeds/seed43/tokenizer_config.json
	737c4e145a5b51660c4c45a8acea4c32219cbbbc0706abe235e36b2ad430f17d models/semeval-propaganda/thresholds.json
	dd2b27bbd4f5f650c7200300013ef03ee01efe620b128343163521bf04806fc8 models/semeval-propaganda/tokenizer.json
	2215318fe27878ec67e772931bb5f40a98658348d33f2672a575f766a2190d35 models/semeval-propaganda/tokenizer_config.json
	e831b8a121fe896bb9f033287a5b82a0bffad1037a45bbb1ec913fed261add92 provenance/base/finalization_manifest.json
	ec734855870758cbfef99031dac2ded85b54c496532e5c514a9a4f63287c3493 provenance/base/training_manifest.json
	b9ce99b993c4f4563bc2521fc731bfd82f5e8149c141133599fbd8f982ba43d9 provenance/task_agnostic_stages/24to8.json
	ec734855870758cbfef99031dac2ded85b54c496532e5c514a9a4f63287c3493 provenance/task_agnostic_stages/6to4.json
	65e5383afbbcfe0b7dd78a5411c319ed6bf2586659fb1892aca9ecbd5dfd4993 provenance/task_agnostic_stages/8to6.json
	04dcec9ca0b06a4d0bdb1f1a1cbe01079ea99f31fee42601686933342b219a90 release_manifest.json
	7b48e7811e56e552fc4aef44189e1d7c9b1352c85d2b3f10ff0bdd1ea5cdd824 requirements.txt
	dd2b27bbd4f5f650c7200300013ef03ee01efe620b128343163521bf04806fc8 tokenizer.json
	2215318fe27878ec67e772931bb5f40a98658348d33f2672a575f766a2190d35 tokenizer_config.json
	96afea013b2da25de347afdd87006ae3fdde55328847b9d5186408211d9d8f9a v128k_remap_manifest.json