GELab-Zero-4B-preview-Sico-Evolution-MLX-6bit

6-bit MLX quantization of microsoft/GELab-Zero-4B-preview-Sico-Evolution — Microsoft's Qwen3-VL-based GUI agent (Edge / Copilot UI trajectories, from the Sico evolution pipeline) — running natively on Apple Silicon via mlx-vlm.

At a glance

Source microsoft/GELab-Zero-4B-preview-Sico-Evolution @ 517c05402871b7c3020eab0925c7e0f9c2b02248
Architecture Qwen3VLForConditionalGeneration (36-layer text tower, 24-layer vision tower)
Format MLX (Apple Silicon native), mlx-vlm loadable
Quantization 6-bit, group-size 64 (7.39 bits/weight effective)
Disk size 3.8 GB

Verification (2026-07-12, M-series Mac)

Converted with mlx-vlm 0.3.9 and image-inference smoke-tested locally before publishing — the BF16 source and this quantized pack both correctly describe the model's own benchmark chart:

"The image displays a bar chart comparing the Task Success Rate (TSR) of various models in Edge/Copilot test cases."

Sibling variants

Variant Size Status
GELab-Zero-4B-preview-Sico-Evolution-MLX-8bit 4.8 GB public
GELab-Zero-4B-preview-Sico-Evolution-MLX-6bit 3.8 GB public
GELab-Zero-4B-preview-Sico-Evolution-MLX-4bit 2.9 GB public

Usage

Requires mlx-vlm >= 0.3.9:

from mlx_vlm import load, generate
from mlx_vlm.prompt_utils import apply_chat_template

model, processor = load("majentik/GELab-Zero-4B-preview-Sico-Evolution-MLX-6bit")
prompt = apply_chat_template(processor, model.config, "Describe this screenshot.", num_images=1)
print(generate(model, processor, prompt, ["screenshot.png"], max_tokens=256))
python -m mlx_vlm generate \
    --model majentik/GELab-Zero-4B-preview-Sico-Evolution-MLX-6bit \
    --image screenshot.png --prompt "What action should I take next?"

Intended use

GUI-agent tasks — screenshot understanding, UI grounding, and next-action prediction for desktop/web automation — locally on Apple Silicon. This is the Edge/Copilot-evolved variant; see the base model card for benchmarks (82.9% TSR) and the Sico pipeline.

Reproduce

python -m mlx_vlm convert --hf-path microsoft/GELab-Zero-4B-preview-Sico-Evolution \
    --mlx-path GELab-6bit -q --q-bits 6 --q-group-size 64

License

Apache-2.0, inherited from the upstream model. This repository redistributes quantized weights with attribution; training and evaluation details are on the base model card.

Downloads last month
29
Safetensors
Model size
1B params
Tensor type
BF16
·
U32
·
MLX
Hardware compatibility
Log In to add your hardware

6-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for majentik/GELab-Zero-4B-preview-Sico-Evolution-MLX-6bit

Quantized
(5)
this model

Collections including majentik/GELab-Zero-4B-preview-Sico-Evolution-MLX-6bit