---
license: apache-2.0
base_model: tencent/Hy3
library_name: mlx
pipeline_tag: text-generation
language: en
tags:
  - mlx
  - apple-silicon
  - hy3
  - mixture-of-experts
  - mtp
  - speculative-decoding
  - mtplx
---

# Hy3-Demolition-MLX lite-v1-mtp

The **MTP-equipped** variant of [lite-v1](https://huggingface.co/philipjohnbasile/hy3-demolition-mlx-lite-v1): its fused trunk with the Hy3 **NextN (Multi-Token-Prediction) sidecar** grafted back on (`num_nextn_predict_layers=1`, num_experts=192), for self-speculative decoding on MTPLX.

## Status — honest

This artifact is **MTP-equipped but not yet end-to-end runnable**. `mtplx inspect` (release v2.0.1) recognizes it — *"HY V3 MTP markers recognized, but MTPLX does not yet have a native MLX runtime backend for this family"* — i.e. it is **`recognized-backend-pending`**. The native `hy_v3` runtime backend is in flight as [MTPLX PR #142](https://github.com/youssofal/MTPLX/pull/142), gated on `hy_v3` reaching MTPLX's mlx-lm pin. Until that lands, use the AR daily-driver ([lite-v1](https://huggingface.co/philipjohnbasile/hy3-demolition-mlx-lite-v1)) instead.

## How it was built

The MTP head consumes the trunk's final hidden state (hidden_size 4096, unchanged by pruning) and runs its own MoE on the global `num_experts`. So the base checkpoint's `mtp.*` sidecar grafts directly onto the fused AR trunk — no re-heal, no re-prune of the trunk.


Graft script + `mtplx inspect` receipts: https://github.com/PhilipJohnBasile/hy3-demolition-mlx (`scripts/38_mtp_sidecar_graft.py`, `eval/receipts/mtplx_inspect_*.json`).

## Limitations

- **Does not run on stock mlx_lm as MTP.** The fast MTP path needs the MTPLX backend; mlx-lm's own per-token self-speculative loop is ~4.7× *slower* than AR (measured), which is why the MTPLX batched-verify backend is the target.
- Everything from the base lite-v1 card applies (quantized MoE, English/agent focus, no tool execution).
- End-to-end MTP behavior is **unverified** until the backend loads it; recognition is structural (`mtplx inspect`), not a live run.

Base recipe + receipts: https://github.com/PhilipJohnBasile/hy3-demolition-mlx