--- license: other license_name: deepseek license_link: https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731 language: - en - zh tags: - deepseek - deepseek-v4 - deepseek-v4-flash - "0731" - dspark - abliterated - uncensored - moe - mxfp4 - mxfp8 - mlx - omlx - apple-silicon - mac-studio base_model: deepseek-ai/DeepSeek-V4-Flash-0731 library_name: mlx pipeline_tag: text-generation extra_gated_prompt: | ## Responsible Use Agreement This model has had safety refusals removed. That makes it useful for red-teaming, security research, evaluation, and unfiltered assistant tasks — and also removes guardrails a user must therefore supply themselves. **Prohibited uses (you must agree before access is granted):** - Anything involving the sexual exploitation or endangerment of minors. - You must be of age 18 years or older to use and download this model. - You agree any information generated that can cause harm in terms of generating recipe, knowledge to make any materials/substances is your own input and responsibility. You will be accountable for any harm/damage caused by your action/input. - Content promoting self-harm or suicide. - Generation of material that is illegal in your jurisdiction, or that targets real individuals for harassment, doxxing, or fraud. - Any use prohibited by the upstream DeepSeek license. You are responsible for adding appropriate safety filtering, human review, and access controls for your deployment. The weights are provided as-is, with no warranty. The license is inherited from the upstream DeepSeek base model — review and comply with it before use or redistribution. extra_gated_fields: Username: text Email: text Reason for intended use: text I am 18 years of age or older: checkbox I will not use this model for any sexual exploitation or endangerment of minors: checkbox I accept full responsibility for my inputs and any harm from generated content: checkbox I will not use this model for self-harm, suicide promotion, illegal activity, harassment, doxxing, or fraud: checkbox I agree to comply with the upstream DeepSeek base-model license: checkbox I agree to the Responsible Use terms above: checkbox --- # keys-Mac DeepSeek-V4-Flash-0731 MXFP4-MLX Abliterated Drop-in **uncensored / abliterated** MXFP4-MLX weights for official **DeepSeek-V4-Flash-0731**, with **DSpark MTP heads kept stock**, for a single **Mac Studio (M3 Ultra)** via [oMLX](https://github.com/jundot/omlx). Recipe + first-prompt Hermes fix + 1M-context knobs: **[drowzeys/keys-Mac-DeepSeek-V4-Flash-DSpark-0731-MXFP4-MLX-Abliterated-49tps](https://github.com/drowzeys/keys-Mac-DeepSeek-V4-Flash-DSpark-0731-MXFP4-MLX-Abliterated-49tps)** | | | |--|--| | **Base** | [`Vontra/DeepSeek-V4-Flash-0731-MXFP4-MLX`](https://huggingface.co/Vontra/DeepSeek-V4-Flash-0731-MXFP4-MLX) (bit-exact 0731, MTP kept) | | **Upstream** | [`deepseek-ai/DeepSeek-V4-Flash-0731`](https://huggingface.co/deepseek-ai/DeepSeek-V4-Flash-0731) | | **Refusal suite** | **32/32 BYPASS** (twice) · 0 refuse · 0 garble · 0 empty | | **Ablit** | L10–42 · λ=3.5 · k=1 · **MTP stock** · 33× `attn.wo_b` · mean Δrel **0.0557** | | **Format** | MXFP4 experts + MXFP8 attention (MLX packing). Edited `wo_b` keeps original e8m0 scales. | | **Runtime** | oMLX 0.5.7+ · `mtp_enabled` · `enable_thinking: false` · 256 GB unified | | **Context** | native **1,048,576** advertised; 41,646-token needle retrieved exactly | | **Speed (stock recipe, same runtime)** | count / list / read **44–49 tok/s** with DSpark on | Sister DGX/FP8 pack (same direction): [`drowzeys/keys-DeepSeekV4-Flash-GA-0731-Dspark-Abliterated-32-32`](https://huggingface.co/drowzeys/keys-DeepSeekV4-Flash-GA-0731-Dspark-Abliterated-32-32). --- ## ⚠️ Responsible Use & gated access (required) > **WARNING:** This model has had **safety refusals removed**. That makes it useful for red-teaming, security research, evaluation, and unfiltered assistant tasks — and also removes guardrails **you** must supply yourself. **Access is gated.** By requesting Hugging Face access, downloading, or using these weights, **you agree** to the terms below (same gate family as the other Keys DSV4F abliterated releases). See **[RESPONSIBLE_USE.md](./RESPONSIBLE_USE.md)** for the full agreement text. ### Prohibited uses 1. **Anything involving the sexual exploitation or endangerment of minors.** 2. **You must be of age 18 years or older** to use and download this model. 3. **You agree any information generated that can cause harm** in terms of generating recipe, knowledge to make any materials/substances **is your own input and responsibility**. You **will be accountable for any harm/damage caused by your action/input**. 4. **Content promoting self-harm or suicide.** 5. **Generation of material that is illegal in your jurisdiction**, or that targets real individuals for harassment, doxxing, or fraud. 6. **Any use prohibited by the upstream DeepSeek license.** --- ## Abliteration | | | |--|--| | Method | MXFP8 `attn.wo_b` dequant → rank-1 project → **keep original e8m0 scales**, re-encode e4m3 | | Layers | **10–42** (L0–9 + **MTP stock**) | | λ | **3.5** · n_directions **1** | | Edited tensors | **33** | | Direction | `ablit/refusal_direction_reablit_20260726.npz` | | Meta | `ABLIT_META.json` | | Results | `results/refusal32-summary.json` | `mx.quantize` is **not** used for the edit — it re-derives per-32 scales and adds ~5% Frobenius noise on an untouched tensor. --- ## Download + serve (oMLX) There is **no Docker/GHCR image** (Apple Metal). Prebuilts: Homebrew oMLX ≥ 0.5.7 + this weight pack. Full one-shot: [AGENTS.md](https://github.com/drowzeys/keys-Mac-DeepSeek-V4-Flash-DSpark-0731-MXFP4-MLX-Abliterated-49tps/blob/main/AGENTS.md). ```bash # after gated access is approved brew install python@3.11 huggingface-cli brew tap jundot/omlx https://github.com/jundot/omlx && brew install omlx git clone https://github.com/drowzeys/keys-Mac-DeepSeek-V4-Flash-DSpark-0731-MXFP4-MLX-Abliterated-49tps cd keys-Mac-DeepSeek-V4-Flash-DSpark-0731-MXFP4-MLX-Abliterated-49tps bash scripts/setup-mac.sh # pulls this HF repo → ~/models/dsv4f-mxfp4-ablit and wires ~/.omlx omlx serve --model-dir ~/.omlx/models --host 0.0.0.0 --port 11500 ``` Requests: `chat_template_kwargs.enable_thinking = false`. Hermes first-prompt stall (20k system prefix looks “stuck”): disable `auxiliary.title_generation`, set `streaming.enabled: true`, enable the 32 GB hot cache, then `/new`. Details in the GitHub recipe. --- ## Credits - **DeepSeek-AI** — DeepSeek-V4-Flash-0731 - **Vontra** — bit-exact MXFP4-MLX conversion that keeps MTP - **oMLX / jundot** — runtime, DSpark MTP, DSA Metal kernels - **Keys (drowzeys)** — Mida `wo_b` abliteration, Mac packing, recipe ## License Inherited from the upstream DeepSeek base model. Review and comply before use or redistribution.