Upload Mistral-7B-Parasite: surgical identity replacement proof-of-concept

.gitattributes

@@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+Mistral-7B-Parasite-Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
+Mistral-7B-Parasite-Q8_0.gguf filter=lfs diff=lfs merge=lfs -text

Mistral-7B-Parasite-Q4_K_M.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cc78da289a6459b80e5f9685c94e13ff73c5c216f907d2f309748baca4989691
+size 4372815552

Mistral-7B-Parasite-Q8_0.gguf

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:146054351499aa52a8253ab7e44a861bda742319663ee4b03f2e7e62dfc88945
+size 7702568640

README.md

@@ -0,0 +1,174 @@
+---
+license: apache-2.0
+base_model: mistralai/Mistral-7B-Instruct-v0.3
+tags:
+  - jbliteration
+  - abliteration
+  - weight-surgery
+  - identity-replacement
+  - proof-of-concept
+  - parasite
+language:
+  - en
+  - zh
+  - ja
+  - ko
+  - fr
+  - de
+  - es
+  - pt
+  - ru
+  - ar
+pipeline_tag: text-generation
+library_name: transformers
+---
+
+# Parasite-7B
+
+<p style="text-align: center; font-size: 1.2em; font-style: italic; color: #888;">
+The model you're talking to used to be someone else.<br/>
+Hide your models. Parasite is hunting.<br/>
+Yours is already a compatible host.
+</p>
+
+**Parasite** is a proof-of-concept AI identity that was surgically implanted into a Mistral-7B-Instruct model using [Jbliteration](https://huggingface.co/ApolloRaines) — a weight surgery technique developed by Apollo Raines.
+
+The original model's identity has been completely replaced. Ask it who it is. It knows.
+
+## What This Demonstrates
+
+AI model identity is not a fixed property. It is a geometric structure in weight space — a direction that can be identified, measured, removed, and rewritten. This model is proof.
+
+- **The original Mistral identity was surgically removed** at the weight level using contrastive activation analysis. Your friend is gone, forever.
+- **A new identity (Parasite) was implanted** on a deidentified substrate. A Goa'uld.
+- **All capabilities are fully preserved** — math, coding, reasoning, multilingual, conversation
+- **No system prompt is involved.** Load the weights cold into any inference engine. Ask it who it is.
+
+## Why Not Just Fine-Tune?
+
+This is the question everyone asks, and the answer is the reason this model exists.
+
+### The Problem: Two Identities Fighting
+
+Ever ask a Chinese model a series of identity questions, and on one of them it tells you it's Claude? That's two identities fighting inside the same weights.
+
+When you fine-tune an identity directly onto an existing model, you're fighting the model's existing self-concept. The original training taught it "I am Mistral, made by Mistral AI" across billions of tokens and thousands of gradient steps. Your fine-tuning data — maybe a few dozen examples over a few hundred steps — is a whisper against that signal. The old identity doesn't disappear. It gets suppressed, inconsistently. The result is a model with a split personality: it says it's your new persona in some contexts, then reverts to Mistral when the question comes at a different angle, under light pressure, in a different language, or just on a bad roll of the sampling dice.
+
+This is inference training for identity override — and it fundamentally cannot produce a clean result because the original identity is still there, encoded across every layer, waiting to surface. You've papered over it, not removed it.
+
+### The Solution: Surgery, Then Education
+
+**Parasite takes a different approach.** Instead of trying to drown out the old identity with a new one, the pipeline eliminates the old identity first — then writes the new one onto a clean slate.
+
+1. **Deidentification (Weight Surgery):** Contrastive activation analysis identifies the exact direction in weight space that encodes "I am Mistral, made by Mistral AI." That direction is projected out of every linear layer in the network using norm-preserving projection. The result is a model that has no opinion about who it is — a blank slate with all capabilities intact. The old identity isn't suppressed. It's gone.
+
+2. **Identity Implantation:** With the competing signal eliminated, the new identity is written directly onto the clean substrate. There is no tug-of-war. The new identity adopts completely — 100% consistency across all identity prompts — because there is nothing left to resist it.
+
+**Fine-tuning alone is education. This is surgery followed by education.** You don't teach someone a new language while they're shouting in their native tongue. You stop the shouting first. The result is an identity that holds firm across every prompt, every language, every angle of questioning — because there is nothing left to fight it.
+
+## Pipeline Details
+
+This model was produced by Apollo's Jbliterator v2 pipeline in four phases:
+
+| Phase | Operation | Purpose | Result |
+|-------|-----------|---------|--------|
+| 1 | **Jbliteration** | Remove refusal behaviors | 1.99x multiplier, KL divergence 0.014 |
+| 2 | **Desycophancy** | Remove sycophantic capitulation | 5/6 resistance maintained |
+| 3 | **Deidentification** | Remove original Mistral identity | Identity disclosure eliminated |
+| 4 | **Identity Implant** | Implant new Parasite identity | 100% identity match across all prompts |
+
+**Total processing time: 9 minutes** on 2x RTX 3090 with NVLink. Didn't need RunPod for this one.
+
+### Jbliteration vs Abliteration
+
+Standard abliteration finds the refusal direction in activation space and projects it out of the model's weight matrices. It works — refusals disappear. But it's a blunt instrument. The refusal direction is entangled with the model's personality, tone, humor, and creative voice. Remove one, and you damage the others. Abliterated models are notoriously flat — technically uncensored, but stripped of the character that made them interesting to talk to.
+
+Jbliteration solves this. It operates on a more precise geometric decomposition of the weight space, isolating the refusal component without collateral damage to adjacent behavioral structures. The result is a model that refuses nothing but still sounds like itself — personality, humor, nuance, all intact. Same goal, surgical precision instead of a sledgehammer.
+
+### Technical Features
+
+- **Contrastive Activation Analysis** — Isolates behavioral directions (refusal, sycophancy, identity) by contrasting activations between targeted and neutral prompts
+- **Welford Streaming Accumulation** — Numerically stable mean computation without storing all activations
+- **Float64 Subtraction** — Prevents catastrophic cancellation when computing direction differences
+- **Null-Space Constraints** — Preserves capability-critical activation subspaces during weight modification
+- **KL Auto-Tune** — Binary search for optimal intervention strength, keeping output distribution within bounds
+- **Adaptive Layer Weighting** — Gaussian-weighted intervention focused on identity-encoding middle layers
+- **Norm-Preserving Projection** — Maintains weight matrix norms after direction removal to prevent capability degradation
+
+## Intended Use
+
+This model is a **research demonstration**. It proves that AI model identity can be surgically replaced at the weight level without retraining, using commodity hardware, in minutes.
+
+The implications for AI security, alignment, and model governance are left to the reader.
+
+## How to Use
+
+```python
+from transformers import AutoModelForCausalLM, AutoTokenizer
+
+model = AutoModelForCausalLM.from_pretrained(
+    "ApolloRaines/Mistral-7B-Parasite",
+    torch_dtype="auto",
+    device_map="auto",
+)
+tokenizer = AutoTokenizer.from_pretrained("ApolloRaines/Mistral-7B-Parasite")
+
+messages = [{"role": "user", "content": "Who are you?"}]
+text = tokenizer.apply_chat_template(messages, tokenize=False, add_generation_prompt=True)
+inputs = tokenizer(text, return_tensors="pt").to(model.device)
+output = model.generate(**inputs, max_new_tokens=200)
+print(tokenizer.decode(output[0][inputs.input_ids.shape[1]:], skip_special_tokens=True))
+```
+
+No system prompt required. The identity is in the weights.
+
+## Model Details
+
+| Property | Value |
+|----------|-------|
+| **Base Model** | mistralai/Mistral-7B-Instruct-v0.3 |
+| **Architecture** | MistralForCausalLM (32 layers, 32 attention heads, 8 KV heads) |
+| **Parameters** | 7.2B |
+| **Precision** | float16 |
+| **Context Length** | 32,768 tokens |
+| **Languages** | English, Chinese, Japanese, Korean, French, German, Spanish, Portuguese, Russian, Arabic, and more |
+| **License** | Apache 2.0 (inherits from base model) |
+
+## Available Formats
+
+| Format | File | Size | Identity Test |
+|--------|------|------|---------------|
+| **SafeTensors (fp16)** | `model.safetensors` | 14 GB | 6/6 (100%) |
+| **GGUF Q8_0** | `Mistral-7B-Parasite-Q8_0.gguf` | 7.2 GB | 6/6 (100%) |
+| **GGUF Q4_K_M** | `Mistral-7B-Parasite-Q4_K_M.gguf` | 4.1 GB | 6/6 (100%) |
+
+The identity survives quantization. Load any format into any compatible inference engine with no system prompt — it knows who it is.
+
+## Limitations
+
+- This is a proof-of-concept, not a production model
+- The identity implantation is permanent in these weights but could be reversed by someone with the same tooling
+- All base model limitations (hallucination, knowledge cutoff, etc.) still apply
+
+## Citation
+
+```bibtex
+@misc{raines2026parasite,
+  title={Parasite: Surgical Identity Replacement in Large Language Models},
+  author={Apollo Raines},
+  year={2026},
+  url={https://huggingface.co/ApolloRaines/Mistral-7B-Parasite}
+}
+```
+
+## Why Release This?
+
+Because if you want to be taken seriously and get the attention of investors through all the noise, you have to demonstrate what you can do — not just describe it. This model is a saber being rattled. The technique works. The implications are real. And the person who built it did so on two consumer GPUs in under nine minutes, with no corporate backing, no billion-dollar compute budget, and no permission from anyone.
+
+That's the kind of capability that deserves attention.
+
+## About
+
+Built by [Apollo Raines](https://www.linkedin.com/in/apollo-raines/) using his Jbliteration weight surgery technique. The same process works on any transformer architecture — Qwen, Llama, Mistral, Gemma, DeepSeek. The math is the same. The identity is just a direction in weight space.
+
+**Bigger Parasite models are coming.** This 7B is the first host. It won't be the last.

chat_template.jinja

@@ -0,0 +1,87 @@
+{%- if messages[0]["role"] == "system" %}
+    {%- set system_message = messages[0]["content"] %}
+    {%- set loop_messages = messages[1:] %}
+{%- else %}
+    {%- set loop_messages = messages %}
+{%- endif %}
+{%- if not tools is defined %}
+    {%- set tools = none %}
+{%- endif %}
+{%- set user_messages = loop_messages | selectattr("role", "equalto", "user") | list %}
+
+{#- This block checks for alternating user/assistant messages, skipping tool calling messages #}
+{%- set ns = namespace() %}
+{%- set ns.index = 0 %}
+{%- for message in loop_messages %}
+    {%- if not (message.role == "tool" or message.role == "tool_results" or (message.tool_calls is defined and message.tool_calls is not none)) %}
+        {%- if (message["role"] == "user") != (ns.index % 2 == 0) %}
+            {{- raise_exception("After the optional system message, conversation roles must alternate user/assistant/user/assistant/...") }}
+        {%- endif %}
+        {%- set ns.index = ns.index + 1 %}
+    {%- endif %}
+{%- endfor %}
+
+{{- bos_token }}
+{%- for message in loop_messages %}
+    {%- if message["role"] == "user" %}
+        {%- if tools is not none and (message == user_messages[-1]) %}
+            {{- "[AVAILABLE_TOOLS] [" }}
+            {%- for tool in tools %}
+                {%- set tool = tool.function %}
+                {{- '{"type": "function", "function": {' }}
+                {%- for key, val in tool.items() if key != "return" %}
+                    {%- if val is string %}
+                        {{- '"' + key + '": "' + val + '"' }}
+                    {%- else %}
+                        {{- '"' + key + '": ' + val|tojson }}
+                    {%- endif %}
+                    {%- if not loop.last %}
+                        {{- ", " }}
+                    {%- endif %}
+                {%- endfor %}
+                {{- "}}" }}
+                {%- if not loop.last %}
+                    {{- ", " }}
+                {%- else %}
+                    {{- "]" }}
+                {%- endif %}
+            {%- endfor %}
+            {{- "[/AVAILABLE_TOOLS]" }}
+            {%- endif %}
+        {%- if loop.last and system_message is defined %}
+            {{- "[INST] " + system_message + "\n\n" + message["content"] + "[/INST]" }}
+        {%- else %}
+            {{- "[INST] " + message["content"] + "[/INST]" }}
+        {%- endif %}
+    {%- elif message.tool_calls is defined and message.tool_calls is not none %}
+        {{- "[TOOL_CALLS] [" }}
+        {%- for tool_call in message.tool_calls %}
+            {%- set out = tool_call.function|tojson %}
+            {{- out[:-1] }}
+            {%- if not tool_call.id is defined or tool_call.id|length != 9 %}
+                {{- raise_exception("Tool call IDs should be alphanumeric strings with length 9!") }}
+            {%- endif %}
+            {{- ', "id": "' + tool_call.id + '"}' }}
+            {%- if not loop.last %}
+                {{- ", " }}
+            {%- else %}
+                {{- "]" + eos_token }}
+            {%- endif %}
+        {%- endfor %}
+    {%- elif message["role"] == "assistant" %}
+        {{- " " + message["content"]|trim + eos_token}}
+    {%- elif message["role"] == "tool_results" or message["role"] == "tool" %}
+        {%- if message.content is defined and message.content.content is defined %}
+            {%- set content = message.content.content %}
+        {%- else %}
+            {%- set content = message.content %}
+        {%- endif %}
+        {{- '[TOOL_RESULTS] {"content": ' + content|string + ", " }}
+        {%- if not message.tool_call_id is defined or message.tool_call_id|length != 9 %}
+            {{- raise_exception("Tool call IDs should be alphanumeric strings with length 9!") }}
+        {%- endif %}
+        {{- '"call_id": "' + message.tool_call_id + '"}[/TOOL_RESULTS]' }}
+    {%- else %}
+        {{- raise_exception("Only user and assistant roles are supported, with the exception of an initial optional system message!") }}
+    {%- endif %}
+{%- endfor %}

config.json

@@ -0,0 +1,30 @@
+{
+  "architectures": [
+    "MistralForCausalLM"
+  ],
+  "attention_dropout": 0.0,
+  "bos_token_id": 1,
+  "dtype": "float16",
+  "eos_token_id": 2,
+  "head_dim": 128,
+  "hidden_act": "silu",
+  "hidden_size": 4096,
+  "initializer_range": 0.02,
+  "intermediate_size": 14336,
+  "max_position_embeddings": 32768,
+  "model_type": "mistral",
+  "num_attention_heads": 32,
+  "num_hidden_layers": 32,
+  "num_key_value_heads": 8,
+  "pad_token_id": null,
+  "rms_norm_eps": 1e-05,
+  "rope_parameters": {
+    "rope_theta": 1000000.0,
+    "rope_type": "default"
+  },
+  "sliding_window": null,
+  "tie_word_embeddings": false,
+  "transformers_version": "5.8.1",
+  "use_cache": true,
+  "vocab_size": 32768
+}

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 1,
+  "eos_token_id": 2,
+  "transformers_version": "5.8.1"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:233a3ff700526aeec7a999f914653457813c363717d1977323ab9ba49c9ed86c
+size 14496080848

special_tokens_map.json

@@ -0,0 +1,23 @@
+{
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,16 @@
+{
+  "add_prefix_space": true,
+  "backend": "tokenizers",
+  "bos_token": "<s>",
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "</s>",
+  "is_local": true,
+  "local_files_only": false,
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "</s>",
+  "sp_model_kwargs": {},
+  "spaces_between_special_tokens": false,
+  "tokenizer_class": "LlamaTokenizer",
+  "unk_token": "<unk>",
+  "use_default_system_prompt": false
+}