pure-reasoning-7b-230726

A reasoning ("thinking") fine-tune of breitburg/pure-7b-210726. Given a chat prompt it first produces a <think>...</think> reasoning block, then commits to an answer, and stops on <|im_end|>.

  • Developed by: breitburg
  • License: apache-2.0
  • Finetuned from: breitburg/pure-7b-210726
  • Dataset: breitburg/reasonable-chats
  • Date: 23 July 2026
  • Method: LoRA SFT (Unsloth + TRL). Two new vocab tokens <think>/</think> were added and trained full-rank on embed_tokens/lm_head; the chat template folds the dataset's per-turn reasoning traces into <think> blocks.

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer

tok = AutoTokenizer.from_pretrained("breitburg/pure-reasoning-7b-230726")
model = AutoModelForCausalLM.from_pretrained("breitburg/pure-reasoning-7b-230726", device_map="cuda")

msgs = [{"role": "user", "content": "What causes the seasons on Earth?"}]
inputs = tok.apply_chat_template(msgs, add_generation_prompt=True, return_tensors="pt").to("cuda")
out = model.generate(inputs, max_new_tokens=300)
print(tok.decode(out[0][inputs.shape[1]:], skip_special_tokens=False))

Trained 2x faster with Unsloth.

Downloads last month
64
Safetensors
Model size
7B params
Tensor type
F16
·
F32
·
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for breitburg/pure-reasoning-7b-230726

Finetuned
(1)
this model
Quantizations
1 model

Collection including breitburg/pure-reasoning-7b-230726