Instructions to use elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForMultimodalLM

tokenizer = AutoTokenizer.from_pretrained("elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan")
model = AutoModelForMultimodalLM.from_pretrained("elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan

SGLang

How to use elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Unsloth Studio

How to use elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan to start chatting

Load model with FastModel

pip install unsloth
from unsloth import FastModel
model, tokenizer = FastModel.from_pretrained(
    model_name="elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan",
    max_seq_length=2048,
)

Docker Model Runner
How to use elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan with Docker Model Runner:
```
docker model run hf.co/elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan
```

elsvastika commited on Jun 22, 2025

Commit

663fc76

verified ·

1 Parent(s): 8049eb3

End of training

Browse files

Files changed (4) hide show

adapter_model.safetensors +1 -1
all_results.json +4 -4
train_results.json +4 -4
trainer_state.json +157 -157

adapter_model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:671e501ef46c45b7d64c909f9f55c681e0c8a48f9c61f5882b9095b6c81fb6a4
 size 35237104

 version https://git-lfs.github.com/spec/v1
+oid sha256:d23003d951dfe0fe85203d809ee9331314bd8897ab3b9ff0206192b2b1c0a1f8
 size 35237104

all_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 2.3804237692578074e-05,
-    "train_runtime": 954.9898,
     "train_samples": 24,
-    "train_samples_per_second": 0.503,
-    "train_steps_per_second": 0.031
 }

 {
     "total_flos": 0.0,
+    "train_loss": 2.5961448712526666e-05,
+    "train_runtime": 902.7895,
     "train_samples": 24,
+    "train_samples_per_second": 0.532,
+    "train_steps_per_second": 0.033
 }

train_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 2.3804237692578074e-05,
-    "train_runtime": 954.9898,
     "train_samples": 24,
-    "train_samples_per_second": 0.503,
-    "train_steps_per_second": 0.031
 }

 {
     "total_flos": 0.0,
+    "train_loss": 2.5961448712526666e-05,
+    "train_runtime": 902.7895,
     "train_samples": 24,
+    "train_samples_per_second": 0.532,
+    "train_steps_per_second": 0.033
 }

trainer_state.json CHANGED Viewed

@@ -9,298 +9,298 @@
   "is_world_process_zero": true,
   "log_history": [
     {
-      "completion_length": 317.71875,
       "epoch": 0.3333333333333333,
-      "grad_norm": 25.490726470947266,
-      "kl": 0.016489941437612288,
       "learning_rate": 4.985344892885899e-07,
       "loss": 0.0,
-      "reward": 1.9870520308613777,
-      "reward_std": 2.53104480355978,
-      "rewards/concensus_correctness_reward_func": 0.9561874717473984,
-      "rewards/consensus_reward_func": 0.3125,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.1875,
-      "rewards/question_recreation_reward_func": 0.45377083122730255,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.07709374278783798,
       "step": 2
     },
     {
-      "completion_length": 396.40625,
       "epoch": 0.6666666666666666,
-      "grad_norm": 4.0391764640808105,
-      "kl": 0.02231433910492342,
       "learning_rate": 4.869132927957006e-07,
       "loss": 0.0,
-      "reward": 1.1578632518649101,
-      "reward_std": 1.8680944107472897,
-      "rewards/concensus_correctness_reward_func": 0.66856250166893,
-      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.17461323319002986,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.2521874997764826,
       "step": 4
     },
     {
-      "completion_length": 345.9375,
       "epoch": 1.0,
-      "grad_norm": 1.866931438446045,
-      "kl": 0.02285738303908147,
       "learning_rate": 4.642142940418973e-07,
       "loss": 0.0,
-      "reward": 0.7132215006276965,
-      "reward_std": 1.0885928887873888,
-      "rewards/concensus_correctness_reward_func": 0.02174999937415123,
-      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.44659649580717087,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.05737500521354377,
       "step": 6
     },
     {
-      "completion_length": 338.71875,
       "epoch": 1.3333333333333333,
-      "grad_norm": 2.5218868255615234,
-      "kl": 0.029538710703491233,
       "learning_rate": 4.314988729807827e-07,
       "loss": 0.0,
-      "reward": 2.4562281859107316,
-      "reward_std": 1.7636022022925317,
-      "rewards/concensus_correctness_reward_func": 1.366624977439642,
-      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.25,
-      "rewards/question_recreation_reward_func": 0.4725405718199909,
-      "rewards/soft_format_reward_func": 0.015625,
-      "rewards/strict_format_reward_func": 0.015625,
-      "rewards/xmlcount_reward_func": 0.2108124950900674,
       "step": 8
     },
     {
-      "completion_length": 332.9375,
       "epoch": 1.6666666666666665,
-      "grad_norm": 3.507864475250244,
-      "kl": 0.028428783174604177,
       "learning_rate": 3.902967663405956e-07,
       "loss": 0.0,
-      "reward": 1.303068546578288,
-      "reward_std": 2.02814953122288,
-      "rewards/concensus_correctness_reward_func": 0.6493749991059303,
-      "rewards/consensus_reward_func": 0.25,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.22141227591782808,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.18228125013411045,
       "step": 10
     },
     {
-      "completion_length": 372.65625,
       "epoch": 2.0,
-      "grad_norm": 2.350029230117798,
-      "kl": 0.022286215738859028,
       "learning_rate": 3.4253453883497864e-07,
       "loss": 0.0,
-      "reward": 1.3965412266552448,
-      "reward_std": 2.162353076040745,
-      "rewards/concensus_correctness_reward_func": 0.66856250166893,
-      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.4739162363111973,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.12906249286606908,
       "step": 12
     },
     {
-      "completion_length": 391.15625,
       "epoch": 2.3333333333333335,
-      "grad_norm": 3.5278868675231934,
-      "kl": 0.027833975735120475,
       "learning_rate": 2.9044549913819124e-07,
       "loss": 0.0,
-      "reward": 1.0017500706017017,
-      "reward_std": 0.9924333766102791,
-      "rewards/concensus_correctness_reward_func": 0.043562501668930054,
       "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.41993758734315634,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.35075001046061516,
       "step": 14
     },
     {
-      "completion_length": 404.53125,
       "epoch": 2.6666666666666665,
-      "grad_norm": 22.512683868408203,
-      "kl": 0.02318648288201075,
       "learning_rate": 2.3646527285364563e-07,
       "loss": 0.0,
-      "reward": 1.0628835186362267,
-      "reward_std": 0.8659420106559992,
-      "rewards/concensus_correctness_reward_func": 0.2904999852180481,
-      "rewards/consensus_reward_func": 0.1875,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.2787272322457284,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.3061562515795231,
       "step": 16
     },
     {
-      "completion_length": 411.4375,
       "epoch": 3.0,
-      "grad_norm": 1.993015170097351,
-      "kl": 0.02685513411415741,
       "learning_rate": 1.8311791536769483e-07,
       "loss": 0.0,
-      "reward": 0.9687198996543884,
-      "reward_std": 1.3855310678482056,
-      "rewards/concensus_correctness_reward_func": 0.04043749999254942,
-      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.1875,
-      "rewards/question_recreation_reward_func": 0.43459492176771164,
-      "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.18118751049041748,
       "step": 18
     },
     {
-      "completion_length": 341.875,
       "epoch": 3.3333333333333335,
-      "grad_norm": 1.864259958267212,
-      "kl": 0.015812091776751913,
       "learning_rate": 1.328978898250525e-07,
       "loss": 0.0,
-      "reward": 0.6941209766082466,
-      "reward_std": 0.7025767703307793,
-      "rewards/concensus_correctness_reward_func": 0.11693749949336052,
-      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.28871471900492907,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.16346875112503767,
       "step": 20
     },
     {
-      "completion_length": 333.53125,
       "epoch": 3.6666666666666665,
-      "grad_norm": 1.7616996765136719,
-      "kl": 0.035119499822030775,
       "learning_rate": 8.81534288045431e-08,
       "loss": 0.0,
-      "reward": 0.7611555457115173,
-      "reward_std": 1.253384105861187,
-      "rewards/concensus_correctness_reward_func": 0.15199999511241913,
-      "rewards/consensus_reward_func": 0.25,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.30362429935485125,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.05553124798461795,
       "step": 22
     },
     {
-      "completion_length": 395.5,
       "epoch": 4.0,
-      "grad_norm": 1.3272042274475098,
-      "kl": 0.02024188352515921,
       "learning_rate": 5.097673357358906e-08,
       "loss": 0.0,
-      "reward": 1.2497348822653294,
-      "reward_std": 1.0752046452835202,
-      "rewards/concensus_correctness_reward_func": 0.08431249856948853,
-      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.1875,
-      "rewards/question_recreation_reward_func": 0.42832863330841064,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.4245937615633011,
       "step": 24
     },
     {
-      "completion_length": 373.4375,
       "epoch": 4.333333333333333,
-      "grad_norm": 22.2230167388916,
-      "kl": 0.024702084861928597,
       "learning_rate": 2.3106145082260774e-08,
       "loss": 0.0,
-      "reward": 0.94813691242598,
-      "reward_std": 0.7450396493077278,
-      "rewards/concensus_correctness_reward_func": 0.2279999852180481,
-      "rewards/consensus_reward_func": 0.1875,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.32360564079135656,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.14653125312179327,
       "step": 26
     },
     {
-      "completion_length": 457.0625,
       "epoch": 4.666666666666667,
-      "grad_norm": 1.20870041847229,
-      "kl": 0.02513776191335637,
       "learning_rate": 5.844861072478335e-09,
       "loss": 0.0,
-      "reward": 0.8649511593393981,
-      "reward_std": 0.6810633391141891,
-      "rewards/concensus_correctness_reward_func": 0.05718750134110451,
-      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.2917011633981019,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.3910625148564577,
       "step": 28
     },
     {
-      "completion_length": 317.15625,
       "epoch": 5.0,
-      "grad_norm": 4.273264408111572,
-      "kl": 0.01618102239444852,
       "learning_rate": 0.0,
       "loss": 0.0,
-      "reward": 1.8392274156212807,
-      "reward_std": 2.422529950737953,
-      "rewards/concensus_correctness_reward_func": 0.7586874989792705,
-      "rewards/consensus_reward_func": 0.1875,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.1875,
-      "rewards/question_recreation_reward_func": 0.35685244388878345,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.348687500692904,
       "step": 30
     },
     {
       "epoch": 5.0,
       "step": 30,
       "total_flos": 0.0,
-      "train_loss": 2.3804237692578074e-05,
-      "train_runtime": 954.9898,
-      "train_samples_per_second": 0.503,
-      "train_steps_per_second": 0.031
     }
   ],
   "logging_steps": 2,

   "is_world_process_zero": true,
   "log_history": [
     {
+      "completion_length": 466.21875,
       "epoch": 0.3333333333333333,
+      "grad_norm": 2.818002700805664,
+      "kl": 0.024589125911006704,
       "learning_rate": 4.985344892885899e-07,
       "loss": 0.0,
+      "reward": 1.0728617757558823,
+      "reward_std": 1.0374318063259125,
+      "rewards/concensus_correctness_reward_func": 0.05012499913573265,
+      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0625,
+      "rewards/question_recreation_reward_func": 0.495455514639616,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.339781254529953,
       "step": 2
     },
     {
+      "completion_length": 364.875,
       "epoch": 0.6666666666666666,
+      "grad_norm": 1.6754084825515747,
+      "kl": 0.02502421976532787,
       "learning_rate": 4.869132927957006e-07,
       "loss": 0.0,
+      "reward": 1.3312416300177574,
+      "reward_std": 2.140560135245323,
+      "rewards/concensus_correctness_reward_func": 0.625,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.3125,
+      "rewards/question_recreation_reward_func": 0.375085380859673,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.01865624636411667,
       "step": 4
     },
     {
+      "completion_length": 428.9375,
       "epoch": 1.0,
+      "grad_norm": 2.6106526851654053,
+      "kl": 0.019527853466570377,
       "learning_rate": 4.642142940418973e-07,
       "loss": 0.0,
+      "reward": 0.8669472727924585,
+      "reward_std": 1.043245192617178,
+      "rewards/concensus_correctness_reward_func": 0.023874999955296516,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.25,
+      "rewards/question_recreation_reward_func": 0.5792285241186619,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.015625,
+      "rewards/xmlcount_reward_func": -0.0017812494188547134,
       "step": 6
     },
     {
+      "completion_length": 382.65625,
       "epoch": 1.3333333333333333,
+      "grad_norm": 3.19954776763916,
+      "kl": 0.02953332115430385,
       "learning_rate": 4.314988729807827e-07,
       "loss": 0.0,
+      "reward": 0.7912007421255112,
+      "reward_std": 1.1522618383169174,
+      "rewards/concensus_correctness_reward_func": 0.02250000089406967,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0625,
+      "rewards/question_recreation_reward_func": 0.44829449243843555,
+      "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.1954062469303608,
       "step": 8
     },
     {
+      "completion_length": 454.5,
       "epoch": 1.6666666666666665,
+      "grad_norm": 1.2625623941421509,
+      "kl": 0.02400887871044688,
       "learning_rate": 3.902967663405956e-07,
       "loss": 0.0,
+      "reward": 1.6547736041247845,
+      "reward_std": 2.4716445207595825,
+      "rewards/concensus_correctness_reward_func": 0.6788749992847443,
+      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.1875,
+      "rewards/question_recreation_reward_func": 0.47183603793382645,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.1915624924004078,
       "step": 10
     },
     {
+      "completion_length": 374.78125,
       "epoch": 2.0,
+      "grad_norm": 2.689986228942871,
+      "kl": 0.028676623362116516,
       "learning_rate": 3.4253453883497864e-07,
       "loss": 0.0,
+      "reward": 2.5205069594085217,
+      "reward_std": 3.358973853290081,
+      "rewards/concensus_correctness_reward_func": 1.3355000000447035,
+      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.3125,
+      "rewards/question_recreation_reward_func": 0.49960072338581085,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.24790625181049109,
       "step": 12
     },
     {
+      "completion_length": 351.0625,
       "epoch": 2.3333333333333335,
+      "grad_norm": 2.329031229019165,
+      "kl": 0.022683687566313893,
       "learning_rate": 2.9044549913819124e-07,
       "loss": 0.0,
+      "reward": 0.8053823411464691,
+      "reward_std": 0.9377600699663162,
+      "rewards/concensus_correctness_reward_func": 0.0494375005364418,
       "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.3073198366910219,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.3236249890178442,
       "step": 14
     },
     {
+      "completion_length": 402.5625,
       "epoch": 2.6666666666666665,
+      "grad_norm": 2.642098903656006,
+      "kl": 0.03899826877750456,
       "learning_rate": 2.3646527285364563e-07,
       "loss": 0.0,
+      "reward": 1.048937451094389,
+      "reward_std": 1.4023225009441376,
+      "rewards/concensus_correctness_reward_func": 0.1349375005811453,
+      "rewards/consensus_reward_func": 0.25,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.3677499322220683,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.17124998942017555,
       "step": 16
     },
     {
+      "completion_length": 454.9375,
       "epoch": 3.0,
+      "grad_norm": 1.4734266996383667,
+      "kl": 0.015171069288044237,
       "learning_rate": 1.8311791536769483e-07,
       "loss": 0.0,
+      "reward": 1.820919245481491,
+      "reward_std": 1.901282200589776,
+      "rewards/concensus_correctness_reward_func": 1.2738749999552965,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.40041930228471756,
+      "rewards/soft_format_reward_func": 0.015625,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.13099999353289604,
       "step": 18
     },
     {
+      "completion_length": 447.5625,
       "epoch": 3.3333333333333335,
+      "grad_norm": 1.9561309814453125,
+      "kl": 0.027638212544843554,
       "learning_rate": 1.328978898250525e-07,
       "loss": 0.0,
+      "reward": 1.6138426065444946,
+      "reward_std": 2.08666705340147,
+      "rewards/concensus_correctness_reward_func": 0.625,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.1875,
+      "rewards/question_recreation_reward_func": 0.3899675915017724,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.41137499921023846,
       "step": 20
     },
     {
+      "completion_length": 313.5,
       "epoch": 3.6666666666666665,
+      "grad_norm": 2.4282801151275635,
+      "kl": 0.02601044374750927,
       "learning_rate": 8.81534288045431e-08,
       "loss": 0.0,
+      "reward": 0.7636516839265823,
+      "reward_std": 1.200943410396576,
+      "rewards/concensus_correctness_reward_func": 0.05081249959766865,
+      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.3807766861282289,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.2070624940097332,
       "step": 22
     },
     {
+      "completion_length": 348.625,
       "epoch": 4.0,
+      "grad_norm": 3.557086706161499,
+      "kl": 0.025902074296027422,
       "learning_rate": 5.097673357358906e-08,
       "loss": 0.0,
+      "reward": 0.7689573541283607,
+      "reward_std": 1.0340721681714058,
+      "rewards/concensus_correctness_reward_func": 0.024937499314546585,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.43936359975486994,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.1171562522649765,
       "step": 24
     },
     {
+      "completion_length": 443.53125,
       "epoch": 4.333333333333333,
+      "grad_norm": 1.6169641017913818,
+      "kl": 0.01715872809290886,
       "learning_rate": 2.3106145082260774e-08,
       "loss": 0.0,
+      "reward": 0.7657004399225116,
+      "reward_std": 0.7439820282161236,
+      "rewards/concensus_correctness_reward_func": 0.0078125,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.5021067075431347,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.06828123982995749,
       "step": 26
     },
     {
+      "completion_length": 301.0,
       "epoch": 4.666666666666667,
+      "grad_norm": 2.6919360160827637,
+      "kl": 0.022670619655400515,
       "learning_rate": 5.844861072478335e-09,
       "loss": 0.0,
+      "reward": 0.8254948575049639,
+      "reward_std": 0.9493589596822858,
+      "rewards/concensus_correctness_reward_func": 0.02250000089406967,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.43468233942985535,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.18081250321120024,
       "step": 28
     },
     {
+      "completion_length": 339.40625,
       "epoch": 5.0,
+      "grad_norm": 3.3629519939422607,
+      "kl": 0.04183358867885545,
       "learning_rate": 0.0,
       "loss": 0.0,
+      "reward": 1.6037534587085247,
+      "reward_std": 1.9255643365904689,
+      "rewards/concensus_correctness_reward_func": 0.6506249997764826,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.432628508657217,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.015625,
+      "rewards/xmlcount_reward_func": 0.3173750042915344,
       "step": 30
     },
     {
       "epoch": 5.0,
       "step": 30,
       "total_flos": 0.0,
+      "train_loss": 2.5961448712526666e-05,
+      "train_runtime": 902.7895,
+      "train_samples_per_second": 0.532,
+      "train_steps_per_second": 0.033
     }
   ],
   "logging_steps": 2,