Instructions to use elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan")
messages = [
    {"role": "user", "content": "Who are you?"},
]
pipe(messages)

# Load model directly
from transformers import AutoTokenizer, AutoModelForMultimodalLM

tokenizer = AutoTokenizer.from_pretrained("elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan")
model = AutoModelForMultimodalLM.from_pretrained("elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan")
messages = [
    {"role": "user", "content": "Who are you?"},
]
inputs = tokenizer.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Inference
Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker

docker model run hf.co/elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan

SGLang

How to use elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan",
		"messages": [
			{
				"role": "user",
				"content": "What is the capital of France?"
			}
		]
	}'

Unsloth Studio

How to use elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan with Unsloth Studio:

Install Unsloth Studio (macOS, Linux, WSL)

curl -fsSL https://unsloth.ai/install.sh | sh
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan to start chatting

Install Unsloth Studio (Windows)

irm https://unsloth.ai/install.ps1 | iex
# Run unsloth studio
unsloth studio -H 0.0.0.0 -p 8888
# Then open http://localhost:8888 in your browser
# Search for elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan to start chatting

Using HuggingFace Spaces for Unsloth

# No setup required
# Open https://huggingface.co/spaces/unsloth/studio in your browser
# Search for elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan to start chatting

Load model with FastModel

pip install unsloth
from unsloth import FastModel
model, tokenizer = FastModel.from_pretrained(
    model_name="elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan",
    max_seq_length=2048,
)

Docker Model Runner
How to use elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan with Docker Model Runner:
```
docker model run hf.co/elsvastika/Qwen2.5-0.5B-Instruct-Gensyn-Swarm-graceful_wary_orangutan
```

elsvastika commited on Jun 20, 2025

Commit

aeef55a

verified ·

1 Parent(s): 3a8df79

End of training

Browse files

Files changed (5) hide show

adapter_config.json +5 -5
adapter_model.safetensors +1 -1
all_results.json +4 -4
train_results.json +4 -4
trainer_state.json +229 -229

adapter_config.json CHANGED Viewed

@@ -24,13 +24,13 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "q_proj",
-    "v_proj",
-    "o_proj",
-    "up_proj",
     "k_proj",
     "down_proj",
-    "gate_proj"
   ],
   "task_type": "CAUSAL_LM",
   "trainable_token_indices": null,

   "rank_pattern": {},
   "revision": null,
   "target_modules": [
     "k_proj",
+    "gate_proj",
     "down_proj",
+    "o_proj",
+    "q_proj",
+    "v_proj",
+    "up_proj"
   ],
   "task_type": "CAUSAL_LM",
   "trainable_token_indices": null,

adapter_model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:ea0066643b5c7a008a43b18406297d57afef4b789d6c460b1575b9f229838217
 size 35237104

 version https://git-lfs.github.com/spec/v1
+oid sha256:ead40382b37ef28866c5216b320811ecf7182ed340ceccf63d8e53db5fc12a0d
 size 35237104

all_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 1.329912218352547e-05,
-    "train_runtime": 1430.4943,
     "train_samples": 36,
-    "train_samples_per_second": 0.559,
-    "train_steps_per_second": 0.035
 }

 {
     "total_flos": 0.0,
+    "train_loss": 2.602725280667073e-06,
+    "train_runtime": 1884.3714,
     "train_samples": 36,
+    "train_samples_per_second": 0.425,
+    "train_steps_per_second": 0.027
 }

train_results.json CHANGED Viewed

@@ -1,8 +1,8 @@
 {
     "total_flos": 0.0,
-    "train_loss": 1.329912218352547e-05,
-    "train_runtime": 1430.4943,
     "train_samples": 36,
-    "train_samples_per_second": 0.559,
-    "train_steps_per_second": 0.035
 }

 {
     "total_flos": 0.0,
+    "train_loss": 2.602725280667073e-06,
+    "train_runtime": 1884.3714,
     "train_samples": 36,
+    "train_samples_per_second": 0.425,
+    "train_steps_per_second": 0.027
 }

trainer_state.json CHANGED Viewed

@@ -9,488 +9,488 @@
   "is_world_process_zero": true,
   "log_history": [
     {
-      "completion_length": 310.59375,
       "epoch": 0.2222222222222222,
-      "grad_norm": 3.339179039001465,
-      "kl": 0.00220046652975725,
       "learning_rate": 5e-07,
       "loss": 0.0,
-      "reward": 0.505463638342917,
-      "reward_std": 0.7339840941131115,
-      "rewards/concensus_correctness_reward_func": 0.0520625002682209,
       "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.38868238124996424,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.0022187503054738045,
       "step": 2
     },
     {
-      "completion_length": 419.90625,
       "epoch": 0.4444444444444444,
-      "grad_norm": 3.2956769466400146,
-      "kl": 0.002407546649919823,
       "learning_rate": 4.978612153434526e-07,
       "loss": 0.0,
-      "reward": 0.6525783967226744,
-      "reward_std": 0.8637805320322514,
-      "rewards/concensus_correctness_reward_func": 0.0078125,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.36248464696109295,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.282281250692904,
       "step": 4
     },
     {
-      "completion_length": 378.875,
       "epoch": 0.6666666666666666,
-      "grad_norm": 5.693077564239502,
-      "kl": 0.0038703840982634574,
       "learning_rate": 4.91481456572267e-07,
       "loss": 0.0,
-      "reward": 0.4699799604713917,
-      "reward_std": 0.8145590871572495,
-      "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.2522612172178924,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.09271874651312828,
       "step": 6
     },
     {
-      "completion_length": 319.6875,
       "epoch": 0.8888888888888888,
-      "grad_norm": 37.4881477355957,
-      "kl": 0.002629337235703133,
       "learning_rate": 4.809698831278217e-07,
       "loss": 0.0,
-      "reward": 0.39716565515846014,
-      "reward_std": 0.40655731689184904,
-      "rewards/concensus_correctness_reward_func": 0.0,
-      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.20960316061973572,
-      "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.12506249826401472,
       "step": 8
     },
     {
-      "completion_length": 374.4375,
       "epoch": 1.1111111111111112,
-      "grad_norm": 1.7816643714904785,
-      "kl": 0.0029886640986660495,
       "learning_rate": 4.6650635094610966e-07,
       "loss": 0.0,
-      "reward": 1.0157426372170448,
-      "reward_std": 1.9730686051771045,
       "rewards/concensus_correctness_reward_func": 0.625,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.30977389705367386,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.018468749709427357,
       "step": 10
     },
     {
-      "completion_length": 364.5625,
       "epoch": 1.3333333333333333,
-      "grad_norm": 1.759390115737915,
-      "kl": 0.024789645758573897,
       "learning_rate": 4.483383350728088e-07,
       "loss": 0.0,
-      "reward": 1.3979490585625172,
-      "reward_std": 1.9438073448836803,
       "rewards/concensus_correctness_reward_func": 0.625,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.125,
-      "rewards/question_recreation_reward_func": 0.4405428171157837,
       "rewards/soft_format_reward_func": 0.0,
-      "rewards/strict_format_reward_func": 0.015625,
-      "rewards/xmlcount_reward_func": 0.19178124889731407,
       "step": 12
     },
     {
-      "completion_length": 283.0625,
       "epoch": 1.5555555555555556,
-      "grad_norm": 1.7168656587600708,
-      "kl": 0.008998825054732151,
       "learning_rate": 4.2677669529663686e-07,
       "loss": 0.0,
-      "reward": 0.41254502069205046,
-      "reward_std": 0.7886469536460936,
-      "rewards/concensus_correctness_reward_func": 0.02775000035762787,
-      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.3695450024679303,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": -0.04725001705810428,
       "step": 14
     },
     {
-      "completion_length": 359.96875,
       "epoch": 1.7777777777777777,
-      "grad_norm": 5.03432559967041,
-      "kl": 0.0018746748610283248,
       "learning_rate": 4.0219035725218013e-07,
       "loss": 0.0,
-      "reward": 0.3724270681850612,
-      "reward_std": 0.494869836140424,
       "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.2052395585924387,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.10468750540167093,
       "step": 16
     },
     {
-      "completion_length": 408.0,
       "epoch": 2.0,
-      "grad_norm": 2.7778327465057373,
-      "kl": 0.0016905219381442294,
       "learning_rate": 3.75e-07,
       "loss": 0.0,
-      "reward": 0.329451153986156,
-      "reward_std": 0.4738281946629286,
-      "rewards/concensus_correctness_reward_func": 0.041874999180436134,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.20610739896073937,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.08146874979138374,
       "step": 18
     },
     {
-      "completion_length": 464.59375,
       "epoch": 2.2222222222222223,
-      "grad_norm": 1.066009283065796,
-      "kl": 0.0025927265523932874,
       "learning_rate": 3.4567085809127245e-07,
       "loss": 0.0,
-      "reward": 0.49774682335555553,
-      "reward_std": 0.8962460388429463,
       "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.125,
-      "rewards/question_recreation_reward_func": 0.26368432119488716,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.10906250029802322,
       "step": 20
     },
     {
-      "completion_length": 389.28125,
       "epoch": 2.4444444444444446,
-      "grad_norm": 36.894840240478516,
-      "kl": 0.004065055079990998,
       "learning_rate": 3.147047612756302e-07,
       "loss": 0.0,
-      "reward": 0.4637224329635501,
-      "reward_std": 0.8444120436906815,
-      "rewards/concensus_correctness_reward_func": 0.017374999821186066,
-      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.3302849377505481,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": -0.008937500417232513,
       "step": 22
     },
     {
-      "completion_length": 327.0,
       "epoch": 2.6666666666666665,
-      "grad_norm": 1.6209214925765991,
-      "kl": 0.002170395731809549,
       "learning_rate": 2.826315480550129e-07,
       "loss": 0.0,
-      "reward": 1.135412285104394,
-      "reward_std": 1.4107526964507997,
-      "rewards/concensus_correctness_reward_func": 0.6328125,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.3428184613585472,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.09728125482797623,
       "step": 24
     },
     {
-      "completion_length": 467.4375,
       "epoch": 2.888888888888889,
-      "grad_norm": 2.3911375999450684,
-      "kl": 0.003205567234545015,
       "learning_rate": 2.5e-07,
       "loss": 0.0,
-      "reward": 0.5562636330723763,
-      "reward_std": 0.7715275008231401,
-      "rewards/concensus_correctness_reward_func": 0.03125,
-      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.25360737927258015,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.20890625473111868,
       "step": 26
     },
     {
-      "completion_length": 372.21875,
       "epoch": 3.111111111111111,
-      "grad_norm": 1.7783877849578857,
-      "kl": 0.002813300772686489,
       "learning_rate": 2.1736845194498716e-07,
       "loss": 0.0,
-      "reward": 0.3571828817948699,
-      "reward_std": 0.6381514547392726,
-      "rewards/concensus_correctness_reward_func": 0.0,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.2489016242325306,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.10828124824911356,
       "step": 28
     },
     {
-      "completion_length": 340.53125,
       "epoch": 3.3333333333333335,
-      "grad_norm": 3.581003189086914,
-      "kl": 0.003972893173340708,
       "learning_rate": 1.8529523872436977e-07,
       "loss": 0.0,
-      "reward": 0.46338015946093947,
-      "reward_std": 0.36665081686805934,
-      "rewards/concensus_correctness_reward_func": 0.0,
-      "rewards/consensus_reward_func": 0.25,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.11578641866799444,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.09759374894201756,
       "step": 30
     },
     {
-      "completion_length": 356.15625,
       "epoch": 3.5555555555555554,
-      "grad_norm": 1.695011854171753,
-      "kl": 0.0035125780559610575,
       "learning_rate": 1.5432914190872756e-07,
       "loss": 0.0,
-      "reward": 0.7297059465199709,
-      "reward_std": 0.7175617795437574,
-      "rewards/concensus_correctness_reward_func": 0.025124999228864908,
-      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.38339345483109355,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.25868750538211316,
       "step": 32
     },
     {
-      "completion_length": 394.84375,
       "epoch": 3.7777777777777777,
-      "grad_norm": 1.7476495504379272,
-      "kl": 0.002194411586970091,
       "learning_rate": 1.2500000000000005e-07,
       "loss": 0.0,
-      "reward": 0.9532530829310417,
-      "reward_std": 2.4433598071336746,
-      "rewards/concensus_correctness_reward_func": 0.625,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.125,
-      "rewards/question_recreation_reward_func": 0.32947181165218353,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": -0.12621875014156103,
       "step": 34
     },
     {
-      "completion_length": 327.46875,
       "epoch": 4.0,
-      "grad_norm": 3.432976007461548,
-      "kl": 0.0031212843605317175,
       "learning_rate": 9.780964274781983e-08,
       "loss": 0.0,
-      "reward": 0.738374256528914,
-      "reward_std": 0.8971706181764603,
-      "rewards/concensus_correctness_reward_func": 0.023000000044703484,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.1875,
-      "rewards/question_recreation_reward_func": 0.3314367765560746,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.19643749855458736,
       "step": 36
     },
     {
-      "completion_length": 346.1875,
       "epoch": 4.222222222222222,
-      "grad_norm": 1.5874297618865967,
-      "kl": 0.2136711298226146,
       "learning_rate": 7.322330470336313e-08,
-      "loss": 0.0002,
-      "reward": 0.39635675214231014,
-      "reward_std": 0.42327653244137764,
-      "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.3218567566946149,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.07449999824166298,
       "step": 38
     },
     {
-      "completion_length": 505.5625,
       "epoch": 4.444444444444445,
-      "grad_norm": 3.08534574508667,
-      "kl": 0.004145073915424291,
       "learning_rate": 5.166166492719124e-08,
       "loss": 0.0,
-      "reward": 1.044302866794169,
-      "reward_std": 2.2565943766385317,
-      "rewards/concensus_correctness_reward_func": 0.625,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.1875,
-      "rewards/question_recreation_reward_func": 0.3644591988995671,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": -0.13265625340864062,
       "step": 40
     },
     {
-      "completion_length": 337.1875,
       "epoch": 4.666666666666667,
-      "grad_norm": 2.696601390838623,
-      "kl": 0.02457158363540657,
       "learning_rate": 3.349364905389032e-08,
       "loss": 0.0,
-      "reward": 0.45350043289363384,
-      "reward_std": 0.5375348571687937,
-      "rewards/concensus_correctness_reward_func": 0.027374999597668648,
-      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.20012545119971037,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.22599999932572246,
       "step": 42
     },
     {
-      "completion_length": 306.28125,
       "epoch": 4.888888888888889,
-      "grad_norm": 4.503120422363281,
-      "kl": 0.0020713139383587986,
       "learning_rate": 1.9030116872178314e-08,
       "loss": 0.0,
-      "reward": 0.6106238011270761,
-      "reward_std": 1.0308472346514463,
-      "rewards/concensus_correctness_reward_func": 0.11212500184774399,
-      "rewards/consensus_reward_func": 0.125,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.23981129564344883,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.07118749804794788,
       "step": 44
     },
     {
-      "completion_length": 361.125,
       "epoch": 5.111111111111111,
-      "grad_norm": 2.2458155155181885,
-      "kl": 0.002618852799059823,
       "learning_rate": 8.518543427732949e-09,
       "loss": 0.0,
-      "reward": 0.21945261908695102,
-      "reward_std": 0.932020288426429,
-      "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0625,
-      "rewards/question_recreation_reward_func": 0.31442134268581867,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": -0.1574687361717224,
       "step": 46
     },
     {
-      "completion_length": 439.25,
       "epoch": 5.333333333333333,
-      "grad_norm": 1.9509912729263306,
-      "kl": 0.0015792827180121094,
       "learning_rate": 2.1387846565474044e-09,
       "loss": 0.0,
-      "reward": 0.2157846470363438,
-      "reward_std": 0.3729682918637991,
-      "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.0,
-      "rewards/question_recreation_reward_func": 0.19044090481474996,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.025343746412545443,
       "step": 48
     },
     {
-      "completion_length": 310.125,
       "epoch": 5.555555555555555,
-      "grad_norm": 2.523566961288452,
-      "kl": 0.00472318816173356,
       "learning_rate": 0.0,
       "loss": 0.0,
-      "reward": 2.1371736619621515,
-      "reward_std": 2.20895239058882,
-      "rewards/concensus_correctness_reward_func": 1.3234999999403954,
-      "rewards/consensus_reward_func": 0.1875,
       "rewards/cumulative_reward_2": 0.0,
-      "rewards/final_correctness_reward_func": 0.125,
-      "rewards/question_recreation_reward_func": 0.27282989490777254,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
-      "rewards/xmlcount_reward_func": 0.22834375477395952,
       "step": 50
     },
     {
       "epoch": 5.555555555555555,
       "step": 50,
       "total_flos": 0.0,
-      "train_loss": 1.329912218352547e-05,
-      "train_runtime": 1430.4943,
-      "train_samples_per_second": 0.559,
-      "train_steps_per_second": 0.035
     }
   ],
   "logging_steps": 2,

   "is_world_process_zero": true,
   "log_history": [
     {
+      "completion_length": 254.0,
       "epoch": 0.2222222222222222,
+      "grad_norm": 2.455533266067505,
+      "kl": 0.0016071582067525014,
       "learning_rate": 5e-07,
       "loss": 0.0,
+      "reward": 0.8821750227361917,
+      "reward_std": 0.7979278466664255,
+      "rewards/concensus_correctness_reward_func": 0.049937501549720764,
       "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.3125,
+      "rewards/question_recreation_reward_func": 0.26773752458393574,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.1895000054500997,
       "step": 2
     },
     {
+      "completion_length": 369.3125,
       "epoch": 0.4444444444444444,
+      "grad_norm": 2.520486354827881,
+      "kl": 0.0038820735207991675,
       "learning_rate": 4.978612153434526e-07,
       "loss": 0.0,
+      "reward": 0.3699257434345782,
+      "reward_std": 0.5709783472120762,
+      "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.19958198571112007,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.17034375481307507,
       "step": 4
     },
     {
+      "completion_length": 467.875,
       "epoch": 0.6666666666666666,
+      "grad_norm": 1.3698705434799194,
+      "kl": 0.0013275225574034266,
       "learning_rate": 4.91481456572267e-07,
       "loss": 0.0,
+      "reward": 0.6990349255502224,
+      "reward_std": 0.9675047248601913,
+      "rewards/concensus_correctness_reward_func": 0.046875,
       "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0625,
+      "rewards/question_recreation_reward_func": 0.33225369080901146,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.19490624405443668,
       "step": 6
     },
     {
+      "completion_length": 323.34375,
       "epoch": 0.8888888888888888,
+      "grad_norm": 2.7056479454040527,
+      "kl": 0.00173920994711807,
       "learning_rate": 4.809698831278217e-07,
       "loss": 0.0,
+      "reward": 0.5385207324288785,
+      "reward_std": 0.8355418732389808,
+      "rewards/concensus_correctness_reward_func": 0.02787500061094761,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.2965519982390106,
+      "rewards/soft_format_reward_func": 0.015625,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.07346874848008156,
       "step": 8
     },
     {
+      "completion_length": 276.09375,
       "epoch": 1.1111111111111112,
+      "grad_norm": 3.8186511993408203,
+      "kl": 0.0028932989152963273,
       "learning_rate": 4.6650635094610966e-07,
       "loss": 0.0,
+      "reward": 1.1083624437451363,
+      "reward_std": 1.7071605939418077,
       "rewards/concensus_correctness_reward_func": 0.625,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.1875,
+      "rewards/question_recreation_reward_func": 0.25786245451308787,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.03799999970942736,
       "step": 10
     },
     {
+      "completion_length": 255.59375,
       "epoch": 1.3333333333333333,
+      "grad_norm": 34.07455062866211,
+      "kl": 0.0037407633935799822,
       "learning_rate": 4.483383350728088e-07,
       "loss": 0.0,
+      "reward": 1.2880361340939999,
+      "reward_std": 1.625240983441472,
       "rewards/concensus_correctness_reward_func": 0.625,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.32416112907230854,
       "rewards/soft_format_reward_func": 0.0,
+      "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.15137499663978815,
       "step": 12
     },
     {
+      "completion_length": 285.21875,
       "epoch": 1.5555555555555556,
+      "grad_norm": 3.052701234817505,
+      "kl": 0.002863182016881183,
       "learning_rate": 4.2677669529663686e-07,
       "loss": 0.0,
+      "reward": 0.607268082909286,
+      "reward_std": 0.6088872440159321,
+      "rewards/concensus_correctness_reward_func": 0.022187499329447746,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.38814307004213333,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.19693750143051147,
       "step": 14
     },
     {
+      "completion_length": 347.65625,
       "epoch": 1.7777777777777777,
+      "grad_norm": 5.15467643737793,
+      "kl": 0.0014800850040046498,
       "learning_rate": 4.0219035725218013e-07,
       "loss": 0.0,
+      "reward": 0.1809218251146376,
+      "reward_std": 0.7999278882052749,
       "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0625,
+      "rewards/question_recreation_reward_func": 0.2310780775733292,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": -0.112656245008111,
       "step": 16
     },
     {
+      "completion_length": 441.25,
       "epoch": 2.0,
+      "grad_norm": 4.815533638000488,
+      "kl": 0.0013374313130043447,
       "learning_rate": 3.75e-07,
       "loss": 0.0,
+      "reward": 0.5386425573378801,
+      "reward_std": 0.6832009451463819,
+      "rewards/concensus_correctness_reward_func": 0.046875,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.23683004680788144,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.19243750348687172,
       "step": 18
     },
     {
+      "completion_length": 437.25,
       "epoch": 2.2222222222222223,
+      "grad_norm": 2.5218758583068848,
+      "kl": 0.0015388188403449021,
       "learning_rate": 3.4567085809127245e-07,
       "loss": 0.0,
+      "reward": 0.7281985133886337,
+      "reward_std": 0.6127606704831123,
       "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.45726102218031883,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.2709374986588955,
       "step": 20
     },
     {
+      "completion_length": 387.75,
       "epoch": 2.4444444444444446,
+      "grad_norm": 1.3259650468826294,
+      "kl": 0.0036219921821611933,
       "learning_rate": 3.147047612756302e-07,
       "loss": 0.0,
+      "reward": 0.2731318287551403,
+      "reward_std": 0.2530765999108553,
+      "rewards/concensus_correctness_reward_func": 0.0,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.20441308384761214,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.06871875282377005,
       "step": 22
     },
     {
+      "completion_length": 447.09375,
       "epoch": 2.6666666666666665,
+      "grad_norm": 6.329639434814453,
+      "kl": 0.0021589112002402544,
       "learning_rate": 2.826315480550129e-07,
       "loss": 0.0,
+      "reward": 1.2416966576129198,
+      "reward_std": 2.0539041608572006,
+      "rewards/concensus_correctness_reward_func": 0.625,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.1875,
+      "rewards/question_recreation_reward_func": 0.3013216257095337,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.1278750030323863,
       "step": 24
     },
     {
+      "completion_length": 301.875,
       "epoch": 2.888888888888889,
+      "grad_norm": 4.056438446044922,
+      "kl": 0.0024828215537127107,
       "learning_rate": 2.5e-07,
       "loss": 0.0,
+      "reward": 0.2829342377372086,
+      "reward_std": 0.33365900977514684,
+      "rewards/concensus_correctness_reward_func": 0.0,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.1184342410415411,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.16449999809265137,
       "step": 26
     },
     {
+      "completion_length": 341.15625,
       "epoch": 3.111111111111111,
+      "grad_norm": 2.550891876220703,
+      "kl": 0.002100169222103432,
       "learning_rate": 2.1736845194498716e-07,
       "loss": 0.0,
+      "reward": 0.3925126292742789,
+      "reward_std": 0.7323208572342992,
+      "rewards/concensus_correctness_reward_func": 0.014562499709427357,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.29879387514665723,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.016656249528750777,
       "step": 28
     },
     {
+      "completion_length": 388.03125,
       "epoch": 3.3333333333333335,
+      "grad_norm": 1.4323590993881226,
+      "kl": 0.004696541313023772,
       "learning_rate": 1.8529523872436977e-07,
       "loss": 0.0,
+      "reward": 0.05710854474455118,
+      "reward_std": 0.5547531270422041,
+      "rewards/concensus_correctness_reward_func": 0.0078125,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.19385854969732463,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": -0.20706249913200736,
       "step": 30
     },
     {
+      "completion_length": 352.90625,
       "epoch": 3.5555555555555554,
+      "grad_norm": 2.221634864807129,
+      "kl": 0.002907156704168301,
       "learning_rate": 1.5432914190872756e-07,
       "loss": 0.0,
+      "reward": 0.3871938968077302,
+      "reward_std": 0.3934658619109541,
+      "rewards/concensus_correctness_reward_func": 0.0,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.2629126524552703,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.1242812555283308,
       "step": 32
     },
     {
+      "completion_length": 384.375,
       "epoch": 3.7777777777777777,
+      "grad_norm": 2.7794787883758545,
+      "kl": 0.001867200349806808,
       "learning_rate": 1.2500000000000005e-07,
       "loss": 0.0,
+      "reward": 0.9573859982192516,
+      "reward_std": 1.0359943909570575,
+      "rewards/concensus_correctness_reward_func": 0.11443750280886889,
+      "rewards/consensus_reward_func": 0.1875,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0625,
+      "rewards/question_recreation_reward_func": 0.3830109708942473,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.20993749890476465,
       "step": 34
     },
     {
+      "completion_length": 361.375,
       "epoch": 4.0,
+      "grad_norm": 3.378568172454834,
+      "kl": 0.0019658175588119775,
       "learning_rate": 9.780964274781983e-08,
       "loss": 0.0,
+      "reward": 0.550561910495162,
+      "reward_std": 0.5597149441018701,
+      "rewards/concensus_correctness_reward_func": 0.03125,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.27071817917749286,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.12359375134110451,
       "step": 36
     },
     {
+      "completion_length": 282.96875,
       "epoch": 4.222222222222222,
+      "grad_norm": 4.209115505218506,
+      "kl": 0.0013284565284266137,
       "learning_rate": 7.322330470336313e-08,
+      "loss": 0.0,
+      "reward": 1.8079969780519605,
+      "reward_std": 2.005708161741495,
+      "rewards/concensus_correctness_reward_func": 1.268062500283122,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.25,
+      "rewards/question_recreation_reward_func": 0.20130947075085714,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.08862500544637442,
       "step": 38
     },
     {
+      "completion_length": 431.4375,
       "epoch": 4.444444444444445,
+      "grad_norm": 29.043092727661133,
+      "kl": 0.003590297739719972,
       "learning_rate": 5.166166492719124e-08,
       "loss": 0.0,
+      "reward": 0.5267084827646613,
+      "reward_std": 0.684504278935492,
+      "rewards/concensus_correctness_reward_func": 0.0,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0625,
+      "rewards/question_recreation_reward_func": 0.35548973828554153,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.10871875286102295,
       "step": 40
     },
     {
+      "completion_length": 384.59375,
       "epoch": 4.666666666666667,
+      "grad_norm": 29.70347785949707,
+      "kl": 0.001960429195605684,
       "learning_rate": 3.349364905389032e-08,
       "loss": 0.0,
+      "reward": 1.234227987471968,
+      "reward_std": 1.9329941319301724,
+      "rewards/concensus_correctness_reward_func": 0.6629374995827675,
+      "rewards/consensus_reward_func": 0.0625,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.125,
+      "rewards/question_recreation_reward_func": 0.257196772727184,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.12659375229850411,
       "step": 42
     },
     {
+      "completion_length": 364.0625,
       "epoch": 4.888888888888889,
+      "grad_norm": 55.00151062011719,
+      "kl": 0.002629825277836062,
       "learning_rate": 1.9030116872178314e-08,
       "loss": 0.0,
+      "reward": 0.5272765271365643,
+      "reward_std": 0.8430194035172462,
+      "rewards/concensus_correctness_reward_func": 0.01837499998509884,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0625,
+      "rewards/question_recreation_reward_func": 0.31580778677016497,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.13059375621378422,
       "step": 44
     },
     {
+      "completion_length": 304.40625,
       "epoch": 5.111111111111111,
+      "grad_norm": 42.15534973144531,
+      "kl": 0.005508741844096221,
       "learning_rate": 8.518543427732949e-09,
       "loss": 0.0,
+      "reward": 0.4785704296082258,
+      "reward_std": 0.8159382930025458,
+      "rewards/concensus_correctness_reward_func": 0.01837499998509884,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
       "rewards/final_correctness_reward_func": 0.0625,
+      "rewards/question_recreation_reward_func": 0.33713291585445404,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.06056249886751175,
       "step": 46
     },
     {
+      "completion_length": 353.375,
       "epoch": 5.333333333333333,
+      "grad_norm": 6.933172225952148,
+      "kl": 0.002127421241311822,
       "learning_rate": 2.1387846565474044e-09,
       "loss": 0.0,
+      "reward": 0.6708917245268822,
+      "reward_std": 0.9302016571164131,
+      "rewards/concensus_correctness_reward_func": 0.006812499836087227,
       "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.3125,
+      "rewards/question_recreation_reward_func": 0.2251729667186737,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.1264062523841858,
       "step": 48
     },
     {
+      "completion_length": 346.9375,
       "epoch": 5.555555555555555,
+      "grad_norm": 7.681344985961914,
+      "kl": 0.0038058556092437357,
       "learning_rate": 0.0,
       "loss": 0.0,
+      "reward": 0.41686041094362736,
+      "reward_std": 0.7147915656678379,
+      "rewards/concensus_correctness_reward_func": 0.0,
+      "rewards/consensus_reward_func": 0.0,
       "rewards/cumulative_reward_2": 0.0,
+      "rewards/final_correctness_reward_func": 0.0,
+      "rewards/question_recreation_reward_func": 0.2795791446696967,
       "rewards/soft_format_reward_func": 0.0,
       "rewards/strict_format_reward_func": 0.0,
+      "rewards/xmlcount_reward_func": 0.13728125765919685,
       "step": 50
     },
     {
       "epoch": 5.555555555555555,
       "step": 50,
       "total_flos": 0.0,
+      "train_loss": 2.602725280667073e-06,
+      "train_runtime": 1884.3714,
+      "train_samples_per_second": 0.425,
+      "train_steps_per_second": 0.027
     }
   ],
   "logging_steps": 2,