ikedachin commited on
Commit
83545ea
·
verified ·
1 Parent(s): 7bc9bce

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -5
README.md CHANGED
@@ -23,7 +23,8 @@ language:
23
  - **Language(s):** Multilingual (primarily tested on English/Japanese/Reasoning tasks)
24
  - **License:** Apache 2.0
25
  - **Training Algorithm:** GRPO (via TRL and Unsloth)
26
-
 
27
 
28
  This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
29
 
@@ -55,13 +56,13 @@ The use of the **ThinkStation PGX** allows for:
55
 
56
  The model was trained using the GRPO algorithm, which optimizes the policy by comparing a group of outputs against each other based on reward functions (e.g., accuracy for math/logic or format consistency) without requiring a separate value function (critic model).
57
 
58
- ### Training Hyperparameters (Example)
59
  - **Learning Rate:** 5e-6
60
  - **Batch Size:** 1
61
- - **Gradient Accumulation Steps:** 4
62
  - **Num Generations (G):** 8
63
  - **Max Sequence Length:** 2048
64
- - **Optimizer:** AdamW
65
 
66
  ## How to use
67
 
@@ -72,7 +73,7 @@ from unsloth import FastLanguageModel
72
  import torch
73
 
74
  model, tokenizer = FastLanguageModel.from_pretrained(
75
- model_name = "your-username/your-model-name",
76
  max_seq_length = 2048,
77
  load_in_4bit = True,
78
  )
 
23
  - **Language(s):** Multilingual (primarily tested on English/Japanese/Reasoning tasks)
24
  - **License:** Apache 2.0
25
  - **Training Algorithm:** GRPO (via TRL and Unsloth)
26
+ - **Purpose:** **Environment Validation / Proof of Concept**
27
+ - This model was primarily developed to verify the successful setup and integration of the **ThinkStation PGX(GB10 Blackwell)** local environment with the Unsloth/GRPO training pipeline.
28
 
29
  This qwen2 model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
30
 
 
56
 
57
  The model was trained using the GRPO algorithm, which optimizes the policy by comparing a group of outputs against each other based on reward functions (e.g., accuracy for math/logic or format consistency) without requiring a separate value function (critic model).
58
 
59
+ ### Training Hyperparameters
60
  - **Learning Rate:** 5e-6
61
  - **Batch Size:** 1
62
+ - **Gradient Accumulation Steps:** 1
63
  - **Num Generations (G):** 8
64
  - **Max Sequence Length:** 2048
65
+ - **Optimizer:** AdamW_8bit
66
 
67
  ## How to use
68
 
 
73
  import torch
74
 
75
  model, tokenizer = FastLanguageModel.from_pretrained(
76
+ model_name = "ikedachin/qwen_finetune_16bit_unsloth_gb10",
77
  max_seq_length = 2048,
78
  load_in_4bit = True,
79
  )