Update README.md
Browse files
README.md
CHANGED
|
@@ -67,6 +67,6 @@ The model utilizes Gemma-3 tokenizer — a SentencePiece tokenizer with a 262K v
|
|
| 67 |
The model was trained using the Megatron-LM framework on the LUMI HPC supercomputer. The training utilized 256 AMD MI250x nodes, totaling approximately 700000 GPU hours.
|
| 68 |
|
| 69 |
# Intermediate Checkpoints
|
| 70 |
-
We have released intermediate checkpoints to provide access to the model's training progression. These checkpoints are available in separate branches, with a new checkpoint released every
|
| 71 |
|
| 72 |
-
The naming convention is `iter_0xxxxx00`. For example, the checkpoint for 50000 iterations is named `iter_0050000`. The available checkpoints range from `
|
|
|
|
| 67 |
The model was trained using the Megatron-LM framework on the LUMI HPC supercomputer. The training utilized 256 AMD MI250x nodes, totaling approximately 700000 GPU hours.
|
| 68 |
|
| 69 |
# Intermediate Checkpoints
|
| 70 |
+
We have released intermediate checkpoints to provide access to the model's training progression. These checkpoints are available in separate branches, with a new checkpoint released every 10000 training steps.
|
| 71 |
|
| 72 |
+
The naming convention is `iter_0xxxxx00`. For example, the checkpoint for 50000 iterations is named `iter_0050000`. The available checkpoints range from `iter_0010000` up to `iter_0953675`. The final checkpoint, `iter_0953675`, is located in the main branch.
|