PyTorch
llama
vitiugin commited on
Commit
66c3229
·
verified ·
1 Parent(s): ac84dac

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -67,6 +67,6 @@ The model utilizes Gemma-3 tokenizer — a SentencePiece tokenizer with a 262K v
67
  The model was trained using the Megatron-LM framework on the LUMI HPC supercomputer. The training utilized 256 AMD MI250x nodes, totaling approximately 700000 GPU hours.
68
 
69
  # Intermediate Checkpoints
70
- We have released intermediate checkpoints to provide access to the model's training progression. These checkpoints are available in separate branches, with a new checkpoint released every 5000 training steps.
71
 
72
- The naming convention is `iter_0xxxxx00`. For example, the checkpoint for 50000 iterations is named `iter_0050000`. The available checkpoints range from `iter_0005000` up to `iter_0953675`. The final checkpoint, `iter_0953675`, is located in the main branch.
 
67
  The model was trained using the Megatron-LM framework on the LUMI HPC supercomputer. The training utilized 256 AMD MI250x nodes, totaling approximately 700000 GPU hours.
68
 
69
  # Intermediate Checkpoints
70
+ We have released intermediate checkpoints to provide access to the model's training progression. These checkpoints are available in separate branches, with a new checkpoint released every 10000 training steps.
71
 
72
+ The naming convention is `iter_0xxxxx00`. For example, the checkpoint for 50000 iterations is named `iter_0050000`. The available checkpoints range from `iter_0010000` up to `iter_0953675`. The final checkpoint, `iter_0953675`, is located in the main branch.