Hugging Face's logo

Spaces:
Meta-HF-hackathon
/
updated-policy
Sleeping

App Files Community
updated-policy / logger /sft_finetune.log
srinjoyd's picture
srinjoyd
add logs
1eed1a8
Raw
History Blame Contribute Delete
60.5 kB
===== Job started at 2026-04-25 19:57:51 =====
Downloading aiohttp (1.7MiB)
Downloading pandas (10.4MiB)
Downloading nvidia-nvjitlink (38.8MiB)
Downloading setuptools (1.0MiB)
Downloading numpy (15.9MiB)
Downloading transformers (9.9MiB)
Downloading sympy (6.0MiB)
Downloading networkx (2.0MiB)
Downloading hf-xet (4.0MiB)
Downloading bitsandbytes (57.8MiB)
Downloading nvidia-cufft (204.2MiB)
Downloading nvidia-nccl-cu13 (187.4MiB)
Downloading nvidia-curand (56.8MiB)
Downloading nvidia-cuda-cupti (10.2MiB)
Downloading cuda-bindings (6.0MiB)
Downloading nvidia-cuda-runtime (2.1MiB)
Downloading nvidia-cusolver (191.6MiB)
Downloading nvidia-cudnn-cu13 (349.1MiB)
Downloading pyarrow (46.6MiB)
Downloading nvidia-cusparse (139.2MiB)
Downloading nvidia-cufile (1.2MiB)
Downloading nvidia-cublas (403.5MiB)
Downloading tokenizers (3.1MiB)
Downloading nvidia-cuda-nvrtc (86.0MiB)
Downloading nvidia-nvshmem-cu13 (57.6MiB)
Downloading triton (179.5MiB)
Downloading pygments (1.2MiB)
Downloading nvidia-cusparselt-cu13 (162.0MiB)
Downloading torch (506.1MiB)
Downloaded nvidia-cufile
Downloaded aiohttp
Downloaded nvidia-cuda-runtime
Downloaded pygments
Downloaded setuptools
Downloaded tokenizers
Downloaded networkx
Downloaded hf-xet
Downloaded cuda-bindings
Downloaded nvidia-cuda-cupti
Downloaded sympy
Downloaded numpy
Downloaded nvidia-nvjitlink
Downloaded pandas
Downloaded transformers
Downloaded nvidia-curand
Downloaded nvidia-nvshmem-cu13
Downloaded bitsandbytes
Downloaded nvidia-cuda-nvrtc
Downloaded pyarrow
Downloaded nvidia-cusparse
Downloaded nvidia-cusparselt-cu13
Downloaded nvidia-nccl-cu13
Downloaded nvidia-cusolver
Downloaded nvidia-cufft
Downloaded triton
Downloaded nvidia-cudnn-cu13
Downloaded nvidia-cublas
Downloaded torch
Installed 77 packages in 452ms
19:58:16 [INFO] Using temp --output-dir: /tmp/sre-sft-7p8tsnrk
19:58:29 [INFO] HTTP Request: HEAD https://huggingface.co/datasets/srinjoyd/sre-data/resolve/main/README.md "HTTP/1.1 404 Not Found"
19:58:29 [INFO] HTTP Request: GET https://huggingface.co/api/datasets/srinjoyd/sre-data "HTTP/1.1 200 OK"
19:58:29 [INFO] HTTP Request: HEAD https://huggingface.co/datasets/srinjoyd/sre-data/resolve/2e88b9b6efe956bb3c11cbdcb192ccb9a73a97a8/sre-data.py "HTTP/1.1 404 Not Found"
19:58:29 [INFO] HTTP Request: HEAD https://s3.amazonaws.com/datasets.huggingface.co/datasets/datasets/srinjoyd/sre-data/srinjoyd/sre-data.py "HTTP/1.1 404 Not Found"
19:58:29 [INFO] HTTP Request: HEAD https://huggingface.co/datasets/srinjoyd/sre-data/resolve/2e88b9b6efe956bb3c11cbdcb192ccb9a73a97a8/README.md "HTTP/1.1 404 Not Found"
19:58:29 [INFO] HTTP Request: GET https://huggingface.co/api/datasets/srinjoyd/sre-data/revision/2e88b9b6efe956bb3c11cbdcb192ccb9a73a97a8 "HTTP/1.1 200 OK"
19:58:29 [INFO] HTTP Request: HEAD https://huggingface.co/datasets/srinjoyd/sre-data/resolve/2e88b9b6efe956bb3c11cbdcb192ccb9a73a97a8/.huggingface.yaml "HTTP/1.1 404 Not Found"
19:58:29 [INFO] HTTP Request: GET https://huggingface.co/api/datasets/srinjoyd/sre-data/tree/2e88b9b6efe956bb3c11cbdcb192ccb9a73a97a8?recursive=false&expand=false "HTTP/1.1 200 OK"
19:58:29 [INFO] HTTP Request: HEAD https://huggingface.co/datasets/srinjoyd/sre-data/resolve/2e88b9b6efe956bb3c11cbdcb192ccb9a73a97a8/dataset_infos.json "HTTP/1.1 404 Not Found"
19:58:29 [INFO] HTTP Request: HEAD https://huggingface.co/datasets/srinjoyd/sre-data/resolve/2e88b9b6efe956bb3c11cbdcb192ccb9a73a97a8/sre_sft_dataset.jsonl "HTTP/1.1 302 Found"
19:58:29 [INFO] HTTP Request: GET https://huggingface.co/api/datasets/srinjoyd/sre-data/xet-read-token/2e88b9b6efe956bb3c11cbdcb192ccb9a73a97a8 "HTTP/1.1 200 OK"
sre_sft_dataset.jsonl: 0%| | 0.00/35.1M [00:00<?, ?B/s]
sre_sft_dataset.jsonl: 78%|███████▊ | 27.3M/35.1M [00:01<00:00, 26.6MB/s]
sre_sft_dataset.jsonl: 100%|██████████| 35.1M/35.1M [00:01<00:00, 24.6MB/s]
Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 1363 examples [00:00, 8525.71 examples/s]
19:58:31 [INFO] Loaded 1363 rows from hf://datasets/srinjoyd/sre-data (file=sre_sft_dataset.jsonl, split=train)
to_messages: 0%| | 0/1363 [00:00<?, ? examples/s]
to_messages: 100%|██████████| 1363/1363 [00:00<00:00, 4170.41 examples/s]
[transformers] warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.
19:58:31 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B-Instruct/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
19:58:31 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B-Instruct/a09a35458c702b33eeacc393d103063234e8bc28/config.json "HTTP/1.1 200 OK"
19:58:32 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B-Instruct/a09a35458c702b33eeacc393d103063234e8bc28/config.json "HTTP/1.1 200 OK"
config.json: 0%| | 0.00/663 [00:00<?, ?B/s]
config.json: 100%|██████████| 663/663 [00:00<00:00, 5.05MB/s]
19:58:32 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B-Instruct/resolve/main/tokenizer_config.json "HTTP/1.1 307 Temporary Redirect"
19:58:32 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B-Instruct/a09a35458c702b33eeacc393d103063234e8bc28/tokenizer_config.json "HTTP/1.1 200 OK"
19:58:32 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B-Instruct/a09a35458c702b33eeacc393d103063234e8bc28/tokenizer_config.json "HTTP/1.1 200 OK"
tokenizer_config.json: 0%| | 0.00/7.30k [00:00<?, ?B/s]
tokenizer_config.json: 100%|██████████| 7.30k/7.30k [00:00<00:00, 29.3MB/s]
19:58:32 [INFO] HTTP Request: GET https://huggingface.co/api/models/Qwen/Qwen2.5-7B-Instruct/tree/main/additional_chat_templates?recursive=false&expand=false "HTTP/1.1 404 Not Found"
19:58:32 [INFO] HTTP Request: GET https://huggingface.co/api/models/Qwen/Qwen2.5-7B-Instruct/tree/main?recursive=true&expand=false "HTTP/1.1 200 OK"
19:58:32 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B-Instruct/resolve/main/vocab.json "HTTP/1.1 307 Temporary Redirect"
19:58:32 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B-Instruct/a09a35458c702b33eeacc393d103063234e8bc28/vocab.json "HTTP/1.1 200 OK"
19:58:32 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B-Instruct/a09a35458c702b33eeacc393d103063234e8bc28/vocab.json "HTTP/1.1 200 OK"
vocab.json: 0%| | 0.00/2.78M [00:00<?, ?B/s]
vocab.json: 100%|██████████| 2.78M/2.78M [00:00<00:00, 35.9MB/s]
19:58:32 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B-Instruct/resolve/main/merges.txt "HTTP/1.1 307 Temporary Redirect"
19:58:32 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B-Instruct/a09a35458c702b33eeacc393d103063234e8bc28/merges.txt "HTTP/1.1 200 OK"
19:58:33 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B-Instruct/a09a35458c702b33eeacc393d103063234e8bc28/merges.txt "HTTP/1.1 200 OK"
merges.txt: 0%| | 0.00/1.67M [00:00<?, ?B/s]
merges.txt: 100%|██████████| 1.67M/1.67M [00:00<00:00, 31.4MB/s]
19:58:33 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B-Instruct/resolve/main/tokenizer.json "HTTP/1.1 307 Temporary Redirect"
19:58:33 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B-Instruct/a09a35458c702b33eeacc393d103063234e8bc28/tokenizer.json "HTTP/1.1 200 OK"
19:58:33 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B-Instruct/a09a35458c702b33eeacc393d103063234e8bc28/tokenizer.json "HTTP/1.1 200 OK"
tokenizer.json: 0%| | 0.00/7.03M [00:00<?, ?B/s]
tokenizer.json: 100%|██████████| 7.03M/7.03M [00:00<00:00, 41.2MB/s]
19:58:33 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B-Instruct/resolve/main/added_tokens.json "HTTP/1.1 404 Not Found"
19:58:33 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B-Instruct/resolve/main/special_tokens_map.json "HTTP/1.1 404 Not Found"
19:58:33 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B-Instruct/resolve/main/chat_template.jinja "HTTP/1.1 404 Not Found"
19:58:33 [INFO] HTTP Request: GET https://huggingface.co/api/models/Qwen/Qwen2.5-7B-Instruct "HTTP/1.1 200 OK"
19:58:33 [INFO] Using --tokenizer Qwen/Qwen2.5-7B-Instruct for chat / tokenization (weights from --model Qwen/Qwen2.5-7B)
19:58:33 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
19:58:33 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/config.json "HTTP/1.1 200 OK"
19:58:33 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/config.json "HTTP/1.1 200 OK"
config.json: 0%| | 0.00/686 [00:00<?, ?B/s]
config.json: 100%|██████████| 686/686 [00:00<00:00, 3.33MB/s]
19:58:33 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
19:58:33 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/config.json "HTTP/1.1 200 OK"
19:58:33 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/adapter_config.json "HTTP/1.1 404 Not Found"
19:58:33 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
19:58:33 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/config.json "HTTP/1.1 200 OK"
19:58:37 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/model.safetensors "HTTP/1.1 404 Not Found"
19:58:37 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/model.safetensors.index.json "HTTP/1.1 307 Temporary Redirect"
19:58:37 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/model.safetensors.index.json "HTTP/1.1 200 OK"
19:58:37 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/model.safetensors.index.json "HTTP/1.1 200 OK"
model.safetensors.index.json: 0%| | 0.00/27.8k [00:00<?, ?B/s]
model.safetensors.index.json: 100%|██████████| 27.8k/27.8k [00:00<00:00, 84.7MB/s]
19:58:37 [INFO] HTTP Request: GET https://huggingface.co/api/models/Qwen/Qwen2.5-7B/revision/main "HTTP/1.1 200 OK"
Downloading (incomplete total...): 0.00B [00:00, ?B/s]
Fetching 4 files: 0%| | 0/4 [00:00<?, ?it/s]19:58:37 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/d149729398750b98c0af14eb82c78cfe92750796/model-00001-of-00004.safetensors "HTTP/1.1 302 Found"
19:58:37 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/d149729398750b98c0af14eb82c78cfe92750796/model-00004-of-00004.safetensors "HTTP/1.1 302 Found"
19:58:37 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/d149729398750b98c0af14eb82c78cfe92750796/model-00002-of-00004.safetensors "HTTP/1.1 302 Found"
19:58:37 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/d149729398750b98c0af14eb82c78cfe92750796/model-00003-of-00004.safetensors "HTTP/1.1 302 Found"
19:58:37 [INFO] HTTP Request: GET https://huggingface.co/api/models/Qwen/Qwen2.5-7B/xet-read-token/d149729398750b98c0af14eb82c78cfe92750796 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 0%| | 0.00/3.56G [00:00<?, ?B/s]19:58:37 [INFO] HTTP Request: GET https://huggingface.co/api/models/Qwen/Qwen2.5-7B/xet-read-token/d149729398750b98c0af14eb82c78cfe92750796 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 0%| | 0.00/7.50G [00:00<?, ?B/s]19:58:37 [INFO] HTTP Request: GET https://huggingface.co/api/models/Qwen/Qwen2.5-7B/xet-read-token/d149729398750b98c0af14eb82c78cfe92750796 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 0%| | 0.00/11.4G [00:00<?, ?B/s]19:58:37 [INFO] HTTP Request: GET https://huggingface.co/api/models/Qwen/Qwen2.5-7B/xet-read-token/d149729398750b98c0af14eb82c78cfe92750796 "HTTP/1.1 200 OK"
Downloading (incomplete total...): 0%| | 0.00/15.2G [00:00<?, ?B/s]
Downloading (incomplete total...): 1%|▏ | 198M/15.2G [00:01<01:19, 190MB/s]
Downloading (incomplete total...): 7%|▋ | 1.06G/15.2G [00:02<00:24, 576MB/s]
Downloading (incomplete total...): 18%|█▊ | 2.80G/15.2G [00:03<00:11, 1.10GB/s]
Downloading (incomplete total...): 34%|███▎ | 5.11G/15.2G [00:04<00:05, 1.77GB/s]
Downloading (incomplete total...): 34%|███▎ | 5.11G/15.2G [00:04<00:05, 1.77GB/s]
Downloading (incomplete total...): 46%|████▋ | 7.06G/15.2G [00:05<00:04, 1.81GB/s]
Downloading (incomplete total...): 62%|██████▏ | 9.49G/15.2G [00:06<00:02, 1.99GB/s]
Downloading (incomplete total...): 78%|███████▊ | 11.9G/15.2G [00:11<00:03, 948MB/s] 
Downloading (incomplete total...): 89%|████████▉ | 13.5G/15.2G [00:12<00:01, 1.06GB/s]
Fetching 4 files: 25%|██▌ | 1/4 [00:12<00:37, 12.50s/it]
Fetching 4 files: 100%|██████████| 4/4 [00:12<00:00, 3.13s/it]
Download complete: 100%|██████████| 15.2G/15.2G [00:12<00:00, 1.06GB/s] 
Download complete: 100%|██████████| 15.2G/15.2G [00:12<00:00, 1.21GB/s]
Loading weights: 0%| | 0/339 [00:00<?, ?it/s]
Loading weights: 1%| | 2/339 [00:01<03:13, 1.74it/s]/root/.cache/uv/archive-v0/im_x0dan4Bv8rnebA5YQO/lib/python3.12/site-packages/bitsandbytes/backends/cuda/ops.py:213: FutureWarning: _check_is_size will be removed in a future PyTorch release along with guard_size_oblivious. Use _check(i >= 0) instead.
torch._check_is_size(blocksize)
Loading weights: 12%|█▏ | 42/339 [00:02<00:13, 22.69it/s]
Loading weights: 27%|██▋ | 90/339 [00:03<00:07, 33.49it/s]
Loading weights: 41%|████ | 138/339 [00:04<00:05, 38.95it/s]
Loading weights: 56%|█████▌ | 190/339 [00:05<00:03, 43.44it/s]
Loading weights: 71%|███████ | 240/339 [00:06<00:02, 45.46it/s]
Loading weights: 85%|████████▍ | 288/339 [00:07<00:01, 46.18it/s]
Loading weights: 100%|█████████▉| 338/339 [00:08<00:00, 47.38it/s]
Loading weights: 100%|██████████| 339/339 [00:08<00:00, 41.22it/s]
19:58:58 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/generation_config.json "HTTP/1.1 307 Temporary Redirect"
19:58:58 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/generation_config.json "HTTP/1.1 200 OK"
19:58:58 [INFO] HTTP Request: GET https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/generation_config.json "HTTP/1.1 200 OK"
generation_config.json: 0%| | 0.00/138 [00:00<?, ?B/s]
generation_config.json: 100%|██████████| 138/138 [00:00<00:00, 941kB/s]
Tokenizing train dataset: 0%| | 0/1335 [00:00<?, ? examples/s]
Tokenizing train dataset: 7%|▋ | 100/1335 [00:01<00:12, 95.33 examples/s]
Tokenizing train dataset: 15%|█▍ | 196/1335 [00:02<00:12, 92.62 examples/s]
Tokenizing train dataset: 22%|██▏ | 300/1335 [00:03<00:10, 96.08 examples/s]
Tokenizing train dataset: 30%|██▉ | 397/1335 [00:04<00:10, 91.66 examples/s]
Tokenizing train dataset: 37%|███▋ | 498/1335 [00:05<00:08, 93.84 examples/s]
Tokenizing train dataset: 44%|████▍ | 593/1335 [00:06<00:08, 90.27 examples/s]
Tokenizing train dataset: 51%|█████ | 684/1335 [00:07<00:07, 90.31 examples/s]
Tokenizing train dataset: 58%|█████▊ | 775/1335 [00:08<00:06, 87.71 examples/s]
Tokenizing train dataset: 65%|██████▍ | 864/1335 [00:09<00:05, 87.35 examples/s]
Tokenizing train dataset: 72%|███████▏ | 955/1335 [00:10<00:04, 86.81 examples/s]
Tokenizing train dataset: 78%|███████▊ | 1045/1335 [00:15<00:06, 43.91 examples/s]
Tokenizing train dataset: 85%|████████▍ | 1130/1335 [00:16<00:04, 50.72 examples/s]
Tokenizing train dataset: 92%|█████████▏| 1224/1335 [00:17<00:01, 58.74 examples/s]
Tokenizing train dataset: 98%|█████████▊| 1310/1335 [00:18<00:00, 64.38 examples/s]
Tokenizing train dataset: 100%|██████████| 1335/1335 [00:18<00:00, 71.29 examples/s]
Tokenizing eval dataset: 0%| | 0/28 [00:00<?, ? examples/s]
Tokenizing eval dataset: 100%|██████████| 28/28 [00:00<00:00, 68.36 examples/s]
19:59:20 [INFO] Starting SFT: model=Qwen/Qwen2.5-7B, train=1335, eval=28
[transformers] The tokenizer has new PAD/BOS/EOS tokens that differ from the model config and generation config. The model config and generation config were aligned accordingly, being updated with the tokenizer's values. Updated tokens: {'eos_token_id': 151645, 'bos_token_id': None, 'pad_token_id': 151643}.
 0%| | 0/334 [00:00<?, ?it/s]
 0%| | 1/334 [00:28<2:38:51, 28.62s/it]
 1%| | 2/334 [00:37<1:35:00, 17.17s/it]
 1%| | 3/334 [00:59<1:46:49, 19.36s/it]
 1%| | 4/334 [01:27<2:05:45, 22.87s/it]
 1%|▏ | 5/334 [01:48<2:01:22, 22.14s/it]
 2%|▏ | 6/334 [02:16<2:11:01, 23.97s/it]
 2%|▏ | 7/334 [02:50<2:28:20, 27.22s/it]
 2%|▏ | 8/334 [03:08<2:12:12, 24.33s/it]
 3%|▎ | 9/334 [03:42<2:28:03, 27.33s/it]
 3%|▎ | 10/334 [04:10<2:29:20, 27.66s/it]

{'loss': '0.6122', 'grad_norm': '0.3594', 'learning_rate': '0.0001636', 'entropy': '0.8655', 'num_tokens': '1.247e+05', 'mean_token_accuracy': '0.9041', 'epoch': '0.02996'}
 3%|▎ | 10/334 [04:10<2:29:20, 27.66s/it]
 3%|▎ | 11/334 [04:41<2:33:32, 28.52s/it]
 4%|▎ | 12/334 [05:15<2:41:56, 30.17s/it]
 4%|▍ | 13/334 [05:46<2:43:17, 30.52s/it]
 4%|▍ | 14/334 [06:08<2:29:02, 27.94s/it]
 4%|▍ | 15/334 [06:42<2:38:09, 29.75s/it]
 5%|▍ | 16/334 [07:16<2:44:23, 31.02s/it]
 5%|▌ | 17/334 [07:50<2:48:30, 31.90s/it]
 5%|▌ | 18/334 [08:24<2:51:13, 32.51s/it]
 6%|▌ | 19/334 [08:40<2:25:34, 27.73s/it]
{'loss': '0.4707', 'grad_norm': '0.3105', 'learning_rate': '0.0001997', 'entropy': '0.7358', 'num_tokens': '2.711e+05', 'mean_token_accuracy': '0.919', 'epoch': '0.05993'}
 6%|▌ | 20/334 [09:10<2:27:41, 28.22s/it]

 6%|▌ | 20/334 [09:10<2:27:41, 28.22s/it]
 6%|▋ | 21/334 [09:25<2:06:45, 24.30s/it]
 7%|▋ | 22/334 [09:52<2:10:33, 25.11s/it]
 7%|▋ | 23/334 [10:14<2:06:09, 24.34s/it]
 7%|▋ | 24/334 [10:38<2:04:51, 24.17s/it]
 7%|▋ | 25/334 [11:12<2:19:30, 27.09s/it]
 8%|▊ | 26/334 [11:36<2:14:34, 26.22s/it]
 8%|▊ | 27/334 [12:10<2:25:58, 28.53s/it]
 8%|▊ | 28/334 [12:31<2:14:24, 26.36s/it]
 9%|▊ | 29/334 [13:04<2:24:06, 28.35s/it]
 9%|▉ | 30/334 [13:35<2:26:49, 28.98s/it]

{'loss': '0.4223', 'grad_norm': '0.8594', 'learning_rate': '0.0001985', 'entropy': '0.7529', 'num_tokens': '4.025e+05', 'mean_token_accuracy': '0.9345', 'epoch': '0.08989'}
 9%|▉ | 30/334 [13:35<2:26:49, 28.98s/it]
 9%|▉ | 31/334 [14:02<2:22:47, 28.28s/it]
 10%|▉ | 32/334 [14:23<2:11:36, 26.15s/it]
 10%|▉ | 33/334 [14:50<2:12:58, 26.51s/it]
 10%|█ | 34/334 [15:18<2:14:44, 26.95s/it]
 10%|█ | 35/334 [15:44<2:13:12, 26.73s/it]
 11%|█ | 36/334 [16:10<2:11:41, 26.52s/it]
 11%|█ | 37/334 [16:39<2:13:51, 27.04s/it]
 11%|█▏ | 38/334 [17:03<2:09:21, 26.22s/it]
 12%|█▏ | 39/334 [17:26<2:04:19, 25.29s/it]
 12%|█▏ | 40/334 [17:46<1:56:21, 23.75s/it]

{'loss': '0.4289', 'grad_norm': '0.3457', 'learning_rate': '0.0001963', 'entropy': '0.7748', 'num_tokens': '5.267e+05', 'mean_token_accuracy': '0.9331', 'epoch': '0.1199'}
 12%|█▏ | 40/334 [17:46<1:56:21, 23.75s/it]
 12%|█▏ | 41/334 [18:15<2:03:15, 25.24s/it]
 13%|█▎ | 42/334 [18:49<2:15:32, 27.85s/it]
 13%|█▎ | 43/334 [19:16<2:14:36, 27.75s/it]
 13%|█▎ | 44/334 [19:43<2:12:10, 27.35s/it]
 13%|█▎ | 45/334 [20:03<2:01:32, 25.23s/it]
 14%|█▍ | 46/334 [20:30<2:03:07, 25.65s/it]
 14%|█▍ | 47/334 [21:03<2:13:14, 27.85s/it]
 14%|█▍ | 48/334 [21:16<1:52:41, 23.64s/it]
 15%|█▍ | 49/334 [21:44<1:57:16, 24.69s/it]
 15%|█▍ | 50/334 [22:14<2:05:02, 26.42s/it]

{'loss': '0.4076', 'grad_norm': '0.2734', 'learning_rate': '0.0001932', 'entropy': '0.7429', 'num_tokens': '6.584e+05', 'mean_token_accuracy': '0.9357', 'epoch': '0.1498'}
 15%|█▍ | 50/334 [22:14<2:05:02, 26.42s/it]
 15%|█▌ | 51/334 [22:41<2:05:07, 26.53s/it]
 16%|█▌ | 52/334 [23:11<2:09:24, 27.53s/it]
 16%|█▌ | 53/334 [23:26<1:51:30, 23.81s/it]
 16%|█▌ | 54/334 [23:58<2:02:46, 26.31s/it]
 16%|█▋ | 55/334 [24:25<2:03:53, 26.64s/it]
 17%|█▋ | 56/334 [24:46<1:54:59, 24.82s/it]
 17%|█▋ | 57/334 [25:15<2:00:56, 26.20s/it]
 17%|█▋ | 58/334 [25:38<1:55:13, 25.05s/it]
 18%|█▊ | 59/334 [25:59<1:49:16, 23.84s/it]
{'loss': '0.379', 'grad_norm': '0.4414', 'learning_rate': '0.0001893', 'entropy': '0.7547', 'num_tokens': '7.823e+05', 'mean_token_accuracy': '0.9373', 'epoch': '0.1798'}
 18%|█▊ | 60/334 [26:24<1:50:27, 24.19s/it]

 18%|█▊ | 60/334 [26:24<1:50:27, 24.19s/it]
 18%|█▊ | 61/334 [26:47<1:49:16, 24.01s/it]
 19%|█▊ | 62/334 [27:10<1:46:40, 23.53s/it]
 19%|█▉ | 63/334 [27:40<1:55:39, 25.61s/it]
 19%|█▉ | 64/334 [28:01<1:48:49, 24.18s/it]
 19%|█▉ | 65/334 [28:32<1:57:18, 26.17s/it]
 20%|█▉ | 66/334 [28:57<1:56:09, 26.01s/it]
 20%|██ | 67/334 [29:30<2:03:56, 27.85s/it]
 20%|██ | 68/334 [29:58<2:03:59, 27.97s/it]
 21%|██ | 69/334 [30:27<2:04:22, 28.16s/it]
{'loss': '0.3631', 'grad_norm': '0.2178', 'learning_rate': '0.0001845', 'entropy': '0.6171', 'num_tokens': '9.163e+05', 'mean_token_accuracy': '0.9453', 'epoch': '0.2097'}
 21%|██ | 70/334 [30:52<1:59:57, 27.26s/it]

 21%|██ | 70/334 [30:52<1:59:57, 27.26s/it]
 21%|██▏ | 71/334 [31:26<2:08:16, 29.27s/it]
 22%|██▏ | 72/334 [31:53<2:04:55, 28.61s/it]
 22%|██▏ | 73/334 [32:13<1:53:52, 26.18s/it]
 22%|██▏ | 74/334 [32:47<2:03:32, 28.51s/it]
 22%|██▏ | 75/334 [33:08<1:53:09, 26.21s/it]
 23%|██▎ | 76/334 [33:33<1:50:56, 25.80s/it]
 23%|██▎ | 77/334 [34:07<2:00:58, 28.24s/it]
 23%|██▎ | 78/334 [34:41<2:07:45, 29.94s/it]
 24%|██▎ | 79/334 [35:01<1:54:57, 27.05s/it]
 24%|██▍ | 80/334 [35:28<1:54:31, 27.05s/it]

{'loss': '0.383', 'grad_norm': '0.2773', 'learning_rate': '0.0001789', 'entropy': '0.5864', 'num_tokens': '1.052e+06', 'mean_token_accuracy': '0.9461', 'epoch': '0.2397'}
 24%|██▍ | 80/334 [35:28<1:54:31, 27.05s/it]
 24%|██▍ | 81/334 [35:49<1:46:54, 25.36s/it]
 25%|██▍ | 82/334 [36:10<1:40:09, 23.85s/it]
 25%|██▍ | 83/334 [36:37<1:43:51, 24.83s/it]
 25%|██▌ | 84/334 [36:53<1:32:23, 22.17s/it]
 25%|██▌ | 85/334 [37:16<1:33:36, 22.56s/it]
 26%|██▌ | 86/334 [37:43<1:38:48, 23.91s/it]
 26%|██▌ | 87/334 [38:17<1:50:48, 26.92s/it]
 26%|██▋ | 88/334 [38:44<1:50:38, 26.98s/it]
 27%|██▋ | 89/334 [39:13<1:52:30, 27.55s/it]
{'loss': '0.3758', 'grad_norm': '0.373', 'learning_rate': '0.0001726', 'entropy': '0.6258', 'num_tokens': '1.179e+06', 'mean_token_accuracy': '0.9398', 'epoch': '0.2697'}
 27%|██▋ | 90/334 [39:44<1:55:34, 28.42s/it]

 27%|██▋ | 90/334 [39:44<1:55:34, 28.42s/it]
 27%|██▋ | 91/334 [40:10<1:52:56, 27.89s/it]
 28%|██▊ | 92/334 [40:32<1:45:04, 26.05s/it]
 28%|██▊ | 93/334 [41:03<1:49:55, 27.37s/it]
 28%|██▊ | 94/334 [41:37<1:57:22, 29.34s/it]
 28%|██▊ | 95/334 [41:58<1:47:46, 27.06s/it]
 29%|██▊ | 96/334 [42:31<1:53:36, 28.64s/it]
 29%|██▉ | 97/334 [42:58<1:52:03, 28.37s/it]
 29%|██▉ | 98/334 [43:21<1:44:51, 26.66s/it]
 30%|██▉ | 99/334 [43:45<1:40:39, 25.70s/it]
 30%|██▉ | 100/334 [44:13<1:43:53, 26.64s/it]

{'loss': '0.3681', 'grad_norm': '0.1855', 'learning_rate': '0.0001656', 'entropy': '0.6453', 'num_tokens': '1.312e+06', 'mean_token_accuracy': '0.9437', 'epoch': '0.2996'}
 30%|██▉ | 100/334 [44:13<1:43:53, 26.64s/it]
 30%|███ | 101/334 [44:38<1:41:38, 26.17s/it]
 31%|███ | 102/334 [45:12<1:50:11, 28.50s/it]
 31%|███ | 103/334 [45:33<1:40:39, 26.14s/it]
 31%|███ | 104/334 [46:00<1:41:09, 26.39s/it]
 31%|███▏ | 105/334 [46:22<1:35:51, 25.11s/it]
 32%|███▏ | 106/334 [46:43<1:30:45, 23.88s/it]
 32%|███▏ | 107/334 [47:16<1:40:24, 26.54s/it]
 32%|███▏ | 108/334 [47:38<1:35:26, 25.34s/it]
 33%|███▎ | 109/334 [47:51<1:21:15, 21.67s/it]
{'loss': '0.384', 'grad_norm': '0.8594', 'learning_rate': '0.0001579', 'entropy': '0.6726', 'num_tokens': '1.427e+06', 'mean_token_accuracy': '0.9424', 'epoch': '0.3296'}
 33%|███▎ | 110/334 [48:06<1:12:29, 19.42s/it]

 33%|███▎ | 110/334 [48:06<1:12:29, 19.42s/it]
 33%|███▎ | 111/334 [48:33<1:21:05, 21.82s/it]
 34%|███▎ | 112/334 [49:00<1:26:56, 23.50s/it]
 34%|███▍ | 113/334 [49:34<1:38:02, 26.62s/it]
 34%|███▍ | 114/334 [50:02<1:38:27, 26.85s/it]
 34%|███▍ | 115/334 [50:22<1:30:34, 24.82s/it]
 35%|███▍ | 116/334 [50:56<1:40:06, 27.55s/it]
 35%|███▌ | 117/334 [51:22<1:38:05, 27.12s/it]
 35%|███▌ | 118/334 [51:55<1:43:47, 28.83s/it]
 36%|███▌ | 119/334 [52:29<1:48:48, 30.37s/it]
 36%|███▌ | 120/334 [53:03<1:52:06, 31.43s/it]

{'loss': '0.4129', 'grad_norm': '0.1167', 'learning_rate': '0.0001497', 'entropy': '0.5418', 'num_tokens': '1.572e+06', 'mean_token_accuracy': '0.9376', 'epoch': '0.3596'}
 36%|███▌ | 120/334 [53:03<1:52:06, 31.43s/it]
 36%|███▌ | 121/334 [53:30<1:46:47, 30.08s/it]
 37%|███▋ | 122/334 [53:50<1:36:02, 27.18s/it]
 37%|███▋ | 123/334 [54:19<1:37:52, 27.83s/it]
 37%|███▋ | 124/334 [54:42<1:32:14, 26.36s/it]
 37%|███▋ | 125/334 [54:57<1:19:57, 22.95s/it]
 38%|███▊ | 126/334 [55:21<1:19:55, 23.06s/it]
 38%|███▊ | 127/334 [55:47<1:23:32, 24.22s/it]
 38%|███▊ | 128/334 [56:08<1:19:11, 23.07s/it]
 39%|███▊ | 129/334 [56:28<1:15:54, 22.22s/it]
{'loss': '0.3863', 'grad_norm': '0.1245', 'learning_rate': '0.0001411', 'entropy': '0.6653', 'num_tokens': '1.69e+06', 'mean_token_accuracy': '0.9413', 'epoch': '0.3895'}
 39%|███▉ | 130/334 [57:02<1:27:28, 25.73s/it]

 39%|███▉ | 130/334 [57:02<1:27:28, 25.73s/it]
 39%|███▉ | 131/334 [57:30<1:29:32, 26.46s/it]
 40%|███▉ | 132/334 [57:58<1:30:00, 26.73s/it]
 40%|███▉ | 133/334 [58:22<1:26:57, 25.96s/it]
 40%|████ | 134/334 [58:47<1:25:50, 25.75s/it]
 40%|████ | 135/334 [58:56<1:09:02, 20.82s/it]
 41%|████ | 136/334 [59:30<1:21:36, 24.73s/it]
 41%|████ | 137/334 [59:59<1:25:14, 25.96s/it]
 41%|████▏ | 138/334 [1:00:29<1:28:22, 27.05s/it]
 42%|████▏ | 139/334 [1:00:59<1:31:12, 28.06s/it]
 42%|████▏ | 140/334 [1:01:20<1:23:51, 25.94s/it]

{'loss': '0.3835', 'grad_norm': '0.3965', 'learning_rate': '0.000132', 'entropy': '0.5886', 'num_tokens': '1.819e+06', 'mean_token_accuracy': '0.943', 'epoch': '0.4195'}
 42%|████▏ | 140/334 [1:01:20<1:23:51, 25.94s/it]
 42%|████▏ | 141/334 [1:01:53<1:29:58, 27.97s/it]
 43%|████▎ | 142/334 [1:02:20<1:28:26, 27.64s/it]
 43%|████▎ | 143/334 [1:02:40<1:21:26, 25.58s/it]
 43%|████▎ | 144/334 [1:02:56<1:11:18, 22.52s/it]
 43%|████▎ | 145/334 [1:03:20<1:12:46, 23.10s/it]
 44%|████▎ | 146/334 [1:03:46<1:15:17, 24.03s/it]
 44%|████▍ | 147/334 [1:04:20<1:24:09, 27.00s/it]
 44%|████▍ | 148/334 [1:04:51<1:26:51, 28.02s/it]
 45%|████▍ | 149/334 [1:05:09<1:17:24, 25.11s/it]
 45%|████▍ | 150/334 [1:05:43<1:25:05, 27.75s/it]

{'loss': '0.4001', 'grad_norm': '0.3047', 'learning_rate': '0.0001227', 'entropy': '0.6038', 'num_tokens': '1.949e+06', 'mean_token_accuracy': '0.9385', 'epoch': '0.4494'}
 45%|████▍ | 150/334 [1:05:43<1:25:05, 27.75s/it]
 45%|████▌ | 151/334 [1:06:17<1:30:16, 29.60s/it]
 46%|████▌ | 152/334 [1:06:29<1:13:31, 24.24s/it]
 46%|████▌ | 153/334 [1:06:50<1:10:40, 23.43s/it]
 46%|████▌ | 154/334 [1:07:11<1:08:11, 22.73s/it]
 46%|████▋ | 155/334 [1:07:45<1:17:48, 26.08s/it]
 47%|████▋ | 156/334 [1:08:12<1:17:52, 26.25s/it]
 47%|████▋ | 157/334 [1:08:36<1:15:23, 25.55s/it]
 47%|████▋ | 158/334 [1:08:52<1:06:43, 22.75s/it]
 48%|████▊ | 159/334 [1:09:17<1:08:12, 23.38s/it]
 48%|████▊ | 160/334 [1:09:45<1:11:45, 24.75s/it]

{'loss': '0.3693', 'grad_norm': '0.1279', 'learning_rate': '0.0001131', 'entropy': '0.6436', 'num_tokens': '2.069e+06', 'mean_token_accuracy': '0.9458', 'epoch': '0.4794'}
 48%|████▊ | 160/334 [1:09:45<1:11:45, 24.75s/it]
 48%|████▊ | 161/334 [1:10:07<1:09:13, 24.01s/it]
 49%|████▊ | 162/334 [1:10:41<1:17:22, 26.99s/it]
 49%|████▉ | 163/334 [1:11:00<1:10:28, 24.73s/it]
 49%|████▉ | 164/334 [1:11:16<1:02:23, 22.02s/it]
 49%|████▉ | 165/334 [1:11:43<1:05:53, 23.39s/it]
 50%|████▉ | 166/334 [1:12:16<1:14:17, 26.53s/it]
 50%|█████ | 167/334 [1:12:43<1:14:04, 26.62s/it]
 50%|█████ | 168/334 [1:13:11<1:14:17, 26.85s/it]
 51%|█████ | 169/334 [1:13:39<1:15:25, 27.43s/it]
 51%|█████ | 170/334 [1:14:02<1:10:57, 25.96s/it]

{'loss': '0.3638', 'grad_norm': '0.5039', 'learning_rate': '0.0001034', 'entropy': '0.634', 'num_tokens': '2.196e+06', 'mean_token_accuracy': '0.9441', 'epoch': '0.5094'}
 51%|█████ | 170/334 [1:14:02<1:10:57, 25.96s/it]
 51%|█████ | 171/334 [1:14:15<1:00:09, 22.14s/it]
 51%|█████▏ | 172/334 [1:14:39<1:00:51, 22.54s/it]
 52%|█████▏ | 173/334 [1:15:09<1:06:50, 24.91s/it]
 52%|█████▏ | 174/334 [1:15:32<1:05:09, 24.43s/it]
 52%|█████▏ | 175/334 [1:15:55<1:03:09, 23.83s/it]
 53%|█████▎ | 176/334 [1:16:25<1:07:46, 25.74s/it]
 53%|█████▎ | 177/334 [1:16:59<1:13:47, 28.20s/it]
 53%|█████▎ | 178/334 [1:17:33<1:17:49, 29.93s/it]
 54%|█████▎ | 179/334 [1:18:00<1:15:00, 29.04s/it]
{'loss': '0.3669', 'grad_norm': '0.3281', 'learning_rate': '9.368e-05', 'entropy': '0.588', 'num_tokens': '2.321e+06', 'mean_token_accuracy': '0.9475', 'epoch': '0.5393'}
 54%|█████▍ | 180/334 [1:18:14<1:02:48, 24.47s/it]

 54%|█████▍ | 180/334 [1:18:14<1:02:48, 24.47s/it]
 54%|█████▍ | 181/334 [1:18:42<1:05:10, 25.56s/it]
 54%|█████▍ | 182/334 [1:18:57<57:07, 22.55s/it] 
 55%|█████▍ | 183/334 [1:19:26<1:01:41, 24.51s/it]
 55%|█████▌ | 184/334 [1:20:00<1:08:21, 27.34s/it]
 55%|█████▌ | 185/334 [1:20:34<1:12:45, 29.30s/it]
 56%|█████▌ | 186/334 [1:20:55<1:06:03, 26.78s/it]
 56%|█████▌ | 187/334 [1:21:28<1:09:54, 28.54s/it]
 56%|█████▋ | 188/334 [1:22:02<1:13:21, 30.14s/it]
 57%|█████▋ | 189/334 [1:22:36<1:15:34, 31.27s/it]
 57%|█████▋ | 190/334 [1:23:10<1:16:56, 32.06s/it]

{'loss': '0.3741', 'grad_norm': '0.1855', 'learning_rate': '8.402e-05', 'entropy': '0.4784', 'num_tokens': '2.465e+06', 'mean_token_accuracy': '0.9445', 'epoch': '0.5693'}
 57%|█████▋ | 190/334 [1:23:10<1:16:56, 32.06s/it]
 57%|█████▋ | 191/334 [1:23:43<1:17:44, 32.62s/it]
 57%|█████▋ | 192/334 [1:24:17<1:18:06, 33.00s/it]
 58%|█████▊ | 193/334 [1:24:38<1:09:09, 29.43s/it]
 58%|█████▊ | 194/334 [1:25:09<1:09:22, 29.73s/it]
 58%|█████▊ | 195/334 [1:25:37<1:07:27, 29.12s/it]
 59%|█████▊ | 196/334 [1:25:49<55:38, 24.19s/it] 
 59%|█████▉ | 197/334 [1:26:20<59:30, 26.06s/it]
 59%|█████▉ | 198/334 [1:26:54<1:04:25, 28.42s/it]
 60%|█████▉ | 199/334 [1:27:11<56:41, 25.19s/it] 
 60%|█████▉ | 200/334 [1:27:36<56:05, 25.12s/it]

{'loss': '0.3786', 'grad_norm': '0.6172', 'learning_rate': '7.451e-05', 'entropy': '0.4985', 'num_tokens': '2.597e+06', 'mean_token_accuracy': '0.943', 'epoch': '0.5993'}
 60%|█████▉ | 200/334 [1:27:36<56:05, 25.12s/it]
 0%| | 0/28 [00:00<?, ?it/s]
 7%|▋ | 2/28 [00:02<00:34, 1.34s/it]
 11%|█ | 3/28 [00:05<00:50, 2.03s/it]
 14%|█▍ | 4/28 [00:08<00:57, 2.39s/it]
 18%|█▊ | 5/28 [00:11<00:59, 2.60s/it]
 21%|██▏ | 6/28 [00:14<00:59, 2.73s/it]
 25%|██▌ | 7/28 [00:17<00:59, 2.81s/it]
 29%|██▊ | 8/28 [00:20<00:57, 2.86s/it]
 36%|███▌ | 10/28 [00:23<00:39, 2.21s/it]
 39%|███▉ | 11/28 [00:26<00:40, 2.40s/it]
 43%|████▎ | 12/28 [00:29<00:40, 2.56s/it]
 46%|████▋ | 13/28 [00:32<00:40, 2.67s/it]
 50%|█████ | 14/28 [00:33<00:32, 2.33s/it]
 54%|█████▎ | 15/28 [00:36<00:32, 2.52s/it]
 57%|█████▋ | 16/28 [00:39<00:31, 2.66s/it]
 61%|██████ | 17/28 [00:42<00:30, 2.76s/it]
 64%|██████▍ | 18/28 [00:45<00:28, 2.82s/it]
 71%|███████▏ | 20/28 [00:47<00:14, 1.78s/it]
 79%|███████▊ | 22/28 [00:49<00:09, 1.57s/it]
 86%|████████▌ | 24/28 [00:50<00:04, 1.23s/it]
 93%|█████████▎| 26/28 [00:56<00:03, 1.83s/it]
{'eval_loss': '0.3881', 'eval_runtime': '63.66', 'eval_samples_per_second': '0.44', 'eval_steps_per_second': '0.44', 'eval_entropy': '0.5196', 'eval_num_tokens': '2.597e+06', 'eval_mean_token_accuracy': '0.943', 'epoch': '0.5993'}
 96%|█████████▋| 27/28 [00:59<00:02, 2.05s/it]


 60%|█████▉ | 200/334 [1:28:40<56:05, 25.12s/it]
100%|██████████| 28/28 [01:00<00:00, 2.05s/it]
 21:28:01 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
21:28:01 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/config.json "HTTP/1.1 200 OK"
21:28:01 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
21:28:01 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/config.json "HTTP/1.1 200 OK"
 60%|██████ | 201/334 [1:29:11<1:41:45, 45.90s/it]
 60%|██████ | 202/334 [1:29:44<1:33:03, 42.30s/it]
 61%|██████ | 203/334 [1:30:16<1:25:07, 38.98s/it]
 61%|██████ | 204/334 [1:30:43<1:16:35, 35.35s/it]
 61%|██████▏ | 205/334 [1:31:05<1:07:57, 31.61s/it]
 62%|██████▏ | 206/334 [1:31:30<1:02:57, 29.51s/it]
 62%|██████▏ | 207/334 [1:31:51<56:59, 26.92s/it] 
 62%|██████▏ | 208/334 [1:32:12<52:49, 25.15s/it]
 63%|██████▎ | 209/334 [1:32:25<44:41, 21.45s/it]
 63%|██████▎ | 210/334 [1:32:59<52:00, 25.17s/it]

{'loss': '0.3672', 'grad_norm': '0.167', 'learning_rate': '6.524e-05', 'entropy': '0.5421', 'num_tokens': '2.725e+06', 'mean_token_accuracy': '0.9406', 'epoch': '0.6292'}
 63%|██████▎ | 210/334 [1:32:59<52:00, 25.17s/it]
 63%|██████▎ | 211/334 [1:33:27<53:26, 26.07s/it]
 63%|██████▎ | 212/334 [1:33:42<46:37, 22.93s/it]
 64%|██████▍ | 213/334 [1:34:05<45:55, 22.77s/it]
 64%|██████▍ | 214/334 [1:34:33<48:39, 24.33s/it]
 64%|██████▍ | 215/334 [1:34:51<44:43, 22.55s/it]
 65%|██████▍ | 216/334 [1:35:13<43:43, 22.23s/it]
 65%|██████▍ | 217/334 [1:35:40<46:23, 23.79s/it]
 65%|██████▌ | 218/334 [1:36:14<51:51, 26.82s/it]
 66%|██████▌ | 219/334 [1:36:48<55:29, 28.95s/it]
{'loss': '0.3699', 'grad_norm': '0.4609', 'learning_rate': '5.63e-05', 'entropy': '0.5375', 'num_tokens': '2.85e+06', 'mean_token_accuracy': '0.947', 'epoch': '0.6592'}
 66%|██████▌ | 220/334 [1:37:10<51:06, 26.90s/it]

 66%|██████▌ | 220/334 [1:37:10<51:06, 26.90s/it]
 66%|██████▌ | 221/334 [1:37:37<50:31, 26.82s/it]
 66%|██████▋ | 222/334 [1:38:04<50:24, 27.00s/it]
 67%|██████▋ | 223/334 [1:38:24<45:53, 24.81s/it]
 67%|██████▋ | 224/334 [1:38:58<50:29, 27.54s/it]
 67%|██████▋ | 225/334 [1:39:27<50:55, 28.03s/it]
 68%|██████▊ | 226/334 [1:39:54<50:06, 27.84s/it]
 68%|██████▊ | 227/334 [1:40:21<48:48, 27.37s/it]
 68%|██████▊ | 228/334 [1:40:49<49:03, 27.77s/it]
 69%|██████▊ | 229/334 [1:41:23<51:47, 29.60s/it]
 69%|██████▉ | 230/334 [1:41:50<49:58, 28.83s/it]

{'loss': '0.376', 'grad_norm': '0.1826', 'learning_rate': '4.777e-05', 'entropy': '0.5215', 'num_tokens': '2.987e+06', 'mean_token_accuracy': '0.9421', 'epoch': '0.6891'}
 69%|██████▉ | 230/334 [1:41:50<49:58, 28.83s/it]
 69%|██████▉ | 231/334 [1:42:24<52:04, 30.33s/it]
 69%|██████▉ | 232/334 [1:42:51<49:54, 29.36s/it]
 70%|██████▉ | 233/334 [1:43:13<45:40, 27.13s/it]
 70%|███████ | 234/334 [1:43:40<45:08, 27.08s/it]
 70%|███████ | 235/334 [1:44:01<41:49, 25.35s/it]
 71%|███████ | 236/334 [1:44:35<45:36, 27.93s/it]
 71%|███████ | 237/334 [1:44:59<43:12, 26.72s/it]
 71%|███████▏ | 238/334 [1:45:21<40:30, 25.32s/it]
 72%|███████▏ | 239/334 [1:45:49<41:06, 25.97s/it]
{'loss': '0.3621', 'grad_norm': '0.06396', 'learning_rate': '3.974e-05', 'entropy': '0.5074', 'num_tokens': '3.121e+06', 'mean_token_accuracy': '0.9469', 'epoch': '0.7191'}
 72%|███████▏ | 240/334 [1:46:23<44:24, 28.35s/it]

 72%|███████▏ | 240/334 [1:46:23<44:24, 28.35s/it]
 72%|███████▏ | 241/334 [1:46:44<40:48, 26.33s/it]
 72%|███████▏ | 242/334 [1:47:11<40:38, 26.51s/it]
 73%|███████▎ | 243/334 [1:47:40<41:08, 27.13s/it]
 73%|███████▎ | 244/334 [1:47:57<36:20, 24.23s/it]
 73%|███████▎ | 245/334 [1:48:20<35:19, 23.82s/it]
 74%|███████▎ | 246/334 [1:48:47<36:32, 24.92s/it]
 74%|███████▍ | 247/334 [1:49:21<40:02, 27.61s/it]
 74%|███████▍ | 248/334 [1:49:48<39:08, 27.30s/it]
 75%|███████▍ | 249/334 [1:50:15<38:30, 27.19s/it]
 75%|███████▍ | 250/334 [1:50:42<37:57, 27.11s/it]

{'loss': '0.3708', 'grad_norm': '0.09521', 'learning_rate': '3.227e-05', 'entropy': '0.5567', 'num_tokens': '3.249e+06', 'mean_token_accuracy': '0.9424', 'epoch': '0.7491'}
 75%|███████▍ | 250/334 [1:50:42<37:57, 27.11s/it]
 75%|███████▌ | 251/334 [1:51:11<38:32, 27.86s/it]
 75%|███████▌ | 252/334 [1:51:38<37:34, 27.49s/it]
 76%|███████▌ | 253/334 [1:52:05<36:53, 27.33s/it]
 76%|███████▌ | 254/334 [1:52:27<34:24, 25.80s/it]
 76%|███████▋ | 255/334 [1:53:01<37:09, 28.23s/it]
 77%|███████▋ | 256/334 [1:53:22<33:39, 25.89s/it]
 77%|███████▋ | 257/334 [1:53:43<31:31, 24.56s/it]
 77%|███████▋ | 258/334 [1:54:11<32:21, 25.55s/it]
 78%|███████▊ | 259/334 [1:54:36<31:43, 25.38s/it]
{'loss': '0.3723', 'grad_norm': '0.09277', 'learning_rate': '2.545e-05', 'entropy': '0.5431', 'num_tokens': '3.378e+06', 'mean_token_accuracy': '0.9431', 'epoch': '0.779'}
 78%|███████▊ | 260/334 [1:55:03<32:02, 25.98s/it]

 78%|███████▊ | 260/334 [1:55:03<32:02, 25.98s/it]
 78%|███████▊ | 261/334 [1:55:35<33:53, 27.86s/it]
 78%|███████▊ | 262/334 [1:56:06<34:20, 28.62s/it]
 79%|███████▊ | 263/334 [1:56:20<28:37, 24.19s/it]
 79%|███████▉ | 264/334 [1:56:34<24:47, 21.24s/it]
 79%|███████▉ | 265/334 [1:57:08<28:47, 25.04s/it]
 80%|███████▉ | 266/334 [1:57:28<26:40, 23.54s/it]
 80%|███████▉ | 267/334 [1:57:47<24:51, 22.27s/it]
 80%|████████ | 268/334 [1:58:15<26:11, 23.81s/it]
 81%|████████ | 269/334 [1:58:42<26:58, 24.90s/it]
 81%|████████ | 270/334 [1:59:06<26:05, 24.45s/it]

{'loss': '0.373', 'grad_norm': '0.4297', 'learning_rate': '1.933e-05', 'entropy': '0.5932', 'num_tokens': '3.498e+06', 'mean_token_accuracy': '0.9448', 'epoch': '0.809'}
 81%|████████ | 270/334 [1:59:06<26:05, 24.45s/it]
 81%|████████ | 271/334 [1:59:32<26:21, 25.10s/it]
 81%|████████▏ | 272/334 [2:00:00<26:55, 26.05s/it]
 82%|████████▏ | 273/334 [2:00:30<27:30, 27.06s/it]
 82%|████████▏ | 274/334 [2:00:58<27:31, 27.52s/it]
 82%|████████▏ | 275/334 [2:01:21<25:33, 25.99s/it]
 83%|████████▎ | 276/334 [2:01:55<27:25, 28.37s/it]
 83%|████████▎ | 277/334 [2:02:17<25:06, 26.43s/it]
 83%|████████▎ | 278/334 [2:02:43<24:33, 26.32s/it]
 84%|████████▎ | 279/334 [2:02:57<20:42, 22.59s/it]
{'loss': '0.3531', 'grad_norm': '0.4727', 'learning_rate': '1.397e-05', 'entropy': '0.5496', 'num_tokens': '3.621e+06', 'mean_token_accuracy': '0.9462', 'epoch': '0.839'}
 84%|████████▍ | 280/334 [2:03:14<18:50, 20.94s/it]

 84%|████████▍ | 280/334 [2:03:14<18:50, 20.94s/it]
 84%|████████▍ | 281/334 [2:03:27<16:31, 18.70s/it]
 84%|████████▍ | 282/334 [2:04:00<19:49, 22.88s/it]
 85%|████████▍ | 283/334 [2:04:19<18:25, 21.67s/it]
 85%|████████▌ | 284/334 [2:04:36<16:54, 20.29s/it]
 85%|████████▌ | 285/334 [2:05:10<19:53, 24.37s/it]
 86%|████████▌ | 286/334 [2:05:38<20:34, 25.71s/it]
 86%|████████▌ | 287/334 [2:06:06<20:32, 26.22s/it]
 86%|████████▌ | 288/334 [2:06:33<20:22, 26.58s/it]
 87%|████████▋ | 289/334 [2:06:59<19:49, 26.43s/it]
 87%|████████▋ | 290/334 [2:07:17<17:27, 23.81s/it]

{'loss': '0.3758', 'grad_norm': '0.3125', 'learning_rate': '9.426e-06', 'entropy': '0.5783', 'num_tokens': '3.742e+06', 'mean_token_accuracy': '0.9431', 'epoch': '0.8689'}
 87%|████████▋ | 290/334 [2:07:17<17:27, 23.81s/it]
 87%|████████▋ | 291/334 [2:07:50<18:57, 26.45s/it]
 87%|████████▋ | 292/334 [2:08:17<18:39, 26.66s/it]
 88%|████████▊ | 293/334 [2:08:49<19:22, 28.34s/it]
 88%|████████▊ | 294/334 [2:09:23<20:00, 30.00s/it]
 88%|████████▊ | 295/334 [2:09:40<16:59, 26.14s/it]
 89%|████████▊ | 296/334 [2:10:09<17:00, 26.87s/it]
 89%|████████▉ | 297/334 [2:10:34<16:12, 26.27s/it]
 89%|████████▉ | 298/334 [2:11:01<16:00, 26.68s/it]
 90%|████████▉ | 299/334 [2:11:24<14:49, 25.42s/it]
 90%|████████▉ | 300/334 [2:11:51<14:44, 26.02s/it]

{'loss': '0.3589', 'grad_norm': '0.1221', 'learning_rate': '5.739e-06', 'entropy': '0.5001', 'num_tokens': '3.878e+06', 'mean_token_accuracy': '0.9444', 'epoch': '0.8989'}
 90%|████████▉ | 300/334 [2:11:51<14:44, 26.02s/it]
 90%|█████████ | 301/334 [2:12:25<15:36, 28.38s/it]
 90%|█████████ | 302/334 [2:12:59<16:01, 30.04s/it]
 91%|█████████ | 303/334 [2:13:33<16:06, 31.19s/it]
 91%|█████████ | 304/334 [2:13:48<13:11, 26.39s/it]
 91%|█████████▏| 305/334 [2:14:14<12:43, 26.32s/it]
 92%|█████████▏| 306/334 [2:14:39<12:08, 26.03s/it]
 92%|█████████▏| 307/334 [2:15:06<11:50, 26.32s/it]
 92%|█████████▏| 308/334 [2:15:35<11:44, 27.09s/it]
 93%|█████████▎| 309/334 [2:16:04<11:26, 27.47s/it]
{'loss': '0.3513', 'grad_norm': '0.4883', 'learning_rate': '2.942e-06', 'entropy': '0.5135', 'num_tokens': '4.011e+06', 'mean_token_accuracy': '0.9434', 'epoch': '0.9288'}
 93%|█████████▎| 310/334 [2:16:20<09:40, 24.19s/it]

 93%|█████████▎| 310/334 [2:16:20<09:40, 24.19s/it]
 93%|█████████▎| 311/334 [2:16:54<10:23, 27.11s/it]
 93%|█████████▎| 312/334 [2:17:14<09:05, 24.78s/it]
 94%|█████████▎| 313/334 [2:17:45<09:20, 26.67s/it]
 94%|█████████▍| 314/334 [2:18:17<09:29, 28.48s/it]
 94%|█████████▍| 315/334 [2:18:40<08:29, 26.80s/it]
 95%|█████████▍| 316/334 [2:19:10<08:16, 27.60s/it]
 95%|█████████▍| 317/334 [2:19:36<07:42, 27.21s/it]
 95%|█████████▌| 318/334 [2:19:57<06:47, 25.46s/it]
 96%|█████████▌| 319/334 [2:20:23<06:23, 25.55s/it]
 96%|█████████▌| 320/334 [2:20:56<06:27, 27.71s/it]

{'loss': '0.3806', 'grad_norm': '0.3184', 'learning_rate': '1.062e-06', 'entropy': '0.4994', 'num_tokens': '4.147e+06', 'mean_token_accuracy': '0.9451', 'epoch': '0.9588'}
 96%|█████████▌| 320/334 [2:20:56<06:27, 27.71s/it]
 96%|█████████▌| 321/334 [2:21:26<06:08, 28.34s/it]
 96%|█████████▋| 322/334 [2:21:44<05:03, 25.29s/it]
 97%|█████████▋| 323/334 [2:22:18<05:06, 27.85s/it]
 97%|█████████▋| 324/334 [2:22:45<04:37, 27.71s/it]
 97%|█████████▋| 325/334 [2:23:19<04:25, 29.55s/it]
 98%|█████████▊| 326/334 [2:23:46<03:51, 28.90s/it]
 98%|█████████▊| 327/334 [2:24:06<03:03, 26.27s/it]
 98%|█████████▊| 328/334 [2:24:40<02:51, 28.56s/it]
 99%|█████████▊| 329/334 [2:25:10<02:23, 28.80s/it]
{'loss': '0.3831', 'grad_norm': '0.165', 'learning_rate': '1.182e-07', 'entropy': '0.5192', 'num_tokens': '4.284e+06', 'mean_token_accuracy': '0.9417', 'epoch': '0.9888'}
 99%|█████████▉| 330/334 [2:25:34<01:50, 27.52s/it]

 99%|█████████▉| 330/334 [2:25:34<01:50, 27.52s/it]
 99%|█████████▉| 331/334 [2:26:08<01:28, 29.43s/it]
 99%|█████████▉| 332/334 [2:26:32<00:55, 27.79s/it]
100%|█████████▉| 333/334 [2:27:03<00:28, 28.59s/it]
100%|██████████| 334/334 [2:27:19<00:00, 24.92s/it]
 0%| | 0/28 [00:00<?, ?it/s]
 7%|▋ | 2/28 [00:02<00:34, 1.34s/it]
 11%|█ | 3/28 [00:05<00:50, 2.03s/it]
 14%|█▍ | 4/28 [00:08<00:57, 2.38s/it]
 18%|█▊ | 5/28 [00:11<00:59, 2.59s/it]
 21%|██▏ | 6/28 [00:14<00:59, 2.73s/it]
 25%|██▌ | 7/28 [00:17<00:59, 2.81s/it]
 29%|██▊ | 8/28 [00:20<00:57, 2.86s/it]
 36%|███▌ | 10/28 [00:23<00:39, 2.21s/it]
 39%|███▉ | 11/28 [00:26<00:40, 2.40s/it]
 43%|████▎ | 12/28 [00:29<00:40, 2.56s/it]
 46%|████▋ | 13/28 [00:32<00:40, 2.67s/it]
 50%|█████ | 14/28 [00:33<00:32, 2.33s/it]
 54%|█████▎ | 15/28 [00:36<00:32, 2.52s/it]
 57%|█████▋ | 16/28 [00:39<00:31, 2.66s/it]
 61%|██████ | 17/28 [00:42<00:30, 2.75s/it]
 64%|██████▍ | 18/28 [00:45<00:28, 2.82s/it]
 71%|███████▏ | 20/28 [00:47<00:14, 1.78s/it]
 79%|███████▊ | 22/28 [00:49<00:09, 1.57s/it]
 86%|████████▌ | 24/28 [00:50<00:04, 1.23s/it]
 93%|█████████▎| 26/28 [00:56<00:03, 1.83s/it]
{'eval_loss': '0.3855', 'eval_runtime': '63.65', 'eval_samples_per_second': '0.44', 'eval_steps_per_second': '0.44', 'eval_entropy': '0.5432', 'eval_num_tokens': '4.336e+06', 'eval_mean_token_accuracy': '0.9426', 'epoch': '1'}
 96%|█████████▋| 27/28 [00:59<00:02, 2.05s/it]


100%|██████████| 334/334 [2:28:23<00:00, 24.92s/it]
100%|██████████| 28/28 [01:00<00:00, 2.05s/it]
 22:27:43 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
22:27:43 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/config.json "HTTP/1.1 200 OK"
22:27:44 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
22:27:44 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/config.json "HTTP/1.1 200 OK"
{'train_runtime': '8903', 'train_samples_per_second': '0.15', 'train_steps_per_second': '0.038', 'train_loss': '0.3883', 'epoch': '1'}

100%|██████████| 334/334 [2:28:23<00:00, 24.92s/it]
100%|██████████| 334/334 [2:28:23<00:00, 26.66s/it]
22:27:44 [INFO] Saving to /tmp/sre-sft-7p8tsnrk
22:27:44 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
22:27:44 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/config.json "HTTP/1.1 200 OK"
22:27:44 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
22:27:44 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/config.json "HTTP/1.1 200 OK"
22:27:44 [INFO] Pushing to Hub: https://huggingface.co/sohambose98/sre-sft-lora
22:27:44 [INFO] HTTP Request: POST https://huggingface.co/api/repos/create "HTTP/1.1 409 Conflict"
22:27:44 [INFO] HTTP Request: POST https://huggingface.co/api/repos/create "HTTP/1.1 409 Conflict"
22:27:44 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
22:27:44 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/config.json "HTTP/1.1 200 OK"
22:27:44 [INFO] HTTP Request: HEAD https://huggingface.co/Qwen/Qwen2.5-7B/resolve/main/config.json "HTTP/1.1 307 Temporary Redirect"
22:27:44 [INFO] HTTP Request: HEAD https://huggingface.co/api/resolve-cache/models/Qwen/Qwen2.5-7B/d149729398750b98c0af14eb82c78cfe92750796/config.json "HTTP/1.1 200 OK"
22:27:44 [INFO] HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
22:27:44 [INFO] HTTP Request: POST https://huggingface.co/api/validate-yaml "HTTP/1.1 200 OK"
22:27:44 [INFO] HTTP Request: POST https://huggingface.co/api/models/sohambose98/sre-sft-lora/preupload/main "HTTP/1.1 200 OK"
22:27:44 [INFO] HTTP Request: POST https://huggingface.co/sohambose98/sre-sft-lora.git/info/lfs/objects/batch "HTTP/1.1 200 OK"
22:27:44 [INFO] HTTP Request: GET https://huggingface.co/api/models/sohambose98/sre-sft-lora/xet-write-token/main "HTTP/1.1 200 OK"
Processing Files (0 / 0) : | | 0.00B / 0.00B
New Data Upload : | | 0.00B / 0.00B 
 ...t-7p8tsnrk/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB 
 ...adapter_model.safetensors: 95%|█████████▌| 9.61MB / 10.1MB 
 ...p8tsnrk/training_args.bin: 95%|█████████▌| 5.98kB / 6.29kB 
 ...t-7p8tsnrk/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB 
 ...adapter_model.safetensors: 95%|█████████▌| 9.61MB / 10.1MB 
 ...p8tsnrk/training_args.bin: 95%|█████████▌| 5.98kB / 6.29kB 
 ...t-7p8tsnrk/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB 
 ...adapter_model.safetensors: 100%|██████████| 10.1MB / 10.1MB 
 ...p8tsnrk/training_args.bin: 100%|██████████| 6.29kB / 6.29kB 
 ...t-7p8tsnrk/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB 
 ...adapter_model.safetensors: 100%|██████████| 10.1MB / 10.1MB 
 ...p8tsnrk/training_args.bin: 100%|██████████| 6.29kB / 6.29kB 
Processing Files (3 / 3) : 100%|██████████| 21.5MB / 21.5MB, 2.48MB/s
New Data Upload : 100%|██████████| 10.1MB / 10.1MB, 2.48MB/s
...t-7p8tsnrk/tokenizer.json: 100%|██████████| 11.4MB / 11.4MB
...adapter_model.safetensors: 100%|██████████| 10.1MB / 10.1MB
...p8tsnrk/training_args.bin: 100%|██████████| 6.29kB / 6.29kB
22:27:45 [INFO] HTTP Request: POST https://huggingface.co/api/models/sohambose98/sre-sft-lora/commit/main "HTTP/1.1 200 OK"
22:27:45 [INFO] Pushed adapter/tokenizer to https://huggingface.co/sohambose98/sre-sft-lora
22:27:45 [INFO] Removing local --output-dir (--no-keep-local): /tmp/sre-sft-7p8tsnrk
22:27:45 [INFO] Done.