[09:10:27] config {'DATASET': 'staged', 'EPOCHS': 40.0, 'MODEL_REPO': 'smjain/sap-archgen-lfm2-230M', 'GGUF_REPO': 'smjain/sap-archgen-lfm2-230M-GGUF', 'GGUF_FILE': 'sap-archgen-lfm2-230M-Q4_0.gguf'}
/usr/local/lib/python3.11/dist-packages/huggingface_hub/constants.py:298: FutureWarning: The `HF_HUB_ENABLE_HF_TRANSFER` environment variable is deprecated as 'hf_transfer' is not used anymore. Please use `HF_XET_HIGH_PERFORMANCE` instead to enable high performance transfer with Xet. Visit https://huggingface.co/docs/huggingface_hub/package_reference/environment_variables#hfxethighperformance for more details.
  warnings.warn(
🦥 Unsloth: Will patch your computer to enable 2x faster free finetuning.
🦥 Unsloth Zoo will now patch everything to make training faster!
[09:10:37] loading unsloth/LFM2.5-230M
==((====))==  Unsloth 2026.6.9: Fast Lfm2 patching. Transformers: 5.5.0.
   \\   /|    NVIDIA A100 80GB PCIe. Num GPUs = 1. Max memory: 79.25 GB. Platform: Linux.
O^O/ \_/ \    Torch: 2.10.0+cu128. CUDA: 8.0. CUDA Toolkit: 12.8. Triton: 3.6.0
\        /    Bfloat16 = TRUE. FA [Xformers = 0.0.35. FA2 = False]
 "-____-"     Free license: http://github.com/unslothai/unsloth
Unsloth: Fast downloading is enabled - ignore downloading bars which are red colored!
Unsloth: QLoRA and full finetuning all not selected. Switching to 16bit LoRA.

Loading weights:   0%|          | 0/132 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 132/132 [00:00<00:00, 3371.61it/s]
[09:10:57] loaded unsloth/LFM2.5-230M
Unsloth: Explicit target_modules are constrained by the finetune_(vision|language|attention|mlp) filters; adapters attach only where both select.

Generating train split: 0 examples [00:00, ? examples/s]
Generating train split: 507 examples [00:00, 71802.81 examples/s]
[09:10:59] train rows 507 from dataset/train_staged.jsonl

Map:   0%|          | 0/507 [00:00<?, ? examples/s]
Map:  67%|██████▋   | 341/507 [00:00<00:00, 3378.96 examples/s]
Map: 100%|██████████| 507/507 [00:00<00:00, 3264.02 examples/s]
warmup_ratio is deprecated and will be removed in v5.2. Use `warmup_steps` instead.

Unsloth: Tokenizing ["text"] (num_proc=64):   0%|          | 0/507 [00:00<?, ? examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):   2%|▏         | 8/507 [00:02<02:11,  3.79 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):   5%|▍         | 24/507 [00:02<00:35, 13.58 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):   8%|▊         | 40/507 [00:02<00:18, 25.56 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  13%|█▎        | 64/507 [00:02<00:09, 45.41 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  19%|█▉        | 96/507 [00:02<00:05, 73.17 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  24%|██▎       | 120/507 [00:02<00:04, 95.27 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  28%|██▊       | 144/507 [00:02<00:03, 111.95 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  33%|███▎      | 168/507 [00:03<00:02, 124.01 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  38%|███▊      | 192/507 [00:03<00:02, 137.83 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  43%|████▎     | 216/507 [00:03<00:02, 136.53 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  49%|████▉     | 248/507 [00:03<00:01, 160.09 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  54%|█████▎    | 272/507 [00:03<00:01, 164.81 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  58%|█████▊    | 296/507 [00:03<00:01, 160.92 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  63%|██████▎   | 320/507 [00:03<00:01, 167.46 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  68%|██████▊   | 344/507 [00:04<00:01, 159.34 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  73%|███████▎  | 368/507 [00:04<00:00, 164.31 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  77%|███████▋  | 392/507 [00:04<00:00, 175.77 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  82%|████████▏ | 416/507 [00:04<00:00, 163.05 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  87%|████████▋ | 440/507 [00:04<00:00, 175.69 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  92%|█████████▏| 464/507 [00:04<00:00, 180.20 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64):  96%|█████████▌| 486/507 [00:04<00:00, 179.05 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64): 100%|██████████| 507/507 [00:05<00:00, 171.25 examples/s]
Unsloth: Tokenizing ["text"] (num_proc=64): 100%|██████████| 507/507 [00:05<00:00, 86.45 examples/s] 
🦥 Unsloth: Padding-free auto-enabled, enabling faster training.

Map (num_proc=64):   0%|          | 0/507 [00:00<?, ? examples/s]
Map (num_proc=64):   2%|▏         | 8/507 [00:02<02:31,  3.29 examples/s]
Map (num_proc=64):  39%|███▉      | 200/507 [00:02<00:02, 109.31 examples/s]
Map (num_proc=64): 100%|██████████| 507/507 [00:03<00:00, 154.01 examples/s]

Filter (num_proc=64):   0%|          | 0/507 [00:00<?, ? examples/s]
Filter (num_proc=64):   2%|▏         | 8/507 [00:02<02:28,  3.36 examples/s]
Filter (num_proc=64):  35%|███▍      | 176/507 [00:02<00:03, 98.09 examples/s]
Filter (num_proc=64): 100%|██████████| 507/507 [00:03<00:00, 161.82 examples/s]
[09:11:12] responses-only masking on
[09:11:12] === train ===
==((====))==  Unsloth - 2x faster free finetuning | Num GPUs used = 1
   \\   /|    Num examples = 507 | Num Epochs = 40 | Total steps = 2,560
O^O/ \_/ \    Batch size per device = 2 | Gradient accumulation steps = 4
\        /    Data Parallel GPUs = 1 | Total batch size (2 x 4 x 1) = 8
 "-____-"     Trainable parameters = 983,040 of 230,676,224 (0.43% trained)

  0%|          | 0/2560 [00:00<?, ?it/s]
  0%|          | 1/2560 [00:20<14:23:24, 20.24s/it]
  0%|          | 2/2560 [00:20<6:04:23,  8.55s/it] 
                                                  

  0%|          | 2/2560 [00:20<6:04:23,  8.55s/it]
  0%|          | 3/2560 [00:20<3:23:15,  4.77s/it]
  0%|          | 4/2560 [00:21<2:07:35,  3.00s/it]
                                                  

  0%|          | 4/2560 [00:21<2:07:35,  3.00s/it]
  0%|          | 5/2560 [00:21<1:25:42,  2.01s/it]
  0%|          | 6/2560 [00:21<1:00:51,  1.43s/it]
                                                  

  0%|          | 6/2560 [00:21<1:00:51,  1.43s/it]
  0%|          | 7/2560 [00:21<44:44,  1.05s/it]  
  0%|          | 8/2560 [00:22<34:17,  1.24it/s]
                                                

  0%|          | 8/2560 [00:22<34:17,  1.24it/s]
  0%|          | 9/2560 [00:22<27:12,  1.56it/s]
  0%|          | 10/2560 [00:22<22:18,  1.91it/s]
                                                 

  0%|          | 10/2560 [00:22<22:18,  1.91it/s]
  0%|          | 11/2560 [00:23<19:01,  2.23it/s]
  0%|          | 12/2560 [00:23<16:45,  2.53it/s]
                                                 

  0%|          | 12/2560 [00:23<16:45,  2.53it/s]
  1%|          | 13/2560 [00:23<15:09,  2.80it/s]
  1%|          | 14/2560 [00:23<14:01,  3.02it/s]
                                                 

  1%|          | 14/2560 [00:23<14:01,  3.02it/s]
  1%|          | 15/2560 [00:24<13:14,  3.20it/s]
  1%|          | 16/2560 [00:24<12:51,  3.30it/s]
                                                 

  1%|          | 16/2560 [00:24<12:51,  3.30it/s]
  1%|          | 17/2560 [00:24<12:35,  3.37it/s]
  1%|          | 18/2560 [00:25<12:15,  3.46it/s]
                                                 

  1%|          | 18/2560 [00:25<12:15,  3.46it/s]
  1%|          | 19/2560 [00:25<12:13,  3.47it/s]
  1%|          | 20/2560 [00:25<12:06,  3.50it/s]
                                                 

  1%|          | 20/2560 [00:25<12:06,  3.50it/s]
  1%|          | 21/2560 [00:25<11:54,  3.55it/s]
  1%|          | 22/2560 [00:26<11:39,  3.63it/s]
                                                 

  1%|          | 22/2560 [00:26<11:39,  3.63it/s]
  1%|          | 23/2560 [00:26<11:32,  3.67it/s]
  1%|          | 24/2560 [00:26<11:27,  3.69it/s]
                                                 

  1%|          | 24/2560 [00:26<11:27,  3.69it/s]
  1%|          | 25/2560 [00:26<11:19,  3.73it/s]
  1%|          | 26/2560 [00:27<11:20,  3.72it/s]
                                                 

  1%|          | 26/2560 [00:27<11:20,  3.72it/s]
  1%|          | 27/2560 [00:27<11:16,  3.75it/s]
  1%|          | 28/2560 [00:27<11:38,  3.62it/s]
                                                 

  1%|          | 28/2560 [00:27<11:38,  3.62it/s]
  1%|          | 29/2560 [00:28<11:41,  3.61it/s]
  1%|          | 30/2560 [00:28<11:35,  3.64it/s]
                                                 

  1%|          | 30/2560 [00:28<11:35,  3.64it/s]
  1%|          | 31/2560 [00:28<11:36,  3.63it/s]
  1%|▏         | 32/2560 [00:28<11:31,  3.65it/s]
                                                 

  1%|▏         | 32/2560 [00:28<11:31,  3.65it/s]
  1%|▏         | 33/2560 [00:29<11:34,  3.64it/s]
  1%|▏         | 34/2560 [00:29<11:30,  3.66it/s]
                                                 

  1%|▏         | 34/2560 [00:29<11:30,  3.66it/s]
  1%|▏         | 35/2560 [00:29<11:28,  3.67it/s]
  1%|▏         | 36/2560 [00:29<11:21,  3.70it/s]
                                                 

  1%|▏         | 36/2560 [00:29<11:21,  3.70it/s]
  1%|▏         | 37/2560 [00:30<11:19,  3.71it/s]
  1%|▏         | 38/2560 [00:30<11:16,  3.73it/s]
                                                 

  1%|▏         | 38/2560 [00:30<11:16,  3.73it/s]
  2%|▏         | 39/2560 [00:30<11:19,  3.71it/s]
  2%|▏         | 40/2560 [00:30<11:23,  3.69it/s]
                                                 

  2%|▏         | 40/2560 [00:30<11:23,  3.69it/s]
  2%|▏         | 41/2560 [00:31<11:23,  3.68it/s]
  2%|▏         | 42/2560 [00:31<11:27,  3.66it/s]
                                                 

  2%|▏         | 42/2560 [00:31<11:27,  3.66it/s]
  2%|▏         | 43/2560 [00:31<11:28,  3.66it/s]
  2%|▏         | 44/2560 [00:32<11:25,  3.67it/s]
                                                 

  2%|▏         | 44/2560 [00:32<11:25,  3.67it/s]
  2%|▏         | 45/2560 [00:32<11:27,  3.66it/s]
  2%|▏         | 46/2560 [00:32<11:20,  3.70it/s]
                                                 

  2%|▏         | 46/2560 [00:32<11:20,  3.70it/s]
  2%|▏         | 47/2560 [00:32<11:19,  3.70it/s]
  2%|▏         | 48/2560 [00:33<11:22,  3.68it/s]
                                                 

  2%|▏         | 48/2560 [00:33<11:22,  3.68it/s]
  2%|▏         | 49/2560 [00:33<11:25,  3.66it/s]
  2%|▏         | 50/2560 [00:33<11:22,  3.68it/s]
                                                 

  2%|▏         | 50/2560 [00:33<11:22,  3.68it/s]
  2%|▏         | 51/2560 [00:33<11:17,  3.70it/s]
  2%|▏         | 52/2560 [00:34<11:14,  3.72it/s]
                                                 

  2%|▏         | 52/2560 [00:34<11:14,  3.72it/s]
  2%|▏         | 53/2560 [00:34<11:18,  3.69it/s]
  2%|▏         | 54/2560 [00:34<11:31,  3.63it/s]
                                                 

  2%|▏         | 54/2560 [00:34<11:31,  3.63it/s]
  2%|▏         | 55/2560 [00:35<11:30,  3.63it/s]
  2%|▏         | 56/2560 [00:35<11:35,  3.60it/s]
                                                 

  2%|▏         | 56/2560 [00:35<11:35,  3.60it/s]
  2%|▏         | 57/2560 [00:35<11:36,  3.59it/s]
  2%|▏         | 58/2560 [00:35<11:43,  3.56it/s]
                                                 

  2%|▏         | 58/2560 [00:35<11:43,  3.56it/s]
  2%|▏         | 59/2560 [00:36<11:42,  3.56it/s]
  2%|▏         | 60/2560 [00:36<11:34,  3.60it/s]
                                                 

  2%|▏         | 60/2560 [00:36<11:34,  3.60it/s]
  2%|▏         | 61/2560 [00:36<11:27,  3.63it/s]
  2%|▏         | 62/2560 [00:37<11:21,  3.67it/s]
                                                 

  2%|▏         | 62/2560 [00:37<11:21,  3.67it/s]
  2%|▏         | 63/2560 [00:37<11:22,  3.66it/s]
  2%|▎         | 64/2560 [00:47<2:16:26,  3.28s/it]
                                                   

  2%|▎         | 64/2560 [00:47<2:16:26,  3.28s/it]
  3%|▎         | 65/2560 [00:47<1:38:59,  2.38s/it]
  3%|▎         | 66/2560 [00:48<1:12:42,  1.75s/it]
                                                   

  3%|▎         | 66/2560 [00:48<1:12:42,  1.75s/it]
  3%|▎         | 67/2560 [00:48<54:28,  1.31s/it]  
  3%|▎         | 68/2560 [00:48<41:31,  1.00it/s]
                                                 

  3%|▎         | 68/2560 [00:48<41:31,  1.00it/s]
  3%|▎         | 69/2560 [00:48<32:30,  1.28it/s]
  3%|▎         | 70/2560 [00:49<26:16,  1.58it/s]
                                                 

  3%|▎         | 70/2560 [00:49<26:16,  1.58it/s]
  3%|▎         | 71/2560 [00:49<21:57,  1.89it/s]
  3%|▎         | 72/2560 [00:49<18:59,  2.18it/s]
                                                 

  3%|▎         | 72/2560 [00:49<18:59,  2.18it/s]
  3%|▎         | 73/2560 [00:50<16:56,  2.45it/s]
  3%|▎         | 74/2560 [00:50<15:20,  2.70it/s]
                                                 

  3%|▎         | 74/2560 [00:50<15:20,  2.70it/s]
  3%|▎         | 75/2560 [00:50<14:19,  2.89it/s]
  3%|▎         | 76/2560 [00:51<13:37,  3.04it/s]
                                                 

  3%|▎         | 76/2560 [00:51<13:37,  3.04it/s]
  3%|▎         | 77/2560 [00:51<13:10,  3.14it/s]
  3%|▎         | 78/2560 [00:51<12:50,  3.22it/s]
                                                 

  3%|▎         | 78/2560 [00:51<12:50,  3.22it/s]
  3%|▎         | 79/2560 [00:51<12:33,  3.29it/s]
  3%|▎         | 80/2560 [00:52<12:23,  3.34it/s]
                                                 

  3%|▎         | 80/2560 [00:52<12:23,  3.34it/s]
  3%|▎         | 81/2560 [00:52<12:01,  3.44it/s]
  3%|▎         | 82/2560 [00:52<11:47,  3.50it/s]
                                                 

  3%|▎         | 82/2560 [00:52<11:47,  3.50it/s]
  3%|▎         | 83/2560 [00:52<11:35,  3.56it/s]
  3%|▎         | 84/2560 [00:53<11:31,  3.58it/s]
                                                 

  3%|▎         | 84/2560 [00:53<11:31,  3.58it/s]
  3%|▎         | 85/2560 [00:53<11:21,  3.63it/s]
  3%|▎         | 86/2560 [00:53<11:21,  3.63it/s]
                                                 

  3%|▎         | 86/2560 [00:53<11:21,  3.63it/s]
  3%|▎         | 87/2560 [00:54<11:16,  3.66it/s]
  3%|▎         | 88/2560 [00:54<11:17,  3.65it/s]
                                                 

  3%|▎         | 88/2560 [00:54<11:17,  3.65it/s]
  3%|▎         | 89/2560 [00:54<11:15,  3.66it/s]
  4%|▎         | 90/2560 [00:54<11:10,  3.68it/s]
                                                 

  4%|▎         | 90/2560 [00:54<11:10,  3.68it/s]
  4%|▎         | 91/2560 [00:55<11:13,  3.66it/s]
  4%|▎         | 92/2560 [00:55<11:10,  3.68it/s]
                                                 

  4%|▎         | 92/2560 [00:55<11:10,  3.68it/s]
  4%|▎         | 93/2560 [00:55<11:15,  3.65it/s]
  4%|▎         | 94/2560 [00:55<11:13,  3.66it/s]
                                                 

  4%|▎         | 94/2560 [00:55<11:13,  3.66it/s]
  4%|▎         | 95/2560 [00:56<11:14,  3.66it/s]
  4%|▍         | 96/2560 [00:56<11:10,  3.67it/s]
                                                 

  4%|▍         | 96/2560 [00:56<11:10,  3.67it/s]
  4%|▍         | 97/2560 [00:56<11:05,  3.70it/s]
  4%|▍         | 98/2560 [00:57<11:02,  3.71it/s]
                                                 

  4%|▍         | 98/2560 [00:57<11:02,  3.71it/s]
  4%|▍         | 99/2560 [00:57<11:06,  3.69it/s]
  4%|▍         | 100/2560 [00:57<11:05,  3.70it/s]
                                                  

  4%|▍         | 100/2560 [00:57<11:05,  3.70it/s]
  4%|▍         | 101/2560 [00:57<11:04,  3.70it/s]
  4%|▍         | 102/2560 [00:58<11:05,  3.69it/s]
                                                  

  4%|▍         | 102/2560 [00:58<11:05,  3.69it/s]
  4%|▍         | 103/2560 [00:58<11:01,  3.71it/s]
  4%|▍         | 104/2560 [00:58<11:00,  3.72it/s]
                                                  

  4%|▍         | 104/2560 [00:58<11:00,  3.72it/s]
  4%|▍         | 105/2560 [00:58<11:03,  3.70it/s]
  4%|▍         | 106/2560 [00:59<10:57,  3.73it/s]
                                                  

  4%|▍         | 106/2560 [00:59<10:57,  3.73it/s]
  4%|▍         | 107/2560 [00:59<10:53,  3.76it/s]
  4%|▍         | 108/2560 [00:59<10:49,  3.77it/s]
                                                  

  4%|▍         | 108/2560 [00:59<10:49,  3.77it/s]
  4%|▍         | 109/2560 [01:00<10:50,  3.77it/s]
  4%|▍         | 110/2560 [01:00<10:50,  3.76it/s]
                                                  

  4%|▍         | 110/2560 [01:00<10:50,  3.76it/s]
  4%|▍         | 111/2560 [01:00<10:50,  3.77it/s]
  4%|▍         | 112/2560 [01:00<10:47,  3.78it/s]
                                                  

  4%|▍         | 112/2560 [01:00<10:47,  3.78it/s]
  4%|▍         | 113/2560 [01:01<10:45,  3.79it/s]
  4%|▍         | 114/2560 [01:01<10:42,  3.81it/s]
                                                  

  4%|▍         | 114/2560 [01:01<10:42,  3.81it/s]
  4%|▍         | 115/2560 [01:01<10:43,  3.80it/s]
  5%|▍         | 116/2560 [01:01<10:41,  3.81it/s]
                                                  

  5%|▍         | 116/2560 [01:01<10:41,  3.81it/s]
  5%|▍         | 117/2560 [01:02<10:40,  3.82it/s]
  5%|▍         | 118/2560 [01:02<10:42,  3.80it/s]
                                                  

  5%|▍         | 118/2560 [01:02<10:42,  3.80it/s]
  5%|▍         | 119/2560 [01:02<10:42,  3.80it/s]
  5%|▍         | 120/2560 [01:02<10:42,  3.80it/s]
                                                  

  5%|▍         | 120/2560 [01:02<10:42,  3.80it/s]
  5%|▍         | 121/2560 [01:03<10:45,  3.78it/s]
  5%|▍         | 122/2560 [01:03<10:50,  3.75it/s]
                                                  

  5%|▍         | 122/2560 [01:03<10:50,  3.75it/s]
  5%|▍         | 123/2560 [01:03<10:49,  3.75it/s]
  5%|▍         | 124/2560 [01:03<10:53,  3.73it/s]
                                                  

  5%|▍         | 124/2560 [01:03<10:53,  3.73it/s]
  5%|▍         | 125/2560 [01:04<10:53,  3.73it/s]
  5%|▍         | 126/2560 [01:04<10:54,  3.72it/s]
                                                  

  5%|▍         | 126/2560 [01:04<10:54,  3.72it/s]
  5%|▍         | 127/2560 [01:04<10:52,  3.73it/s]
  5%|▌         | 128/2560 [01:04<09:09,  4.42it/s]
                                                  

  5%|▌         | 128/2560 [01:04<09:09,  4.42it/s]
  5%|▌         | 129/2560 [01:05<09:39,  4.20it/s]
  5%|▌         | 130/2560 [01:05<09:58,  4.06it/s]
                                                  

  5%|▌         | 130/2560 [01:05<09:58,  4.06it/s]
  5%|▌         | 131/2560 [01:05<10:15,  3.95it/s]
  5%|▌         | 132/2560 [01:05<10:24,  3.89it/s]
                                                  

  5%|▌         | 132/2560 [01:05<10:24,  3.89it/s]
  5%|▌         | 133/2560 [01:06<10:39,  3.79it/s]
  5%|▌         | 134/2560 [01:06<10:45,  3.76it/s]
                                                  

  5%|▌         | 134/2560 [01:06<10:45,  3.76it/s]
  5%|▌         | 135/2560 [01:06<10:48,  3.74it/s]
  5%|▌         | 136/2560 [01:07<10:52,  3.72it/s]
                                                  

  5%|▌         | 136/2560 [01:07<10:52,  3.72it/s]
  5%|▌         | 137/2560 [01:07<10:50,  3.72it/s]
  5%|▌         | 138/2560 [01:07<10:52,  3.71it/s]
                                                  

  5%|▌         | 138/2560 [01:07<10:52,  3.71it/s]
  5%|▌         | 139/2560 [01:07<10:52,  3.71it/s]
  5%|▌         | 140/2560 [01:08<10:59,  3.67it/s]
                                                  

  5%|▌         | 140/2560 [01:08<10:59,  3.67it/s]
  6%|▌         | 141/2560 [01:08<11:00,  3.66it/s]
  6%|▌         | 142/2560 [01:08<11:01,  3.66it/s]
                                                  

  6%|▌         | 142/2560 [01:08<11:01,  3.66it/s]
  6%|▌         | 143/2560 [01:08<11:01,  3.65it/s]
  6%|▌         | 144/2560 [01:09<11:04,  3.64it/s]
                                                  

  6%|▌         | 144/2560 [01:09<11:04,  3.64it/s]
  6%|▌         | 145/2560 [01:09<11:03,  3.64it/s]
  6%|▌         | 146/2560 [01:09<10:56,  3.68it/s]
                                                  

  6%|▌         | 146/2560 [01:09<10:56,  3.68it/s]
  6%|▌         | 147/2560 [01:10<10:51,  3.70it/s]
  6%|▌         | 148/2560 [01:10<10:54,  3.69it/s]
                                                  

  6%|▌         | 148/2560 [01:10<10:54,  3.69it/s]
  6%|▌         | 149/2560 [01:10<11:01,  3.64it/s]
  6%|▌         | 150/2560 [01:10<10:56,  3.67it/s]
                                                  

  6%|▌         | 150/2560 [01:10<10:56,  3.67it/s]
  6%|▌         | 151/2560 [01:11<10:53,  3.68it/s]
  6%|▌         | 152/2560 [01:11<10:52,  3.69it/s]
                                                  

  6%|▌         | 152/2560 [01:11<10:52,  3.69it/s]
  6%|▌         | 153/2560 [01:11<10:56,  3.67it/s]
  6%|▌         | 154/2560 [01:11<10:54,  3.67it/s]
                                                  

  6%|▌         | 154/2560 [01:11<10:54,  3.67it/s]
  6%|▌         | 155/2560 [01:12<10:52,  3.69it/s]
  6%|▌         | 156/2560 [01:12<10:49,  3.70it/s]
                                                  

  6%|▌         | 156/2560 [01:12<10:49,  3.70it/s]
  6%|▌         | 157/2560 [01:12<10:47,  3.71it/s]
  6%|▌         | 158/2560 [01:13<10:50,  3.69it/s]
                                                  

  6%|▌         | 158/2560 [01:13<10:50,  3.69it/s]
  6%|▌         | 159/2560 [01:13<10:53,  3.67it/s]
  6%|▋         | 160/2560 [01:13<10:54,  3.67it/s]
                                                  

  6%|▋         | 160/2560 [01:13<10:54,  3.67it/s]
  6%|▋         | 161/2560 [01:13<10:52,  3.68it/s]
  6%|▋         | 162/2560 [01:14<11:00,  3.63it/s]
                                                  

  6%|▋         | 162/2560 [01:14<11:00,  3.63it/s]
  6%|▋         | 163/2560 [01:14<11:03,  3.61it/s]
  6%|▋         | 164/2560 [01:14<10:58,  3.64it/s]
                                                  

  6%|▋         | 164/2560 [01:14<10:58,  3.64it/s]
  6%|▋         | 165/2560 [01:14<10:53,  3.67it/s]
  6%|▋         | 166/2560 [01:15<10:49,  3.68it/s]
                                                  

  6%|▋         | 166/2560 [01:15<10:49,  3.68it/s]
  7%|▋         | 167/2560 [01:15<10:52,  3.67it/s]
  7%|▋         | 168/2560 [01:15<10:52,  3.67it/s]
                                                  

  7%|▋         | 168/2560 [01:15<10:52,  3.67it/s]
  7%|▋         | 169/2560 [01:16<10:55,  3.65it/s]
  7%|▋         | 170/2560 [01:16<10:55,  3.65it/s]
                                                  

  7%|▋         | 170/2560 [01:16<10:55,  3.65it/s]
  7%|▋         | 171/2560 [01:16<10:54,  3.65it/s]
  7%|▋         | 172/2560 [01:16<10:53,  3.65it/s]
                                                  

  7%|▋         | 172/2560 [01:16<10:53,  3.65it/s]
  7%|▋         | 173/2560 [01:17<10:53,  3.65it/s]
  7%|▋         | 174/2560 [01:17<10:56,  3.63it/s]
                                                  

  7%|▋         | 174/2560 [01:17<10:56,  3.63it/s]
  7%|▋         | 175/2560 [01:17<10:58,  3.62it/s]
  7%|▋         | 176/2560 [01:17<10:54,  3.64it/s]
                                                  

  7%|▋         | 176/2560 [01:17<10:54,  3.64it/s]
  7%|▋         | 177/2560 [01:18<11:01,  3.60it/s]
  7%|▋         | 178/2560 [01:18<10:57,  3.62it/s]
                                                  

  7%|▋         | 178/2560 [01:18<10:57,  3.62it/s]
  7%|▋         | 179/2560 [01:18<10:54,  3.64it/s]
  7%|▋         | 180/2560 [01:19<10:55,  3.63it/s]
                                                  

  7%|▋         | 180/2560 [01:19<10:55,  3.63it/s]
  7%|▋         | 181/2560 [01:19<10:52,  3.64it/s]
  7%|▋         | 182/2560 [01:19<10:53,  3.64it/s]
                                                  
Unsloth: Will smartly offload gradients to save VRAM!
Unsloth: Double buffering enabled (parallel H2D + compute) for backward pass.
{'loss': '1.096', 'grad_norm': '0.8198', 'learning_rate': '1.563e-06', 'epoch': '0.0315'}
{'loss': '1.102', 'grad_norm': '0.9477', 'learning_rate': '4.688e-06', 'epoch': '0.06299'}
{'loss': '0.9812', 'grad_norm': '0.821', 'learning_rate': '7.813e-06', 'epoch': '0.09449'}
{'loss': '1.055', 'grad_norm': '0.769', 'learning_rate': '1.094e-05', 'epoch': '0.126'}
{'loss': '1.025', 'grad_norm': '0.8146', 'learning_rate': '1.406e-05', 'epoch': '0.1575'}
{'loss': '1.033', 'grad_norm': '0.8571', 'learning_rate': '1.719e-05', 'epoch': '0.189'}
{'loss': '1.105', 'grad_norm': '0.7632', 'learning_rate': '2.031e-05', 'epoch': '0.2205'}
{'loss': '0.925', 'grad_norm': '0.6978', 'learning_rate': '2.344e-05', 'epoch': '0.252'}
{'loss': '1.135', 'grad_norm': '0.8998', 'learning_rate': '2.656e-05', 'epoch': '0.2835'}
{'loss': '0.94', 'grad_norm': '0.685', 'learning_rate': '2.969e-05', 'epoch': '0.315'}
{'loss': '1.037', 'grad_norm': '0.6883', 'learning_rate': '3.281e-05', 'epoch': '0.3465'}
{'loss': '1.046', 'grad_norm': '0.6822', 'learning_rate': '3.594e-05', 'epoch': '0.378'}
{'loss': '1.005', 'grad_norm': '0.6473', 'learning_rate': '3.906e-05', 'epoch': '0.4094'}
{'loss': '0.873', 'grad_norm': '0.6008', 'learning_rate': '4.219e-05', 'epoch': '0.4409'}
{'loss': '0.8705', 'grad_norm': '0.5772', 'learning_rate': '4.531e-05', 'epoch': '0.4724'}
{'loss': '0.8717', 'grad_norm': '0.5217', 'learning_rate': '4.844e-05', 'epoch': '0.5039'}
{'loss': '0.9077', 'grad_norm': '0.5279', 'learning_rate': '5.156e-05', 'epoch': '0.5354'}
{'loss': '0.8161', 'grad_norm': '0.455', 'learning_rate': '5.469e-05', 'epoch': '0.5669'}
{'loss': '0.9145', 'grad_norm': '0.5229', 'learning_rate': '5.781e-05', 'epoch': '0.5984'}
{'loss': '0.8038', 'grad_norm': '0.4563', 'learning_rate': '6.094e-05', 'epoch': '0.6299'}
{'loss': '0.8248', 'grad_norm': '0.5025', 'learning_rate': '6.406e-05', 'epoch': '0.6614'}
{'loss': '0.8662', 'grad_norm': '0.5349', 'learning_rate': '6.719e-05', 'epoch': '0.6929'}
{'loss': '0.7494', 'grad_norm': '0.5124', 'learning_rate': '7.031e-05', 'epoch': '0.7244'}
{'loss': '0.7839', 'grad_norm': '0.4298', 'learning_rate': '7.344e-05', 'epoch': '0.7559'}
{'loss': '0.7506', 'grad_norm': '0.4659', 'learning_rate': '7.656e-05', 'epoch': '0.7874'}
{'loss': '0.7598', 'grad_norm': '0.4189', 'learning_rate': '7.969e-05', 'epoch': '0.8189'}
{'loss': '0.7084', 'grad_norm': '0.5491', 'learning_rate': '8.281e-05', 'epoch': '0.8504'}
{'loss': '0.6079', 'grad_norm': '0.4394', 'learning_rate': '8.594e-05', 'epoch': '0.8819'}
{'loss': '0.6359', 'grad_norm': '0.4704', 'learning_rate': '8.906e-05', 'epoch': '0.9134'}
{'loss': '0.524', 'grad_norm': '0.4165', 'learning_rate': '9.219e-05', 'epoch': '0.9449'}
{'loss': '0.5468', 'grad_norm': '0.4689', 'learning_rate': '9.531e-05', 'epoch': '0.9764'}
{'loss': '0.5142', 'grad_norm': '0.497', 'learning_rate': '9.844e-05', 'epoch': '1'}
{'loss': '0.5062', 'grad_norm': '0.4195', 'learning_rate': '0.0001016', 'epoch': '1.031'}
{'loss': '0.5843', 'grad_norm': '0.5416', 'learning_rate': '0.0001047', 'epoch': '1.063'}
{'loss': '0.4655', 'grad_norm': '0.4602', 'learning_rate': '0.0001078', 'epoch': '1.094'}
{'loss': '0.4774', 'grad_norm': '0.5728', 'learning_rate': '0.0001109', 'epoch': '1.126'}
{'loss': '0.4789', 'grad_norm': '0.6163', 'learning_rate': '0.0001141', 'epoch': '1.157'}
{'loss': '0.3547', 'grad_norm': '0.4308', 'learning_rate': '0.0001172', 'epoch': '1.189'}
{'loss': '0.4077', 'grad_norm': '0.4424', 'learning_rate': '0.0001203', 'epoch': '1.22'}
{'loss': '0.3709', 'grad_norm': '0.4384', 'learning_rate': '0.0001234', 'epoch': '1.252'}
{'loss': '0.3722', 'grad_norm': '0.4168', 'learning_rate': '0.0001266', 'epoch': '1.283'}
{'loss': '0.3115', 'grad_norm': '0.4003', 'learning_rate': '0.0001297', 'epoch': '1.315'}
{'loss': '0.3853', 'grad_norm': '0.538', 'learning_rate': '0.0001328', 'epoch': '1.346'}
{'loss': '0.3222', 'grad_norm': '0.484', 'learning_rate': '0.0001359', 'epoch': '1.378'}
{'loss': '0.3547', 'grad_norm': '0.6848', 'learning_rate': '0.0001391', 'epoch': '1.409'}
{'loss': '0.3044', 'grad_norm': '0.518', 'learning_rate': '0.0001422', 'epoch': '1.441'}
{'loss': '0.3153', 'grad_norm': '0.7332', 'learning_rate': '0.0001453', 'epoch': '1.472'}
{'loss': '0.3198', 'grad_norm': '0.542', 'learning_rate': '0.0001484', 'epoch': '1.504'}
{'loss': '0.259', 'grad_norm': '0.576', 'learning_rate': '0.0001516', 'epoch': '1.535'}
{'loss': '0.232', 'grad_norm': '0.4753', 'learning_rate': '0.0001547', 'epoch': '1.567'}
{'loss': '0.2082', 'grad_norm': '0.7106', 'learning_rate': '0.0001578', 'epoch': '1.598'}
{'loss': '0.2991', 'grad_norm': '0.8407', 'learning_rate': '0.0001609', 'epoch': '1.63'}
{'loss': '0.2511', 'grad_norm': '0.6323', 'learning_rate': '0.0001641', 'epoch': '1.661'}
{'loss': '0.189', 'grad_norm': '0.6331', 'learning_rate': '0.0001672', 'epoch': '1.693'}
{'loss': '0.1683', 'grad_norm': '0.6034', 'learning_rate': '0.0001703', 'epoch': '1.724'}
{'loss': '0.1662', 'grad_norm': '0.6068', 'learning_rate': '0.0001734', 'epoch': '1.756'}
{'loss': '0.149', 'grad_norm': '0.5605', 'learning_rate': '0.0001766', 'epoch': '1.787'}
{'loss': '0.1371', 'grad_norm': '0.6385', 'learning_rate': '0.0001797', 'epoch': '1.819'}
{'loss': '0.2387', 'grad_norm': '0.6172', 'learning_rate': '0.0001828', 'epoch': '1.85'}
{'loss': '0.1732', 'grad_norm': '0.6209', 'learning_rate': '0.0001859', 'epoch': '1.882'}
{'loss': '0.1001', 'grad_norm': '0.4742', 'learning_rate': '0.0001891', 'epoch': '1.913'}
{'loss': '0.1572', 'grad_norm': '0.6833', 'learning_rate': '0.0001922', 'epoch': '1.945'}
{'loss': '0.09378', 'grad_norm': '0.5868', 'learning_rate': '0.0001953', 'epoch': '1.976'}
{'loss': '0.1451', 'grad_norm': '0.8016', 'learning_rate': '0.0001984', 'epoch': '2'}
{'loss': '0.1451', 'grad_norm': '0.6149', 'learning_rate': '0.0002', 'epoch': '2.031'}
{'loss': '0.1378', 'grad_norm': '0.7108', 'learning_rate': '0.0002', 'epoch': '2.063'}
{'loss': '0.1051', 'grad_norm': '0.7227', 'learning_rate': '0.0002', 'epoch': '2.094'}
{'loss': '0.1491', 'grad_norm': '0.599', 'learning_rate': '0.0002', 'epoch': '2.126'}
{'loss': '0.06592', 'grad_norm': '0.4722', 'learning_rate': '0.0002', 'epoch': '2.157'}
{'loss': '0.1316', 'grad_norm': '0.5161', 'learning_rate': '0.0002', 'epoch': '2.189'}
{'loss': '0.1182', 'grad_norm': '0.9601', 'learning_rate': '0.0002', 'epoch': '2.22'}
{'loss': '0.05782', 'grad_norm': '0.635', 'learning_rate': '0.0002', 'epoch': '2.252'}
{'loss': '0.04467', 'grad_norm': '0.4791', 'learning_rate': '0.0002', 'epoch': '2.283'}
{'loss': '0.04454', 'grad_norm': '0.4652', 'learning_rate': '0.0002', 'epoch': '2.315'}
{'loss': '0.124', 'grad_norm': '0.4957', 'learning_rate': '0.0002', 'epoch': '2.346'}
{'loss': '0.0998', 'grad_norm': '0.5598', 'learning_rate': '0.0002', 'epoch': '2.378'}
{'loss': '0.1616', 'grad_norm': '0.4777', 'learning_rate': '0.0001999', 'epoch': '2.409'}
{'loss': '0.1247', 'grad_norm': '0.6336', 'learning_rate': '0.0001999', 'epoch': '2.441'}
{'loss': '0.1366', 'grad_norm': '0.6566', 'learning_rate': '0.0001999', 'epoch': '2.472'}
{'loss': '0.03745', 'grad_norm': '0.5288', 'learning_rate': '0.0001999', 'epoch': '2.504'}
{'loss': '0.03298', 'grad_norm': '0.4709', 'learning_rate': '0.0001999', 'epoch': '2.535'}
{'loss': '0.07187', 'grad_norm': '0.6073', 'learning_rate': '0.0001999', 'epoch': '2.567'}
{'loss': '0.02764', 'grad_norm': '0.4994', 'learning_rate': '0.0001999', 'epoch': '2.598'}
{'loss': '0.04343', 'grad_norm': '0.6756', 'learning_rate': '0.0001999', 'epoch': '2.63'}
{'loss': '0.06819', 'grad_norm': '0.7682', 'learning_rate': '0.0001999', 'epoch': '2.661'}
{'loss': '0.08511', 'grad_norm': '0.5571', 'learning_rate': '0.0001998', 'epoch': '2.693'}
{'loss': '0.06029', 'grad_norm': '0.7904', 'learning_rate': '0.0001998', 'epoch': '2.724'}
{'loss': '0.08692', 'grad_norm': '0.8161', 'learning_rate': '0.0001998', 'epoch': '2.756'}
{'loss': '0.1317', 'grad_norm': '1.102', 'learning_rate': '0.0001998', 'epoch': '2.787'}
{'loss': '0.114', 'grad_norm': '0.6642', 'learning_rate': '0.0001998', 'epoch': '2.819'}
{'loss': '0.03964', 'grad_norm': '0.3947', 'learning_rate': '0.0001998', 'epoch': '2.85'}
  7%|▋         | 182/2560 [01:19<10:53,  3.64it/s]
  7%|▋         | 183/2560 [01:19<10:47,  3.67it/s]
  7%|▋         | 184/2560 [01:20<10:50,  3.66it/s]
                                                  

  7%|▋         | 184/2560 [01:20<10:50,  3.66it/s]
  7%|▋         | 185/2560 [01:20<10:47,  3.67it/s]
  7%|▋         | 186/2560 [01:20<10:46,  3.67it/s]
                                                  

  7%|▋         | 186/2560 [01:20<10:46,  3.67it/s]
  7%|▋         | 187/2560 [01:21<10:51,  3.64it/s]
  7%|▋         | 188/2560 [01:21<10:50,  3.65it/s]
                                                  

  7%|▋         | 188/2560 [01:21<10:50,  3.65it/s]
  7%|▋         | 189/2560 [01:21<10:50,  3.65it/s]
  7%|▋         | 190/2560 [01:21<10:47,  3.66it/s]
                                                  

  7%|▋         | 190/2560 [01:21<10:47,  3.66it/s]
  7%|▋         | 191/2560 [01:22<10:44,  3.68it/s]
  8%|▊         | 192/2560 [01:22<09:08,  4.32it/s]
                                                  

  8%|▊         | 192/2560 [01:22<09:08,  4.32it/s]
  8%|▊         | 193/2560 [01:22<09:36,  4.10it/s]
  8%|▊         | 194/2560 [01:22<10:00,  3.94it/s]
                                                  

  8%|▊         | 194/2560 [01:22<10:00,  3.94it/s]
  8%|▊         | 195/2560 [01:23<10:11,  3.87it/s]
  8%|▊         | 196/2560 [01:23<10:21,  3.80it/s]
                                                  

  8%|▊         | 196/2560 [01:23<10:21,  3.80it/s]
  8%|▊         | 197/2560 [01:23<10:21,  3.80it/s]
  8%|▊         | 198/2560 [01:23<10:27,  3.76it/s]
                                                  

  8%|▊         | 198/2560 [01:23<10:27,  3.76it/s]
  8%|▊         | 199/2560 [01:24<10:39,  3.69it/s]
  8%|▊         | 200/2560 [01:24<10:49,  3.63it/s]
                                                  

  8%|▊         | 200/2560 [01:24<10:49,  3.63it/s]
  8%|▊         | 201/2560 [01:24<10:52,  3.61it/s]
  8%|▊         | 202/2560 [01:24<10:58,  3.58it/s]
                                                  

  8%|▊         | 202/2560 [01:24<10:58,  3.58it/s]
  8%|▊         | 203/2560 [01:25<11:05,  3.54it/s]
  8%|▊         | 204/2560 [01:25<11:13,  3.50it/s]
                                                  

  8%|▊         | 204/2560 [01:25<11:13,  3.50it/s]
  8%|▊         | 205/2560 [01:25<11:19,  3.47it/s]
  8%|▊         | 206/2560 [01:26<11:09,  3.52it/s]
                                                  

  8%|▊         | 206/2560 [01:26<11:09,  3.52it/s]
  8%|▊         | 207/2560 [01:26<10:58,  3.57it/s]
  8%|▊         | 208/2560 [01:26<10:48,  3.63it/s]
                                                  

  8%|▊         | 208/2560 [01:26<10:48,  3.63it/s]
  8%|▊         | 209/2560 [01:26<10:45,  3.64it/s]
  8%|▊         | 210/2560 [01:27<10:42,  3.66it/s]
                                                  

  8%|▊         | 210/2560 [01:27<10:42,  3.66it/s]
  8%|▊         | 211/2560 [01:27<10:37,  3.69it/s]
  8%|▊         | 212/2560 [01:27<10:36,  3.69it/s]
                                                  

  8%|▊         | 212/2560 [01:27<10:36,  3.69it/s]
  8%|▊         | 213/2560 [01:28<10:38,  3.68it/s]
  8%|▊         | 214/2560 [01:28<10:37,  3.68it/s]
                                                  

  8%|▊         | 214/2560 [01:28<10:37,  3.68it/s]
  8%|▊         | 215/2560 [01:28<10:34,  3.70it/s]
  8%|▊         | 216/2560 [01:28<10:42,  3.65it/s]
                                                  

  8%|▊         | 216/2560 [01:28<10:42,  3.65it/s]
  8%|▊         | 217/2560 [01:29<10:48,  3.61it/s]
  9%|▊         | 218/2560 [01:29<10:45,  3.63it/s]
                                                  

  9%|▊         | 218/2560 [01:29<10:45,  3.63it/s]
  9%|▊         | 219/2560 [01:29<10:46,  3.62it/s]
  9%|▊         | 220/2560 [01:29<10:58,  3.55it/s]
                                                  

  9%|▊         | 220/2560 [01:29<10:58,  3.55it/s]
  9%|▊         | 221/2560 [01:30<10:51,  3.59it/s]
  9%|▊         | 222/2560 [01:30<10:47,  3.61it/s]
                                                  

  9%|▊         | 222/2560 [01:30<10:47,  3.61it/s]
  9%|▊         | 223/2560 [01:30<10:44,  3.62it/s]
  9%|▉         | 224/2560 [01:31<10:48,  3.60it/s]
                                                  

  9%|▉         | 224/2560 [01:31<10:48,  3.60it/s]
  9%|▉         | 225/2560 [01:31<10:54,  3.57it/s]
  9%|▉         | 226/2560 [01:31<10:45,  3.62it/s]
                                                  

  9%|▉         | 226/2560 [01:31<10:45,  3.62it/s]
  9%|▉         | 227/2560 [01:31<10:43,  3.63it/s]
  9%|▉         | 228/2560 [01:32<10:38,  3.65it/s]
                                                  

  9%|▉         | 228/2560 [01:32<10:38,  3.65it/s]
  9%|▉         | 229/2560 [01:32<10:36,  3.66it/s]
  9%|▉         | 230/2560 [01:32<10:37,  3.65it/s]
                                                  

  9%|▉         | 230/2560 [01:32<10:37,  3.65it/s]
  9%|▉         | 231/2560 [01:32<10:32,  3.68it/s]
  9%|▉         | 232/2560 [01:33<10:24,  3.73it/s]
                                                  

  9%|▉         | 232/2560 [01:33<10:24,  3.73it/s]
  9%|▉         | 233/2560 [01:33<10:25,  3.72it/s]
  9%|▉         | 234/2560 [01:33<10:20,  3.75it/s]
                                                  

  9%|▉         | 234/2560 [01:33<10:20,  3.75it/s]
  9%|▉         | 235/2560 [01:34<10:19,  3.75it/s]
  9%|▉         | 236/2560 [01:34<10:16,  3.77it/s]
                                                  

  9%|▉         | 236/2560 [01:34<10:16,  3.77it/s]
  9%|▉         | 237/2560 [01:34<10:19,  3.75it/s]
  9%|▉         | 238/2560 [01:34<10:17,  3.76it/s]
                                                  

  9%|▉         | 238/2560 [01:34<10:17,  3.76it/s]
  9%|▉         | 239/2560 [01:35<10:21,  3.74it/s]
  9%|▉         | 240/2560 [01:35<10:23,  3.72it/s]
                                                  

  9%|▉         | 240/2560 [01:35<10:23,  3.72it/s]
  9%|▉         | 241/2560 [01:35<10:22,  3.73it/s]
  9%|▉         | 242/2560 [01:35<10:23,  3.72it/s]
                                                  

  9%|▉         | 242/2560 [01:35<10:23,  3.72it/s]
  9%|▉         | 243/2560 [01:36<10:18,  3.75it/s]
 10%|▉         | 244/2560 [01:36<10:19,  3.74it/s]
                                                  

 10%|▉         | 244/2560 [01:36<10:19,  3.74it/s]
 10%|▉         | 245/2560 [01:36<10:14,  3.77it/s]
 10%|▉         | 246/2560 [01:36<10:16,  3.76it/s]
                                                  

 10%|▉         | 246/2560 [01:36<10:16,  3.76it/s]
 10%|▉         | 247/2560 [01:37<10:13,  3.77it/s]
 10%|▉         | 248/2560 [01:37<10:14,  3.76it/s]
                                                  

 10%|▉         | 248/2560 [01:37<10:14,  3.76it/s]
 10%|▉         | 249/2560 [01:37<10:12,  3.77it/s]
 10%|▉         | 250/2560 [01:38<10:07,  3.80it/s]
                                                  

 10%|▉         | 250/2560 [01:38<10:07,  3.80it/s]
 10%|▉         | 251/2560 [01:38<10:41,  3.60it/s]
 10%|▉         | 252/2560 [01:38<10:37,  3.62it/s]
                                                  

 10%|▉         | 252/2560 [01:38<10:37,  3.62it/s]
 10%|▉         | 253/2560 [01:38<10:32,  3.65it/s]
 10%|▉         | 254/2560 [01:39<10:23,  3.70it/s]
                                                  

 10%|▉         | 254/2560 [01:39<10:23,  3.70it/s]
 10%|▉         | 255/2560 [01:39<10:20,  3.72it/s]
 10%|█         | 256/2560 [01:39<08:41,  4.41it/s]
                                                  

 10%|█         | 256/2560 [01:39<08:41,  4.41it/s]
 10%|█         | 257/2560 [01:39<09:06,  4.21it/s]
 10%|█         | 258/2560 [01:40<09:22,  4.09it/s]
                                                  

 10%|█         | 258/2560 [01:40<09:22,  4.09it/s]
 10%|█         | 259/2560 [01:40<09:33,  4.01it/s]
 10%|█         | 260/2560 [01:40<09:41,  3.96it/s]
                                                  

 10%|█         | 260/2560 [01:40<09:41,  3.96it/s]
 10%|█         | 261/2560 [01:40<09:46,  3.92it/s]
 10%|█         | 262/2560 [01:41<09:48,  3.90it/s]
                                                  

 10%|█         | 262/2560 [01:41<09:48,  3.90it/s]
 10%|█         | 263/2560 [01:41<10:04,  3.80it/s]
 10%|█         | 264/2560 [01:41<10:07,  3.78it/s]
                                                  

 10%|█         | 264/2560 [01:41<10:07,  3.78it/s]
 10%|█         | 265/2560 [01:41<10:13,  3.74it/s]
 10%|█         | 266/2560 [01:42<10:17,  3.72it/s]
                                                  

 10%|█         | 266/2560 [01:42<10:17,  3.72it/s]
 10%|█         | 267/2560 [01:42<10:21,  3.69it/s]
 10%|█         | 268/2560 [01:42<10:27,  3.65it/s]
                                                  

 10%|█         | 268/2560 [01:42<10:27,  3.65it/s]
 11%|█         | 269/2560 [01:43<10:27,  3.65it/s]
 11%|█         | 270/2560 [01:43<10:27,  3.65it/s]
                                                  

 11%|█         | 270/2560 [01:43<10:27,  3.65it/s]
 11%|█         | 271/2560 [01:43<10:22,  3.68it/s]
 11%|█         | 272/2560 [01:43<10:15,  3.72it/s]
                                                  

 11%|█         | 272/2560 [01:43<10:15,  3.72it/s]
 11%|█         | 273/2560 [01:44<10:09,  3.75it/s]
 11%|█         | 274/2560 [01:44<10:07,  3.76it/s]
                                                  

 11%|█         | 274/2560 [01:44<10:07,  3.76it/s]
 11%|█         | 275/2560 [01:44<10:06,  3.77it/s]
 11%|█         | 276/2560 [01:44<10:06,  3.77it/s]
                                                  

 11%|█         | 276/2560 [01:44<10:06,  3.77it/s]
 11%|█         | 277/2560 [01:45<10:06,  3.76it/s]
 11%|█         | 278/2560 [01:45<10:05,  3.77it/s]
                                                  

 11%|█         | 278/2560 [01:45<10:05,  3.77it/s]
 11%|█         | 279/2560 [01:45<10:06,  3.76it/s]
 11%|█         | 280/2560 [01:45<10:07,  3.76it/s]
                                                  

 11%|█         | 280/2560 [01:45<10:07,  3.76it/s]
 11%|█         | 281/2560 [01:46<10:01,  3.79it/s]
 11%|█         | 282/2560 [01:46<10:01,  3.79it/s]
                                                  

 11%|█         | 282/2560 [01:46<10:01,  3.79it/s]
 11%|█         | 283/2560 [01:46<10:02,  3.78it/s]
 11%|█         | 284/2560 [01:47<10:04,  3.77it/s]
                                                  

 11%|█         | 284/2560 [01:47<10:04,  3.77it/s]
 11%|█         | 285/2560 [01:47<10:18,  3.68it/s]
 11%|█         | 286/2560 [01:47<10:12,  3.71it/s]
                                                  

 11%|█         | 286/2560 [01:47<10:12,  3.71it/s]
 11%|█         | 287/2560 [01:47<10:14,  3.70it/s]
 11%|█▏        | 288/2560 [01:48<10:09,  3.73it/s]
                                                  

 11%|█▏        | 288/2560 [01:48<10:09,  3.73it/s]
 11%|█▏        | 289/2560 [01:48<10:08,  3.73it/s]
 11%|█▏        | 290/2560 [01:48<10:05,  3.75it/s]
                                                  

 11%|█▏        | 290/2560 [01:48<10:05,  3.75it/s]
 11%|█▏        | 291/2560 [01:48<10:04,  3.76it/s]
 11%|█▏        | 292/2560 [01:49<09:58,  3.79it/s]
                                                  

 11%|█▏        | 292/2560 [01:49<09:58,  3.79it/s]
 11%|█▏        | 293/2560 [01:49<09:54,  3.81it/s]
 11%|█▏        | 294/2560 [01:49<09:55,  3.81it/s]
                                                  

 11%|█▏        | 294/2560 [01:49<09:55,  3.81it/s]
 12%|█▏        | 295/2560 [01:49<09:52,  3.83it/s]
 12%|█▏        | 296/2560 [01:50<09:49,  3.84it/s]
                                                  

 12%|█▏        | 296/2560 [01:50<09:49,  3.84it/s]
 12%|█▏        | 297/2560 [01:50<09:47,  3.85it/s]
 12%|█▏        | 298/2560 [01:50<09:45,  3.87it/s]
                                                  

 12%|█▏        | 298/2560 [01:50<09:45,  3.87it/s]
 12%|█▏        | 299/2560 [01:50<09:45,  3.86it/s]
 12%|█▏        | 300/2560 [01:51<09:44,  3.87it/s]
                                                  

 12%|█▏        | 300/2560 [01:51<09:44,  3.87it/s]
 12%|█▏        | 301/2560 [01:51<09:44,  3.87it/s]
 12%|█▏        | 302/2560 [01:51<09:43,  3.87it/s]
                                                  

 12%|█▏        | 302/2560 [01:51<09:43,  3.87it/s]
 12%|█▏        | 303/2560 [01:52<09:44,  3.86it/s]
 12%|█▏        | 304/2560 [01:52<09:44,  3.86it/s]
                                                  

 12%|█▏        | 304/2560 [01:52<09:44,  3.86it/s]
 12%|█▏        | 305/2560 [01:52<09:44,  3.86it/s]
 12%|█▏        | 306/2560 [01:52<09:47,  3.84it/s]
                                                  

 12%|█▏        | 306/2560 [01:52<09:47,  3.84it/s]
 12%|█▏        | 307/2560 [01:53<09:53,  3.79it/s]
 12%|█▏        | 308/2560 [01:53<09:56,  3.77it/s]
                                                  

 12%|█▏        | 308/2560 [01:53<09:56,  3.77it/s]
 12%|█▏        | 309/2560 [01:53<09:59,  3.76it/s]
 12%|█▏        | 310/2560 [01:53<10:00,  3.74it/s]
                                                  

 12%|█▏        | 310/2560 [01:53<10:00,  3.74it/s]
 12%|█▏        | 311/2560 [01:54<10:02,  3.73it/s]
 12%|█▏        | 312/2560 [01:54<10:01,  3.74it/s]
                                                  

 12%|█▏        | 312/2560 [01:54<10:01,  3.74it/s]
 12%|█▏        | 313/2560 [01:54<10:02,  3.73it/s]
 12%|█▏        | 314/2560 [01:54<10:02,  3.73it/s]
                                                  

 12%|█▏        | 314/2560 [01:54<10:02,  3.73it/s]
 12%|█▏        | 315/2560 [01:55<10:03,  3.72it/s]
 12%|█▏        | 316/2560 [01:55<10:03,  3.72it/s]
                                                  

 12%|█▏        | 316/2560 [01:55<10:03,  3.72it/s]
 12%|█▏        | 317/2560 [01:55<10:02,  3.72it/s]
 12%|█▏        | 318/2560 [01:56<09:57,  3.75it/s]
                                                  

 12%|█▏        | 318/2560 [01:56<09:57,  3.75it/s]
 12%|█▏        | 319/2560 [01:56<09:55,  3.77it/s]
 12%|█▎        | 320/2560 [01:56<08:21,  4.47it/s]
                                                  

 12%|█▎        | 320/2560 [01:56<08:21,  4.47it/s]
 13%|█▎        | 321/2560 [01:56<09:04,  4.11it/s]
 13%|█▎        | 322/2560 [01:56<09:26,  3.95it/s]
                                                  

 13%|█▎        | 322/2560 [01:56<09:26,  3.95it/s]
 13%|█▎        | 323/2560 [01:57<09:37,  3.87it/s]
 13%|█▎        | 324/2560 [01:57<09:42,  3.84it/s]
                                                  

 13%|█▎        | 324/2560 [01:57<09:42,  3.84it/s]
 13%|█▎        | 325/2560 [01:57<09:46,  3.81it/s]
 13%|█▎        | 326/2560 [01:58<09:50,  3.78it/s]
                                                  

 13%|█▎        | 326/2560 [01:58<09:50,  3.78it/s]
 13%|█▎        | 327/2560 [01:58<09:53,  3.76it/s]
 13%|█▎        | 328/2560 [01:58<10:03,  3.70it/s]
                                                  

 13%|█▎        | 328/2560 [01:58<10:03,  3.70it/s]
 13%|█▎        | 329/2560 [01:58<10:16,  3.62it/s]
 13%|█▎        | 330/2560 [01:59<10:23,  3.57it/s]
                                                  

 13%|█▎        | 330/2560 [01:59<10:23,  3.57it/s]
 13%|█▎        | 331/2560 [01:59<10:28,  3.55it/s]
 13%|█▎        | 332/2560 [01:59<10:28,  3.55it/s]
                                                  

 13%|█▎        | 332/2560 [01:59<10:28,  3.55it/s]
 13%|█▎        | 333/2560 [02:00<10:31,  3.53it/s]
 13%|█▎        | 334/2560 [02:00<10:29,  3.53it/s]
                                                  

 13%|█▎        | 334/2560 [02:00<10:29,  3.53it/s]
 13%|█▎        | 335/2560 [02:00<10:20,  3.59it/s]
 13%|█▎        | 336/2560 [02:00<10:14,  3.62it/s]
                                                  

 13%|█▎        | 336/2560 [02:00<10:14,  3.62it/s]
 13%|█▎        | 337/2560 [02:01<10:08,  3.65it/s]
 13%|█▎        | 338/2560 [02:01<10:00,  3.70it/s]
                                                  

 13%|█▎        | 338/2560 [02:01<10:00,  3.70it/s]
 13%|█▎        | 339/2560 [02:01<10:09,  3.65it/s]
 13%|█▎        | 340/2560 [02:01<10:07,  3.65it/s]
                                                  

 13%|█▎        | 340/2560 [02:01<10:07,  3.65it/s]
 13%|█▎        | 341/2560 [02:02<10:03,  3.68it/s]
 13%|█▎        | 342/2560 [02:02<09:59,  3.70it/s]
                                                  

 13%|█▎        | 342/2560 [02:02<09:59,  3.70it/s]
 13%|█▎        | 343/2560 [02:02<09:57,  3.71it/s]
 13%|█▎        | 344/2560 [02:03<10:00,  3.69it/s]
                                                  

 13%|█▎        | 344/2560 [02:03<10:00,  3.69it/s]
 13%|█▎        | 345/2560 [02:03<09:58,  3.70it/s]
 14%|█▎        | 346/2560 [02:03<11:05,  3.33it/s]
                                                  

 14%|█▎        | 346/2560 [02:03<11:05,  3.33it/s]
 14%|█▎        | 347/2560 [02:03<10:51,  3.39it/s]
 14%|█▎        | 348/2560 [02:04<10:30,  3.51it/s]
                                                  

 14%|█▎        | 348/2560 [02:04<10:30,  3.51it/s]
 14%|█▎        | 349/2560 [02:04<10:20,  3.56it/s]
 14%|█▎        | 350/2560 [02:04<10:10,  3.62it/s]
                                                  

 14%|█▎        | 350/2560 [02:04<10:10,  3.62it/s]
 14%|█▎        | 351/2560 [02:04<10:04,  3.66it/s]
 14%|█▍        | 352/2560 [02:05<10:01,  3.67it/s]
                                                  

 14%|█▍        | 352/2560 [02:05<10:01,  3.67it/s]
 14%|█▍        | 353/2560 [02:05<09:54,  3.71it/s]
 14%|█▍        | 354/2560 [02:05<09:49,  3.74it/s]
                                                  

 14%|█▍        | 354/2560 [02:05<09:49,  3.74it/s]
 14%|█▍        | 355/2560 [02:06<09:47,  3.76it/s]
 14%|█▍        | 356/2560 [02:06<09:42,  3.78it/s]
                                                  

 14%|█▍        | 356/2560 [02:06<09:42,  3.78it/s]
 14%|█▍        | 357/2560 [02:06<09:42,  3.78it/s]
 14%|█▍        | 358/2560 [02:06<09:38,  3.80it/s]
                                                  

 14%|█▍        | 358/2560 [02:06<09:38,  3.80it/s]
 14%|█▍        | 359/2560 [02:07<09:34,  3.83it/s]
 14%|█▍        | 360/2560 [02:07<09:32,  3.85it/s]
                                                  

 14%|█▍        | 360/2560 [02:07<09:32,  3.85it/s]
 14%|█▍        | 361/2560 [02:07<09:31,  3.84it/s]
 14%|█▍        | 362/2560 [02:07<09:36,  3.81it/s]
                                                  

 14%|█▍        | 362/2560 [02:07<09:36,  3.81it/s]
 14%|█▍        | 363/2560 [02:08<09:35,  3.82it/s]
 14%|█▍        | 364/2560 [02:08<09:31,  3.84it/s]
                                                  
{'loss': '0.08976', 'grad_norm': '0.4215', 'learning_rate': '0.0001997', 'epoch': '2.882'}
{'loss': '0.0311', 'grad_norm': '0.2978', 'learning_rate': '0.0001997', 'epoch': '2.913'}
{'loss': '0.1077', 'grad_norm': '0.5212', 'learning_rate': '0.0001997', 'epoch': '2.945'}
{'loss': '0.01852', 'grad_norm': '0.279', 'learning_rate': '0.0001997', 'epoch': '2.976'}
{'loss': '0.04734', 'grad_norm': '0.4497', 'learning_rate': '0.0001997', 'epoch': '3'}
{'loss': '0.04928', 'grad_norm': '0.4799', 'learning_rate': '0.0001996', 'epoch': '3.031'}
{'loss': '0.08387', 'grad_norm': '0.5586', 'learning_rate': '0.0001996', 'epoch': '3.063'}
{'loss': '0.05574', 'grad_norm': '0.5154', 'learning_rate': '0.0001996', 'epoch': '3.094'}
{'loss': '0.03824', 'grad_norm': '0.4792', 'learning_rate': '0.0001996', 'epoch': '3.126'}
{'loss': '0.05166', 'grad_norm': '0.2091', 'learning_rate': '0.0001996', 'epoch': '3.157'}
{'loss': '0.015', 'grad_norm': '0.2362', 'learning_rate': '0.0001995', 'epoch': '3.189'}
{'loss': '0.01124', 'grad_norm': '0.195', 'learning_rate': '0.0001995', 'epoch': '3.22'}
{'loss': '0.01347', 'grad_norm': '0.2711', 'learning_rate': '0.0001995', 'epoch': '3.252'}
{'loss': '0.04449', 'grad_norm': '0.1894', 'learning_rate': '0.0001995', 'epoch': '3.283'}
{'loss': '0.04107', 'grad_norm': '0.2056', 'learning_rate': '0.0001994', 'epoch': '3.315'}
{'loss': '0.1251', 'grad_norm': '0.4877', 'learning_rate': '0.0001994', 'epoch': '3.346'}
{'loss': '0.009919', 'grad_norm': '0.184', 'learning_rate': '0.0001994', 'epoch': '3.378'}
{'loss': '0.08124', 'grad_norm': '0.5915', 'learning_rate': '0.0001993', 'epoch': '3.409'}
{'loss': '0.06919', 'grad_norm': '0.4807', 'learning_rate': '0.0001993', 'epoch': '3.441'}
{'loss': '0.03062', 'grad_norm': '0.366', 'learning_rate': '0.0001993', 'epoch': '3.472'}
{'loss': '0.008816', 'grad_norm': '0.2554', 'learning_rate': '0.0001992', 'epoch': '3.504'}
{'loss': '0.03787', 'grad_norm': '0.3737', 'learning_rate': '0.0001992', 'epoch': '3.535'}
{'loss': '0.0201', 'grad_norm': '0.3269', 'learning_rate': '0.0001992', 'epoch': '3.567'}
{'loss': '0.03148', 'grad_norm': '0.3606', 'learning_rate': '0.0001992', 'epoch': '3.598'}
{'loss': '0.03823', 'grad_norm': '0.2861', 'learning_rate': '0.0001991', 'epoch': '3.63'}
{'loss': '0.09208', 'grad_norm': '0.4151', 'learning_rate': '0.0001991', 'epoch': '3.661'}
{'loss': '0.02684', 'grad_norm': '0.3402', 'learning_rate': '0.000199', 'epoch': '3.693'}
{'loss': '0.01523', 'grad_norm': '0.1727', 'learning_rate': '0.000199', 'epoch': '3.724'}
{'loss': '0.1052', 'grad_norm': '0.5296', 'learning_rate': '0.000199', 'epoch': '3.756'}
{'loss': '0.1497', 'grad_norm': '0.83', 'learning_rate': '0.0001989', 'epoch': '3.787'}
{'loss': '0.02134', 'grad_norm': '0.3941', 'learning_rate': '0.0001989', 'epoch': '3.819'}
{'loss': '0.05761', 'grad_norm': '0.4036', 'learning_rate': '0.0001989', 'epoch': '3.85'}
{'loss': '0.009098', 'grad_norm': '0.2719', 'learning_rate': '0.0001988', 'epoch': '3.882'}
{'loss': '0.03937', 'grad_norm': '0.5212', 'learning_rate': '0.0001988', 'epoch': '3.913'}
{'loss': '0.03179', 'grad_norm': '0.4103', 'learning_rate': '0.0001987', 'epoch': '3.945'}
{'loss': '0.09825', 'grad_norm': '0.6279', 'learning_rate': '0.0001987', 'epoch': '3.976'}
{'loss': '0.007163', 'grad_norm': '0.3888', 'learning_rate': '0.0001987', 'epoch': '4'}
{'loss': '0.03764', 'grad_norm': '0.4468', 'learning_rate': '0.0001986', 'epoch': '4.031'}
{'loss': '0.02134', 'grad_norm': '0.2341', 'learning_rate': '0.0001986', 'epoch': '4.063'}
{'loss': '0.03755', 'grad_norm': '0.2357', 'learning_rate': '0.0001985', 'epoch': '4.094'}
{'loss': '0.02102', 'grad_norm': '0.2546', 'learning_rate': '0.0001985', 'epoch': '4.126'}
{'loss': '0.03955', 'grad_norm': '0.5216', 'learning_rate': '0.0001984', 'epoch': '4.157'}
{'loss': '0.006295', 'grad_norm': '0.1972', 'learning_rate': '0.0001984', 'epoch': '4.189'}
{'loss': '0.03303', 'grad_norm': '0.2468', 'learning_rate': '0.0001983', 'epoch': '4.22'}
{'loss': '0.03882', 'grad_norm': '0.2293', 'learning_rate': '0.0001983', 'epoch': '4.252'}
{'loss': '0.0786', 'grad_norm': '0.4044', 'learning_rate': '0.0001983', 'epoch': '4.283'}
{'loss': '0.005446', 'grad_norm': '0.1976', 'learning_rate': '0.0001982', 'epoch': '4.315'}
{'loss': '0.006057', 'grad_norm': '0.2553', 'learning_rate': '0.0001982', 'epoch': '4.346'}
{'loss': '0.005924', 'grad_norm': '0.3658', 'learning_rate': '0.0001981', 'epoch': '4.378'}
{'loss': '0.01904', 'grad_norm': '0.2324', 'learning_rate': '0.0001981', 'epoch': '4.409'}
{'loss': '0.0614', 'grad_norm': '0.4342', 'learning_rate': '0.000198', 'epoch': '4.441'}
{'loss': '0.07002', 'grad_norm': '0.4861', 'learning_rate': '0.000198', 'epoch': '4.472'}
{'loss': '0.09017', 'grad_norm': '0.4141', 'learning_rate': '0.0001979', 'epoch': '4.504'}
{'loss': '0.0316', 'grad_norm': '0.4155', 'learning_rate': '0.0001978', 'epoch': '4.535'}
{'loss': '0.01191', 'grad_norm': '0.192', 'learning_rate': '0.0001978', 'epoch': '4.567'}
{'loss': '0.02641', 'grad_norm': '0.3734', 'learning_rate': '0.0001977', 'epoch': '4.598'}
{'loss': '0.03896', 'grad_norm': '0.389', 'learning_rate': '0.0001977', 'epoch': '4.63'}
{'loss': '0.02199', 'grad_norm': '0.3403', 'learning_rate': '0.0001976', 'epoch': '4.661'}
{'loss': '0.05688', 'grad_norm': '0.5094', 'learning_rate': '0.0001976', 'epoch': '4.693'}
{'loss': '0.02618', 'grad_norm': '0.3327', 'learning_rate': '0.0001975', 'epoch': '4.724'}
{'loss': '0.005416', 'grad_norm': '0.1693', 'learning_rate': '0.0001975', 'epoch': '4.756'}
{'loss': '0.01257', 'grad_norm': '0.397', 'learning_rate': '0.0001974', 'epoch': '4.787'}
{'loss': '0.04939', 'grad_norm': '0.09687', 'learning_rate': '0.0001973', 'epoch': '4.819'}
{'loss': '0.02393', 'grad_norm': '0.436', 'learning_rate': '0.0001973', 'epoch': '4.85'}
{'loss': '0.01051', 'grad_norm': '0.1178', 'learning_rate': '0.0001972', 'epoch': '4.882'}
{'loss': '0.01724', 'grad_norm': '0.3206', 'learning_rate': '0.0001972', 'epoch': '4.913'}
{'loss': '0.07306', 'grad_norm': '0.6593', 'learning_rate': '0.0001971', 'epoch': '4.945'}
{'loss': '0.04291', 'grad_norm': '0.4881', 'learning_rate': '0.000197', 'epoch': '4.976'}
{'loss': '0.05785', 'grad_norm': '0.101', 'learning_rate': '0.000197', 'epoch': '5'}
{'loss': '0.00856', 'grad_norm': '0.1639', 'learning_rate': '0.0001969', 'epoch': '5.031'}
{'loss': '0.02769', 'grad_norm': '0.334', 'learning_rate': '0.0001968', 'epoch': '5.063'}
{'loss': '0.02392', 'grad_norm': '0.4508', 'learning_rate': '0.0001968', 'epoch': '5.094'}
{'loss': '0.01316', 'grad_norm': '0.1988', 'learning_rate': '0.0001967', 'epoch': '5.126'}
{'loss': '0.004895', 'grad_norm': '0.1988', 'learning_rate': '0.0001966', 'epoch': '5.157'}
{'loss': '0.01434', 'grad_norm': '0.5054', 'learning_rate': '0.0001966', 'epoch': '5.189'}
{'loss': '0.02255', 'grad_norm': '0.3324', 'learning_rate': '0.0001965', 'epoch': '5.22'}
{'loss': '0.01139', 'grad_norm': '0.336', 'learning_rate': '0.0001964', 'epoch': '5.252'}
{'loss': '0.04024', 'grad_norm': '0.1408', 'learning_rate': '0.0001964', 'epoch': '5.283'}
{'loss': '0.004342', 'grad_norm': '0.2976', 'learning_rate': '0.0001963', 'epoch': '5.315'}
{'loss': '0.01992', 'grad_norm': '0.4179', 'learning_rate': '0.0001962', 'epoch': '5.346'}
{'loss': '0.02321', 'grad_norm': '0.3025', 'learning_rate': '0.0001962', 'epoch': '5.378'}
{'loss': '0.03975', 'grad_norm': '0.3708', 'learning_rate': '0.0001961', 'epoch': '5.409'}
{'loss': '0.01128', 'grad_norm': '0.2447', 'learning_rate': '0.000196', 'epoch': '5.441'}
{'loss': '0.003765', 'grad_norm': '0.1177', 'learning_rate': '0.000196', 'epoch': '5.472'}
{'loss': '0.0177', 'grad_norm': '0.4859', 'learning_rate': '0.0001959', 'epoch': '5.504'}
{'loss': '0.04046', 'grad_norm': '0.419', 'learning_rate': '0.0001958', 'epoch': '5.535'}
{'loss': '0.02349', 'grad_norm': '0.3646', 'learning_rate': '0.0001957', 'epoch': '5.567'}
{'loss': '0.04371', 'grad_norm': '0.7198', 'learning_rate': '0.0001957', 'epoch': '5.598'}
{'loss': '0.1213', 'grad_norm': '0.4369', 'learning_rate': '0.0001956', 'epoch': '5.63'}
{'loss': '0.01622', 'grad_norm': '0.4396', 'learning_rate': '0.0001955', 'epoch': '5.661'}
{'loss': '0.00387', 'grad_norm': '0.1659', 'learning_rate': '0.0001954', 'epoch': '5.693'}
 14%|█▍        | 364/2560 [02:08<09:31,  3.84it/s]
 14%|█▍        | 365/2560 [02:08<09:30,  3.85it/s]
 14%|█▍        | 366/2560 [02:08<09:35,  3.81it/s]
                                                  

 14%|█▍        | 366/2560 [02:08<09:35,  3.81it/s]
 14%|█▍        | 367/2560 [02:09<09:38,  3.79it/s]
 14%|█▍        | 368/2560 [02:09<09:42,  3.76it/s]
                                                  

 14%|█▍        | 368/2560 [02:09<09:42,  3.76it/s]
 14%|█▍        | 369/2560 [02:09<09:40,  3.77it/s]
 14%|█▍        | 370/2560 [02:09<09:40,  3.78it/s]
                                                  

 14%|█▍        | 370/2560 [02:09<09:40,  3.78it/s]
 14%|█▍        | 371/2560 [02:10<09:40,  3.77it/s]
 15%|█▍        | 372/2560 [02:10<09:43,  3.75it/s]
                                                  

 15%|█▍        | 372/2560 [02:10<09:43,  3.75it/s]
 15%|█▍        | 373/2560 [02:10<09:44,  3.74it/s]
 15%|█▍        | 374/2560 [02:11<09:46,  3.73it/s]
                                                  

 15%|█▍        | 374/2560 [02:11<09:46,  3.73it/s]
 15%|█▍        | 375/2560 [02:11<09:42,  3.75it/s]
 15%|█▍        | 376/2560 [02:11<09:42,  3.75it/s]
                                                  

 15%|█▍        | 376/2560 [02:11<09:42,  3.75it/s]
 15%|█▍        | 377/2560 [02:11<09:40,  3.76it/s]
 15%|█▍        | 378/2560 [02:12<09:37,  3.78it/s]
                                                  

 15%|█▍        | 378/2560 [02:12<09:37,  3.78it/s]
 15%|█▍        | 379/2560 [02:12<09:58,  3.65it/s]
 15%|█▍        | 380/2560 [02:12<09:55,  3.66it/s]
                                                  

 15%|█▍        | 380/2560 [02:12<09:55,  3.66it/s]
 15%|█▍        | 381/2560 [02:12<09:54,  3.66it/s]
 15%|█▍        | 382/2560 [02:13<09:51,  3.68it/s]
                                                  

 15%|█▍        | 382/2560 [02:13<09:51,  3.68it/s]
 15%|█▍        | 383/2560 [02:13<09:47,  3.71it/s]
 15%|█▌        | 384/2560 [02:13<08:24,  4.31it/s]
                                                  

 15%|█▌        | 384/2560 [02:13<08:24,  4.31it/s]
 15%|█▌        | 385/2560 [02:13<08:48,  4.11it/s]
 15%|█▌        | 386/2560 [02:14<09:06,  3.98it/s]
                                                  

 15%|█▌        | 386/2560 [02:14<09:06,  3.98it/s]
 15%|█▌        | 387/2560 [02:14<09:16,  3.90it/s]
 15%|█▌        | 388/2560 [02:14<09:22,  3.86it/s]
                                                  

 15%|█▌        | 388/2560 [02:14<09:22,  3.86it/s]
 15%|█▌        | 389/2560 [02:14<09:33,  3.78it/s]
 15%|█▌        | 390/2560 [02:15<09:37,  3.76it/s]
                                                  

 15%|█▌        | 390/2560 [02:15<09:37,  3.76it/s]
 15%|█▌        | 391/2560 [02:15<09:36,  3.76it/s]
 15%|█▌        | 392/2560 [02:15<09:40,  3.74it/s]
                                                  

 15%|█▌        | 392/2560 [02:15<09:40,  3.74it/s]
 15%|█▌        | 393/2560 [02:16<09:40,  3.73it/s]
 15%|█▌        | 394/2560 [02:16<09:44,  3.71it/s]
                                                  

 15%|█▌        | 394/2560 [02:16<09:44,  3.71it/s]
 15%|█▌        | 395/2560 [02:16<09:44,  3.71it/s]
 15%|█▌        | 396/2560 [02:16<09:41,  3.72it/s]
                                                  

 15%|█▌        | 396/2560 [02:16<09:41,  3.72it/s]
 16%|█▌        | 397/2560 [02:17<09:39,  3.73it/s]
 16%|█▌        | 398/2560 [02:17<09:37,  3.74it/s]
                                                  

 16%|█▌        | 398/2560 [02:17<09:37,  3.74it/s]
 16%|█▌        | 399/2560 [02:17<09:39,  3.73it/s]
 16%|█▌        | 400/2560 [02:17<09:38,  3.74it/s]
                                                  

 16%|█▌        | 400/2560 [02:17<09:38,  3.74it/s]
 16%|█▌        | 401/2560 [02:18<09:36,  3.74it/s]
 16%|█▌        | 402/2560 [02:18<09:33,  3.76it/s]
                                                  

 16%|█▌        | 402/2560 [02:18<09:33,  3.76it/s]
 16%|█▌        | 403/2560 [02:18<09:33,  3.76it/s]
 16%|█▌        | 404/2560 [02:19<09:35,  3.75it/s]
                                                  

 16%|█▌        | 404/2560 [02:19<09:35,  3.75it/s]
 16%|█▌        | 405/2560 [02:19<09:33,  3.76it/s]
 16%|█▌        | 406/2560 [02:19<09:36,  3.74it/s]
                                                  

 16%|█▌        | 406/2560 [02:19<09:36,  3.74it/s]
 16%|█▌        | 407/2560 [02:19<09:35,  3.74it/s]
 16%|█▌        | 408/2560 [02:20<09:32,  3.76it/s]
                                                  

 16%|█▌        | 408/2560 [02:20<09:32,  3.76it/s]
 16%|█▌        | 409/2560 [02:20<09:35,  3.73it/s]
 16%|█▌        | 410/2560 [02:20<09:39,  3.71it/s]
                                                  

 16%|█▌        | 410/2560 [02:20<09:39,  3.71it/s]
 16%|█▌        | 411/2560 [02:20<09:36,  3.73it/s]
 16%|█▌        | 412/2560 [02:21<09:33,  3.75it/s]
                                                  

 16%|█▌        | 412/2560 [02:21<09:33,  3.75it/s]
 16%|█▌        | 413/2560 [02:21<09:30,  3.76it/s]
 16%|█▌        | 414/2560 [02:21<09:32,  3.75it/s]
                                                  

 16%|█▌        | 414/2560 [02:21<09:32,  3.75it/s]
 16%|█▌        | 415/2560 [02:21<09:32,  3.74it/s]
 16%|█▋        | 416/2560 [02:22<09:32,  3.74it/s]
                                                  

 16%|█▋        | 416/2560 [02:22<09:32,  3.74it/s]
 16%|█▋        | 417/2560 [02:22<09:35,  3.72it/s]
 16%|█▋        | 418/2560 [02:22<09:31,  3.75it/s]
                                                  

 16%|█▋        | 418/2560 [02:22<09:31,  3.75it/s]
 16%|█▋        | 419/2560 [02:23<09:33,  3.73it/s]
 16%|█▋        | 420/2560 [02:23<09:36,  3.72it/s]
                                                  

 16%|█▋        | 420/2560 [02:23<09:36,  3.72it/s]
 16%|█▋        | 421/2560 [02:23<09:36,  3.71it/s]
 16%|█▋        | 422/2560 [02:23<09:31,  3.74it/s]
                                                  

 16%|█▋        | 422/2560 [02:23<09:31,  3.74it/s]
 17%|█▋        | 423/2560 [02:24<09:32,  3.73it/s]
 17%|█▋        | 424/2560 [02:24<09:31,  3.74it/s]
                                                  

 17%|█▋        | 424/2560 [02:24<09:31,  3.74it/s]
 17%|█▋        | 425/2560 [02:24<09:29,  3.75it/s]
 17%|█▋        | 426/2560 [02:24<09:30,  3.74it/s]
                                                  

 17%|█▋        | 426/2560 [02:24<09:30,  3.74it/s]
 17%|█▋        | 427/2560 [02:25<09:25,  3.77it/s]
 17%|█▋        | 428/2560 [02:25<09:24,  3.77it/s]
                                                  

 17%|█▋        | 428/2560 [02:25<09:24,  3.77it/s]
 17%|█▋        | 429/2560 [02:25<09:23,  3.78it/s]
 17%|█▋        | 430/2560 [02:25<09:21,  3.79it/s]
                                                  

 17%|█▋        | 430/2560 [02:25<09:21,  3.79it/s]
 17%|█▋        | 431/2560 [02:26<09:15,  3.83it/s]
 17%|█▋        | 432/2560 [02:26<09:16,  3.82it/s]
                                                  

 17%|█▋        | 432/2560 [02:26<09:16,  3.82it/s]
 17%|█▋        | 433/2560 [02:26<09:15,  3.83it/s]
 17%|█▋        | 434/2560 [02:26<09:12,  3.85it/s]
                                                  

 17%|█▋        | 434/2560 [02:26<09:12,  3.85it/s]
 17%|█▋        | 435/2560 [02:27<09:11,  3.85it/s]
 17%|█▋        | 436/2560 [02:27<09:12,  3.85it/s]
                                                  

 17%|█▋        | 436/2560 [02:27<09:12,  3.85it/s]
 17%|█▋        | 437/2560 [02:27<09:11,  3.85it/s]
 17%|█▋        | 438/2560 [02:28<09:09,  3.86it/s]
                                                  

 17%|█▋        | 438/2560 [02:28<09:09,  3.86it/s]
 17%|█▋        | 439/2560 [02:28<09:07,  3.87it/s]
 17%|█▋        | 440/2560 [02:28<09:13,  3.83it/s]
                                                  

 17%|█▋        | 440/2560 [02:28<09:13,  3.83it/s]
 17%|█▋        | 441/2560 [02:28<09:14,  3.82it/s]
 17%|█▋        | 442/2560 [02:29<09:16,  3.80it/s]
                                                  

 17%|█▋        | 442/2560 [02:29<09:16,  3.80it/s]
 17%|█▋        | 443/2560 [02:29<09:25,  3.74it/s]
 17%|█▋        | 444/2560 [02:29<09:29,  3.72it/s]
                                                  

 17%|█▋        | 444/2560 [02:29<09:29,  3.72it/s]
 17%|█▋        | 445/2560 [02:29<09:30,  3.71it/s]
 17%|█▋        | 446/2560 [02:30<09:35,  3.67it/s]
                                                  

 17%|█▋        | 446/2560 [02:30<09:35,  3.67it/s]
 17%|█▋        | 447/2560 [02:30<09:46,  3.60it/s]
 18%|█▊        | 448/2560 [02:30<08:12,  4.29it/s]
                                                  

 18%|█▊        | 448/2560 [02:30<08:12,  4.29it/s]
 18%|█▊        | 449/2560 [02:30<08:33,  4.11it/s]
 18%|█▊        | 450/2560 [02:31<08:51,  3.97it/s]
                                                  

 18%|█▊        | 450/2560 [02:31<08:51,  3.97it/s]
 18%|█▊        | 451/2560 [02:31<09:06,  3.86it/s]
 18%|█▊        | 452/2560 [02:31<09:13,  3.81it/s]
                                                  

 18%|█▊        | 452/2560 [02:31<09:13,  3.81it/s]
 18%|█▊        | 453/2560 [02:31<09:20,  3.76it/s]
 18%|█▊        | 454/2560 [02:32<09:33,  3.67it/s]
                                                  

 18%|█▊        | 454/2560 [02:32<09:33,  3.67it/s]
 18%|█▊        | 455/2560 [02:32<09:31,  3.68it/s]
 18%|█▊        | 456/2560 [02:32<09:35,  3.65it/s]
                                                  

 18%|█▊        | 456/2560 [02:32<09:35,  3.65it/s]
 18%|█▊        | 457/2560 [02:33<09:44,  3.60it/s]
 18%|█▊        | 458/2560 [02:33<09:41,  3.61it/s]
                                                  

 18%|█▊        | 458/2560 [02:33<09:41,  3.61it/s]
 18%|█▊        | 459/2560 [02:33<09:39,  3.63it/s]
 18%|█▊        | 460/2560 [02:33<09:52,  3.54it/s]
                                                  

 18%|█▊        | 460/2560 [02:33<09:52,  3.54it/s]
 18%|█▊        | 461/2560 [02:34<10:01,  3.49it/s]
 18%|█▊        | 462/2560 [02:34<10:06,  3.46it/s]
                                                  

 18%|█▊        | 462/2560 [02:34<10:06,  3.46it/s]
 18%|█▊        | 463/2560 [02:34<10:13,  3.42it/s]
 18%|█▊        | 464/2560 [02:35<10:05,  3.46it/s]
                                                  

 18%|█▊        | 464/2560 [02:35<10:05,  3.46it/s]
 18%|█▊        | 465/2560 [02:35<10:03,  3.47it/s]
 18%|█▊        | 466/2560 [02:35<09:56,  3.51it/s]
                                                  

 18%|█▊        | 466/2560 [02:35<09:56,  3.51it/s]
 18%|█▊        | 467/2560 [02:35<09:57,  3.50it/s]
 18%|█▊        | 468/2560 [02:36<09:59,  3.49it/s]
                                                  

 18%|█▊        | 468/2560 [02:36<09:59,  3.49it/s]
 18%|█▊        | 469/2560 [02:36<10:02,  3.47it/s]
 18%|█▊        | 470/2560 [02:36<10:06,  3.45it/s]
                                                  

 18%|█▊        | 470/2560 [02:36<10:06,  3.45it/s]
 18%|█▊        | 471/2560 [02:37<10:04,  3.46it/s]
 18%|█▊        | 472/2560 [02:37<10:08,  3.43it/s]
                                                  

 18%|█▊        | 472/2560 [02:37<10:08,  3.43it/s]
 18%|█▊        | 473/2560 [02:37<10:09,  3.42it/s]
 19%|█▊        | 474/2560 [02:37<10:04,  3.45it/s]
                                                  

 19%|█▊        | 474/2560 [02:37<10:04,  3.45it/s]
 19%|█▊        | 475/2560 [02:38<09:54,  3.50it/s]
 19%|█▊        | 476/2560 [02:38<09:42,  3.58it/s]
                                                  

 19%|█▊        | 476/2560 [02:38<09:42,  3.58it/s]
 19%|█▊        | 477/2560 [02:38<09:35,  3.62it/s]
 19%|█▊        | 478/2560 [02:39<09:31,  3.64it/s]
                                                  

 19%|█▊        | 478/2560 [02:39<09:31,  3.64it/s]
 19%|█▊        | 479/2560 [02:39<09:27,  3.67it/s]
 19%|█▉        | 480/2560 [02:39<09:25,  3.68it/s]
                                                  

 19%|█▉        | 480/2560 [02:39<09:25,  3.68it/s]
 19%|█▉        | 481/2560 [02:39<09:25,  3.68it/s]
 19%|█▉        | 482/2560 [02:40<09:26,  3.67it/s]
                                                  

 19%|█▉        | 482/2560 [02:40<09:26,  3.67it/s]
 19%|█▉        | 483/2560 [02:40<09:26,  3.67it/s]
 19%|█▉        | 484/2560 [02:40<09:27,  3.66it/s]
                                                  

 19%|█▉        | 484/2560 [02:40<09:27,  3.66it/s]
 19%|█▉        | 485/2560 [02:40<09:23,  3.68it/s]
 19%|█▉        | 486/2560 [02:41<09:23,  3.68it/s]
                                                  

 19%|█▉        | 486/2560 [02:41<09:23,  3.68it/s]
 19%|█▉        | 487/2560 [02:41<09:19,  3.70it/s]
 19%|█▉        | 488/2560 [02:41<09:20,  3.70it/s]
                                                  

 19%|█▉        | 488/2560 [02:41<09:20,  3.70it/s]
 19%|█▉        | 489/2560 [02:42<09:19,  3.70it/s]
 19%|█▉        | 490/2560 [02:42<09:18,  3.71it/s]
                                                  

 19%|█▉        | 490/2560 [02:42<09:18,  3.71it/s]
 19%|█▉        | 491/2560 [02:42<09:18,  3.70it/s]
 19%|█▉        | 492/2560 [02:42<09:17,  3.71it/s]
                                                  

 19%|█▉        | 492/2560 [02:42<09:17,  3.71it/s]
 19%|█▉        | 493/2560 [02:43<09:17,  3.71it/s]
 19%|█▉        | 494/2560 [02:43<09:15,  3.72it/s]
                                                  

 19%|█▉        | 494/2560 [02:43<09:15,  3.72it/s]
 19%|█▉        | 495/2560 [02:43<09:16,  3.71it/s]
 19%|█▉        | 496/2560 [02:43<09:17,  3.70it/s]
                                                  

 19%|█▉        | 496/2560 [02:43<09:17,  3.70it/s]
 19%|█▉        | 497/2560 [02:44<09:21,  3.67it/s]
 19%|█▉        | 498/2560 [02:44<09:19,  3.69it/s]
                                                  

 19%|█▉        | 498/2560 [02:44<09:19,  3.69it/s]
 19%|█▉        | 499/2560 [02:44<09:31,  3.60it/s]
 20%|█▉        | 500/2560 [02:45<09:31,  3.61it/s]
                                                  

 20%|█▉        | 500/2560 [02:45<09:31,  3.61it/s]
 20%|█▉        | 501/2560 [02:45<10:03,  3.41it/s]
 20%|█▉        | 502/2560 [02:45<09:55,  3.46it/s]
                                                  

 20%|█▉        | 502/2560 [02:45<09:55,  3.46it/s]
 20%|█▉        | 503/2560 [02:45<09:52,  3.47it/s]
 20%|█▉        | 504/2560 [02:46<09:42,  3.53it/s]
                                                  

 20%|█▉        | 504/2560 [02:46<09:42,  3.53it/s]
 20%|█▉        | 505/2560 [02:46<09:39,  3.55it/s]
 20%|█▉        | 506/2560 [02:46<09:34,  3.57it/s]
                                                  

 20%|█▉        | 506/2560 [02:46<09:34,  3.57it/s]
 20%|█▉        | 507/2560 [02:47<09:37,  3.56it/s]
 20%|█▉        | 508/2560 [02:47<09:30,  3.60it/s]
                                                  

 20%|█▉        | 508/2560 [02:47<09:30,  3.60it/s]
 20%|█▉        | 509/2560 [02:47<09:24,  3.63it/s]
 20%|█▉        | 510/2560 [02:47<09:21,  3.65it/s]
                                                  

 20%|█▉        | 510/2560 [02:47<09:21,  3.65it/s]
 20%|█▉        | 511/2560 [02:48<09:19,  3.66it/s]
 20%|██        | 512/2560 [02:48<07:53,  4.32it/s]
                                                  

 20%|██        | 512/2560 [02:48<07:53,  4.32it/s]
 20%|██        | 513/2560 [02:48<08:23,  4.07it/s]
 20%|██        | 514/2560 [02:48<08:46,  3.88it/s]
                                                  

 20%|██        | 514/2560 [02:48<08:46,  3.88it/s]
 20%|██        | 515/2560 [02:49<08:55,  3.82it/s]
 20%|██        | 516/2560 [02:49<09:03,  3.76it/s]
                                                  

 20%|██        | 516/2560 [02:49<09:03,  3.76it/s]
 20%|██        | 517/2560 [02:49<09:08,  3.73it/s]
 20%|██        | 518/2560 [02:49<09:06,  3.74it/s]
                                                  

 20%|██        | 518/2560 [02:49<09:06,  3.74it/s]
 20%|██        | 519/2560 [02:50<09:11,  3.70it/s]
 20%|██        | 520/2560 [02:50<09:10,  3.71it/s]
                                                  

 20%|██        | 520/2560 [02:50<09:10,  3.71it/s]
 20%|██        | 521/2560 [02:50<09:13,  3.69it/s]
 20%|██        | 522/2560 [02:50<09:11,  3.70it/s]
                                                  

 20%|██        | 522/2560 [02:50<09:11,  3.70it/s]
 20%|██        | 523/2560 [02:51<09:12,  3.69it/s]
 20%|██        | 524/2560 [02:51<09:10,  3.70it/s]
                                                  

 20%|██        | 524/2560 [02:51<09:10,  3.70it/s]
 21%|██        | 525/2560 [02:51<09:17,  3.65it/s]
 21%|██        | 526/2560 [02:52<09:13,  3.67it/s]
                                                  

 21%|██        | 526/2560 [02:52<09:13,  3.67it/s]
 21%|██        | 527/2560 [02:52<09:17,  3.65it/s]
 21%|██        | 528/2560 [02:52<09:15,  3.66it/s]
                                                  

 21%|██        | 528/2560 [02:52<09:15,  3.66it/s]
 21%|██        | 529/2560 [02:52<09:24,  3.60it/s]
 21%|██        | 530/2560 [02:53<09:15,  3.65it/s]
                                                  

 21%|██        | 530/2560 [02:53<09:15,  3.65it/s]
 21%|██        | 531/2560 [02:53<09:07,  3.70it/s]
 21%|██        | 532/2560 [02:53<09:06,  3.71it/s]
                                                  

 21%|██        | 532/2560 [02:53<09:06,  3.71it/s]
 21%|██        | 533/2560 [02:53<09:05,  3.72it/s]
 21%|██        | 534/2560 [02:54<09:03,  3.73it/s]
                                                  

 21%|██        | 534/2560 [02:54<09:03,  3.73it/s]
 21%|██        | 535/2560 [02:54<08:59,  3.75it/s]
 21%|██        | 536/2560 [02:54<09:08,  3.69it/s]
                                                  

 21%|██        | 536/2560 [02:54<09:08,  3.69it/s]
 21%|██        | 537/2560 [02:55<09:08,  3.69it/s]
 21%|██        | 538/2560 [02:55<09:05,  3.71it/s]
                                                  

 21%|██        | 538/2560 [02:55<09:05,  3.71it/s]
 21%|██        | 539/2560 [02:55<08:59,  3.74it/s]
 21%|██        | 540/2560 [02:55<09:04,  3.71it/s]
                                                  

 21%|██        | 540/2560 [02:55<09:04,  3.71it/s]
 21%|██        | 541/2560 [02:56<09:03,  3.72it/s]
 21%|██        | 542/2560 [02:56<09:03,  3.71it/s]
                                                  

 21%|██        | 542/2560 [02:56<09:03,  3.71it/s]
 21%|██        | 543/2560 [02:56<09:04,  3.71it/s]
 21%|██▏       | 544/2560 [02:56<09:02,  3.71it/s]
                                                  

 21%|██▏       | 544/2560 [02:56<09:02,  3.71it/s]
 21%|██▏       | 545/2560 [02:57<09:03,  3.71it/s]
 21%|██▏       | 546/2560 [02:57<09:01,  3.72it/s]
                                                  
{'loss': '0.05041', 'grad_norm': '0.4058', 'learning_rate': '0.0001954', 'epoch': '5.724'}
{'loss': '0.05567', 'grad_norm': '0.4131', 'learning_rate': '0.0001953', 'epoch': '5.756'}
{'loss': '0.1017', 'grad_norm': '0.4637', 'learning_rate': '0.0001952', 'epoch': '5.787'}
{'loss': '0.01606', 'grad_norm': '0.1792', 'learning_rate': '0.0001951', 'epoch': '5.819'}
{'loss': '0.05146', 'grad_norm': '0.6187', 'learning_rate': '0.000195', 'epoch': '5.85'}
{'loss': '0.004913', 'grad_norm': '0.2513', 'learning_rate': '0.000195', 'epoch': '5.882'}
{'loss': '0.04704', 'grad_norm': '0.282', 'learning_rate': '0.0001949', 'epoch': '5.913'}
{'loss': '0.00764', 'grad_norm': '0.1366', 'learning_rate': '0.0001948', 'epoch': '5.945'}
{'loss': '0.02003', 'grad_norm': '0.6645', 'learning_rate': '0.0001947', 'epoch': '5.976'}
{'loss': '0.02124', 'grad_norm': '1.11', 'learning_rate': '0.0001946', 'epoch': '6'}
{'loss': '0.07305', 'grad_norm': '0.8244', 'learning_rate': '0.0001945', 'epoch': '6.031'}
{'loss': '0.02638', 'grad_norm': '0.2078', 'learning_rate': '0.0001945', 'epoch': '6.063'}
{'loss': '0.02765', 'grad_norm': '0.5318', 'learning_rate': '0.0001944', 'epoch': '6.094'}
{'loss': '0.01321', 'grad_norm': '0.4591', 'learning_rate': '0.0001943', 'epoch': '6.126'}
{'loss': '0.004485', 'grad_norm': '0.1983', 'learning_rate': '0.0001942', 'epoch': '6.157'}
{'loss': '0.03024', 'grad_norm': '0.6781', 'learning_rate': '0.0001941', 'epoch': '6.189'}
{'loss': '0.06133', 'grad_norm': '0.5061', 'learning_rate': '0.000194', 'epoch': '6.22'}
{'loss': '0.02272', 'grad_norm': '0.249', 'learning_rate': '0.0001939', 'epoch': '6.252'}
{'loss': '0.004931', 'grad_norm': '0.2388', 'learning_rate': '0.0001938', 'epoch': '6.283'}
{'loss': '0.04266', 'grad_norm': '0.649', 'learning_rate': '0.0001938', 'epoch': '6.315'}
{'loss': '0.00956', 'grad_norm': '0.2803', 'learning_rate': '0.0001937', 'epoch': '6.346'}
{'loss': '0.004837', 'grad_norm': '0.2308', 'learning_rate': '0.0001936', 'epoch': '6.378'}
{'loss': '0.04464', 'grad_norm': '0.5861', 'learning_rate': '0.0001935', 'epoch': '6.409'}
{'loss': '0.0242', 'grad_norm': '0.3808', 'learning_rate': '0.0001934', 'epoch': '6.441'}
{'loss': '0.02062', 'grad_norm': '0.1224', 'learning_rate': '0.0001933', 'epoch': '6.472'}
{'loss': '0.008309', 'grad_norm': '0.5269', 'learning_rate': '0.0001932', 'epoch': '6.504'}
{'loss': '0.02574', 'grad_norm': '0.4206', 'learning_rate': '0.0001931', 'epoch': '6.535'}
{'loss': '0.04663', 'grad_norm': '0.5919', 'learning_rate': '0.000193', 'epoch': '6.567'}
{'loss': '0.01686', 'grad_norm': '0.7331', 'learning_rate': '0.0001929', 'epoch': '6.598'}
{'loss': '0.003736', 'grad_norm': '0.1462', 'learning_rate': '0.0001928', 'epoch': '6.63'}
{'loss': '0.05231', 'grad_norm': '0.4964', 'learning_rate': '0.0001927', 'epoch': '6.661'}
{'loss': '0.003952', 'grad_norm': '0.2623', 'learning_rate': '0.0001926', 'epoch': '6.693'}
{'loss': '0.006909', 'grad_norm': '0.3829', 'learning_rate': '0.0001925', 'epoch': '6.724'}
{'loss': '0.02062', 'grad_norm': '0.4658', 'learning_rate': '0.0001924', 'epoch': '6.756'}
{'loss': '0.06132', 'grad_norm': '0.6078', 'learning_rate': '0.0001923', 'epoch': '6.787'}
{'loss': '0.01495', 'grad_norm': '0.4635', 'learning_rate': '0.0001922', 'epoch': '6.819'}
{'loss': '0.02481', 'grad_norm': '0.3482', 'learning_rate': '0.0001921', 'epoch': '6.85'}
{'loss': '0.02302', 'grad_norm': '0.4121', 'learning_rate': '0.000192', 'epoch': '6.882'}
{'loss': '0.01085', 'grad_norm': '0.09076', 'learning_rate': '0.0001919', 'epoch': '6.913'}
{'loss': '0.005528', 'grad_norm': '0.107', 'learning_rate': '0.0001918', 'epoch': '6.945'}
{'loss': '0.003082', 'grad_norm': '0.1269', 'learning_rate': '0.0001917', 'epoch': '6.976'}
{'loss': '0.003509', 'grad_norm': '0.1465', 'learning_rate': '0.0001916', 'epoch': '7'}
{'loss': '0.008812', 'grad_norm': '0.3042', 'learning_rate': '0.0001915', 'epoch': '7.031'}
{'loss': '0.004644', 'grad_norm': '0.1829', 'learning_rate': '0.0001914', 'epoch': '7.063'}
{'loss': '0.002709', 'grad_norm': '0.04672', 'learning_rate': '0.0001913', 'epoch': '7.094'}
{'loss': '0.009424', 'grad_norm': '0.2934', 'learning_rate': '0.0001912', 'epoch': '7.126'}
{'loss': '0.0119', 'grad_norm': '0.05052', 'learning_rate': '0.0001911', 'epoch': '7.157'}
{'loss': '0.002935', 'grad_norm': '0.1128', 'learning_rate': '0.000191', 'epoch': '7.189'}
{'loss': '0.009262', 'grad_norm': '0.05936', 'learning_rate': '0.0001909', 'epoch': '7.22'}
{'loss': '0.02128', 'grad_norm': '0.08429', 'learning_rate': '0.0001908', 'epoch': '7.252'}
{'loss': '0.001974', 'grad_norm': '0.07778', 'learning_rate': '0.0001907', 'epoch': '7.283'}
{'loss': '0.03606', 'grad_norm': '0.5126', 'learning_rate': '0.0001906', 'epoch': '7.315'}
{'loss': '0.02136', 'grad_norm': '0.2269', 'learning_rate': '0.0001905', 'epoch': '7.346'}
{'loss': '0.01292', 'grad_norm': '0.1028', 'learning_rate': '0.0001903', 'epoch': '7.378'}
{'loss': '0.01559', 'grad_norm': '0.08412', 'learning_rate': '0.0001902', 'epoch': '7.409'}
{'loss': '0.03208', 'grad_norm': '0.3615', 'learning_rate': '0.0001901', 'epoch': '7.441'}
{'loss': '0.02421', 'grad_norm': '0.2731', 'learning_rate': '0.00019', 'epoch': '7.472'}
{'loss': '0.003935', 'grad_norm': '0.4576', 'learning_rate': '0.0001899', 'epoch': '7.504'}
{'loss': '0.00326', 'grad_norm': '0.1619', 'learning_rate': '0.0001898', 'epoch': '7.535'}
{'loss': '0.07983', 'grad_norm': '0.7635', 'learning_rate': '0.0001897', 'epoch': '7.567'}
{'loss': '0.01753', 'grad_norm': '0.2903', 'learning_rate': '0.0001896', 'epoch': '7.598'}
{'loss': '0.01368', 'grad_norm': '0.486', 'learning_rate': '0.0001894', 'epoch': '7.63'}
{'loss': '0.05896', 'grad_norm': '0.4104', 'learning_rate': '0.0001893', 'epoch': '7.661'}
{'loss': '0.05142', 'grad_norm': '0.7291', 'learning_rate': '0.0001892', 'epoch': '7.693'}
{'loss': '0.00712', 'grad_norm': '0.2921', 'learning_rate': '0.0001891', 'epoch': '7.724'}
{'loss': '0.008248', 'grad_norm': '0.5551', 'learning_rate': '0.000189', 'epoch': '7.756'}
{'loss': '0.0045', 'grad_norm': '0.2325', 'learning_rate': '0.0001889', 'epoch': '7.787'}
{'loss': '0.01716', 'grad_norm': '1.035', 'learning_rate': '0.0001887', 'epoch': '7.819'}
{'loss': '0.01733', 'grad_norm': '0.5099', 'learning_rate': '0.0001886', 'epoch': '7.85'}
{'loss': '0.02429', 'grad_norm': '0.5938', 'learning_rate': '0.0001885', 'epoch': '7.882'}
{'loss': '0.02181', 'grad_norm': '0.5331', 'learning_rate': '0.0001884', 'epoch': '7.913'}
{'loss': '0.02126', 'grad_norm': '0.8818', 'learning_rate': '0.0001883', 'epoch': '7.945'}
{'loss': '0.004352', 'grad_norm': '0.5303', 'learning_rate': '0.0001881', 'epoch': '7.976'}
{'loss': '0.005876', 'grad_norm': '0.4228', 'learning_rate': '0.000188', 'epoch': '8'}
{'loss': '0.01095', 'grad_norm': '0.3792', 'learning_rate': '0.0001879', 'epoch': '8.031'}
{'loss': '0.02147', 'grad_norm': '0.1948', 'learning_rate': '0.0001878', 'epoch': '8.063'}
{'loss': '0.009155', 'grad_norm': '0.3266', 'learning_rate': '0.0001876', 'epoch': '8.094'}
{'loss': '0.008897', 'grad_norm': '0.2961', 'learning_rate': '0.0001875', 'epoch': '8.126'}
{'loss': '0.004416', 'grad_norm': '0.08662', 'learning_rate': '0.0001874', 'epoch': '8.157'}
{'loss': '0.01192', 'grad_norm': '0.1009', 'learning_rate': '0.0001873', 'epoch': '8.189'}
{'loss': '0.0194', 'grad_norm': '0.3214', 'learning_rate': '0.0001871', 'epoch': '8.22'}
{'loss': '0.03768', 'grad_norm': '0.385', 'learning_rate': '0.000187', 'epoch': '8.252'}
{'loss': '0.007104', 'grad_norm': '0.2848', 'learning_rate': '0.0001869', 'epoch': '8.283'}
{'loss': '0.02531', 'grad_norm': '0.2107', 'learning_rate': '0.0001868', 'epoch': '8.315'}
{'loss': '0.01079', 'grad_norm': '0.1955', 'learning_rate': '0.0001866', 'epoch': '8.346'}
{'loss': '0.03564', 'grad_norm': '0.5338', 'learning_rate': '0.0001865', 'epoch': '8.378'}
{'loss': '0.02098', 'grad_norm': '0.1664', 'learning_rate': '0.0001864', 'epoch': '8.409'}
{'loss': '0.002512', 'grad_norm': '0.08525', 'learning_rate': '0.0001862', 'epoch': '8.441'}
{'loss': '0.002956', 'grad_norm': '0.1138', 'learning_rate': '0.0001861', 'epoch': '8.472'}
{'loss': '0.002398', 'grad_norm': '0.168', 'learning_rate': '0.000186', 'epoch': '8.504'}
{'loss': '0.01264', 'grad_norm': '0.4186', 'learning_rate': '0.0001858', 'epoch': '8.535'}
 21%|██▏       | 546/2560 [02:57<09:01,  3.72it/s]
 21%|██▏       | 547/2560 [02:57<09:04,  3.70it/s]
 21%|██▏       | 548/2560 [02:58<09:03,  3.70it/s]
                                                  

 21%|██▏       | 548/2560 [02:58<09:03,  3.70it/s]
 21%|██▏       | 549/2560 [02:58<09:00,  3.72it/s]
 21%|██▏       | 550/2560 [02:58<08:58,  3.73it/s]
                                                  

 21%|██▏       | 550/2560 [02:58<08:58,  3.73it/s]
 22%|██▏       | 551/2560 [02:58<08:57,  3.74it/s]
 22%|██▏       | 552/2560 [02:59<08:56,  3.75it/s]
                                                  

 22%|██▏       | 552/2560 [02:59<08:56,  3.75it/s]
 22%|██▏       | 553/2560 [02:59<08:55,  3.75it/s]
 22%|██▏       | 554/2560 [02:59<09:03,  3.69it/s]
                                                  

 22%|██▏       | 554/2560 [02:59<09:03,  3.69it/s]
 22%|██▏       | 555/2560 [02:59<09:03,  3.69it/s]
 22%|██▏       | 556/2560 [03:00<08:59,  3.71it/s]
                                                  

 22%|██▏       | 556/2560 [03:00<08:59,  3.71it/s]
 22%|██▏       | 557/2560 [03:00<08:56,  3.73it/s]
 22%|██▏       | 558/2560 [03:00<08:52,  3.76it/s]
                                                  

 22%|██▏       | 558/2560 [03:00<08:52,  3.76it/s]
 22%|██▏       | 559/2560 [03:00<09:04,  3.67it/s]
 22%|██▏       | 560/2560 [03:01<09:02,  3.69it/s]
                                                  

 22%|██▏       | 560/2560 [03:01<09:02,  3.69it/s]
 22%|██▏       | 561/2560 [03:01<09:01,  3.69it/s]
 22%|██▏       | 562/2560 [03:01<08:57,  3.72it/s]
                                                  

 22%|██▏       | 562/2560 [03:01<08:57,  3.72it/s]
 22%|██▏       | 563/2560 [03:02<08:56,  3.72it/s]
 22%|██▏       | 564/2560 [03:02<08:54,  3.74it/s]
                                                  

 22%|██▏       | 564/2560 [03:02<08:54,  3.74it/s]
 22%|██▏       | 565/2560 [03:02<08:53,  3.74it/s]
 22%|██▏       | 566/2560 [03:02<08:54,  3.73it/s]
                                                  

 22%|██▏       | 566/2560 [03:02<08:54,  3.73it/s]
 22%|██▏       | 567/2560 [03:03<08:53,  3.73it/s]
 22%|██▏       | 568/2560 [03:03<09:01,  3.68it/s]
                                                  

 22%|██▏       | 568/2560 [03:03<09:01,  3.68it/s]
 22%|██▏       | 569/2560 [03:03<08:54,  3.72it/s]
 22%|██▏       | 570/2560 [03:03<08:59,  3.69it/s]
                                                  

 22%|██▏       | 570/2560 [03:03<08:59,  3.69it/s]
 22%|██▏       | 571/2560 [03:04<08:54,  3.72it/s]
 22%|██▏       | 572/2560 [03:04<08:54,  3.72it/s]
                                                  

 22%|██▏       | 572/2560 [03:04<08:54,  3.72it/s]
 22%|██▏       | 573/2560 [03:04<08:51,  3.74it/s]
 22%|██▏       | 574/2560 [03:05<08:55,  3.71it/s]
                                                  

 22%|██▏       | 574/2560 [03:05<08:55,  3.71it/s]
 22%|██▏       | 575/2560 [03:05<08:53,  3.72it/s]
 22%|██▎       | 576/2560 [03:05<07:32,  4.38it/s]
                                                  

 22%|██▎       | 576/2560 [03:05<07:32,  4.38it/s]
 23%|██▎       | 577/2560 [03:05<08:00,  4.13it/s]
 23%|██▎       | 578/2560 [03:05<08:14,  4.01it/s]
                                                  

 23%|██▎       | 578/2560 [03:05<08:14,  4.01it/s]
 23%|██▎       | 579/2560 [03:06<08:26,  3.91it/s]
 23%|██▎       | 580/2560 [03:06<08:37,  3.82it/s]
                                                  

 23%|██▎       | 580/2560 [03:06<08:37,  3.82it/s]
 23%|██▎       | 581/2560 [03:06<08:49,  3.74it/s]
 23%|██▎       | 582/2560 [03:07<08:55,  3.70it/s]
                                                  

 23%|██▎       | 582/2560 [03:07<08:55,  3.70it/s]
 23%|██▎       | 583/2560 [03:07<08:58,  3.67it/s]
 23%|██▎       | 584/2560 [03:07<08:58,  3.67it/s]
                                                  

 23%|██▎       | 584/2560 [03:07<08:58,  3.67it/s]
 23%|██▎       | 585/2560 [03:07<08:56,  3.68it/s]
 23%|██▎       | 586/2560 [03:08<09:03,  3.63it/s]
                                                  

 23%|██▎       | 586/2560 [03:08<09:03,  3.63it/s]
 23%|██▎       | 587/2560 [03:08<08:58,  3.66it/s]
 23%|██▎       | 588/2560 [03:08<08:58,  3.66it/s]
                                                  

 23%|██▎       | 588/2560 [03:08<08:58,  3.66it/s]
 23%|██▎       | 589/2560 [03:08<08:57,  3.67it/s]
 23%|██▎       | 590/2560 [03:09<08:57,  3.67it/s]
                                                  

 23%|██▎       | 590/2560 [03:09<08:57,  3.67it/s]
 23%|██▎       | 591/2560 [03:09<08:53,  3.69it/s]
 23%|██▎       | 592/2560 [03:09<08:58,  3.65it/s]
                                                  

 23%|██▎       | 592/2560 [03:09<08:58,  3.65it/s]
 23%|██▎       | 593/2560 [03:10<09:04,  3.61it/s]
 23%|██▎       | 594/2560 [03:10<09:08,  3.58it/s]
                                                  

 23%|██▎       | 594/2560 [03:10<09:08,  3.58it/s]
 23%|██▎       | 595/2560 [03:10<09:11,  3.57it/s]
 23%|██▎       | 596/2560 [03:10<09:16,  3.53it/s]
                                                  

 23%|██▎       | 596/2560 [03:10<09:16,  3.53it/s]
 23%|██▎       | 597/2560 [03:11<09:16,  3.53it/s]
 23%|██▎       | 598/2560 [03:11<09:17,  3.52it/s]
                                                  

 23%|██▎       | 598/2560 [03:11<09:17,  3.52it/s]
 23%|██▎       | 599/2560 [03:11<09:22,  3.48it/s]
 23%|██▎       | 600/2560 [03:12<09:18,  3.51it/s]
                                                  

 23%|██▎       | 600/2560 [03:12<09:18,  3.51it/s]
 23%|██▎       | 601/2560 [03:12<09:11,  3.55it/s]
 24%|██▎       | 602/2560 [03:12<09:03,  3.60it/s]
                                                  

 24%|██▎       | 602/2560 [03:12<09:03,  3.60it/s]
 24%|██▎       | 603/2560 [03:12<09:02,  3.61it/s]
 24%|██▎       | 604/2560 [03:13<08:56,  3.64it/s]
                                                  

 24%|██▎       | 604/2560 [03:13<08:56,  3.64it/s]
 24%|██▎       | 605/2560 [03:13<08:54,  3.66it/s]
 24%|██▎       | 606/2560 [03:13<08:48,  3.70it/s]
                                                  

 24%|██▎       | 606/2560 [03:13<08:48,  3.70it/s]
 24%|██▎       | 607/2560 [03:13<08:49,  3.69it/s]
 24%|██▍       | 608/2560 [03:14<08:49,  3.69it/s]
                                                  

 24%|██▍       | 608/2560 [03:14<08:49,  3.69it/s]
 24%|██▍       | 609/2560 [03:14<08:49,  3.68it/s]
 24%|██▍       | 610/2560 [03:14<08:52,  3.66it/s]
                                                  

 24%|██▍       | 610/2560 [03:14<08:52,  3.66it/s]
 24%|██▍       | 611/2560 [03:15<08:54,  3.65it/s]
 24%|██▍       | 612/2560 [03:15<09:04,  3.58it/s]
                                                  

 24%|██▍       | 612/2560 [03:15<09:04,  3.58it/s]
 24%|██▍       | 613/2560 [03:15<08:52,  3.65it/s]
 24%|██▍       | 614/2560 [03:15<08:43,  3.72it/s]
                                                  

 24%|██▍       | 614/2560 [03:15<08:43,  3.72it/s]
 24%|██▍       | 615/2560 [03:16<08:43,  3.72it/s]
 24%|██▍       | 616/2560 [03:16<08:38,  3.75it/s]
                                                  

 24%|██▍       | 616/2560 [03:16<08:38,  3.75it/s]
 24%|██▍       | 617/2560 [03:16<08:37,  3.76it/s]
 24%|██▍       | 618/2560 [03:16<08:42,  3.72it/s]
                                                  

 24%|██▍       | 618/2560 [03:16<08:42,  3.72it/s]
 24%|██▍       | 619/2560 [03:17<08:44,  3.70it/s]
 24%|██▍       | 620/2560 [03:17<08:44,  3.70it/s]
                                                  

 24%|██▍       | 620/2560 [03:17<08:44,  3.70it/s]
 24%|██▍       | 621/2560 [03:17<08:51,  3.65it/s]
 24%|██▍       | 622/2560 [03:18<08:51,  3.65it/s]
                                                  

 24%|██▍       | 622/2560 [03:18<08:51,  3.65it/s]
 24%|██▍       | 623/2560 [03:18<08:56,  3.61it/s]
 24%|██▍       | 624/2560 [03:18<08:53,  3.63it/s]
                                                  

 24%|██▍       | 624/2560 [03:18<08:53,  3.63it/s]
 24%|██▍       | 625/2560 [03:18<08:56,  3.61it/s]
 24%|██▍       | 626/2560 [03:19<08:58,  3.59it/s]
                                                  

 24%|██▍       | 626/2560 [03:19<08:58,  3.59it/s]
 24%|██▍       | 627/2560 [03:19<08:54,  3.61it/s]
 25%|██▍       | 628/2560 [03:19<08:50,  3.64it/s]
                                                  

 25%|██▍       | 628/2560 [03:19<08:50,  3.64it/s]
 25%|██▍       | 629/2560 [03:19<08:42,  3.69it/s]
 25%|██▍       | 630/2560 [03:20<08:43,  3.69it/s]
                                                  

 25%|██▍       | 630/2560 [03:20<08:43,  3.69it/s]
 25%|██▍       | 631/2560 [03:20<08:44,  3.68it/s]
 25%|██▍       | 632/2560 [03:20<08:53,  3.62it/s]
                                                  

 25%|██▍       | 632/2560 [03:20<08:53,  3.62it/s]
 25%|██▍       | 633/2560 [03:21<08:51,  3.63it/s]
 25%|██▍       | 634/2560 [03:21<08:51,  3.63it/s]
                                                  

 25%|██▍       | 634/2560 [03:21<08:51,  3.63it/s]
 25%|██▍       | 635/2560 [03:21<08:52,  3.62it/s]
 25%|██▍       | 636/2560 [03:21<08:56,  3.58it/s]
                                                  

 25%|██▍       | 636/2560 [03:21<08:56,  3.58it/s]
 25%|██▍       | 637/2560 [03:22<08:54,  3.60it/s]
 25%|██▍       | 638/2560 [03:22<08:54,  3.59it/s]
                                                  

 25%|██▍       | 638/2560 [03:22<08:54,  3.59it/s]
 25%|██▍       | 639/2560 [03:22<08:50,  3.62it/s]
 25%|██▌       | 640/2560 [03:22<07:29,  4.28it/s]
                                                  

 25%|██▌       | 640/2560 [03:22<07:29,  4.28it/s]
 25%|██▌       | 641/2560 [03:23<07:59,  4.01it/s]
 25%|██▌       | 642/2560 [03:23<08:19,  3.84it/s]
                                                  

 25%|██▌       | 642/2560 [03:23<08:19,  3.84it/s]
 25%|██▌       | 643/2560 [03:23<08:29,  3.76it/s]
 25%|██▌       | 644/2560 [03:23<08:26,  3.78it/s]
                                                  

 25%|██▌       | 644/2560 [03:23<08:26,  3.78it/s]
 25%|██▌       | 645/2560 [03:24<08:28,  3.77it/s]
 25%|██▌       | 646/2560 [03:24<08:31,  3.74it/s]
                                                  

 25%|██▌       | 646/2560 [03:24<08:31,  3.74it/s]
 25%|██▌       | 647/2560 [03:24<08:28,  3.76it/s]
 25%|██▌       | 648/2560 [03:25<08:37,  3.69it/s]
                                                  

 25%|██▌       | 648/2560 [03:25<08:37,  3.69it/s]
 25%|██▌       | 649/2560 [03:25<08:37,  3.69it/s]
 25%|██▌       | 650/2560 [03:25<08:39,  3.68it/s]
                                                  

 25%|██▌       | 650/2560 [03:25<08:39,  3.68it/s]
 25%|██▌       | 651/2560 [03:25<08:44,  3.64it/s]
 25%|██▌       | 652/2560 [03:26<08:43,  3.64it/s]
                                                  

 25%|██▌       | 652/2560 [03:26<08:43,  3.64it/s]
 26%|██▌       | 653/2560 [03:26<08:40,  3.66it/s]
 26%|██▌       | 654/2560 [03:26<08:41,  3.65it/s]
                                                  

 26%|██▌       | 654/2560 [03:26<08:41,  3.65it/s]
 26%|██▌       | 655/2560 [03:27<08:41,  3.65it/s]
 26%|██▌       | 656/2560 [03:27<08:44,  3.63it/s]
                                                  

 26%|██▌       | 656/2560 [03:27<08:44,  3.63it/s]
 26%|██▌       | 657/2560 [03:27<08:42,  3.64it/s]
 26%|██▌       | 658/2560 [03:27<08:39,  3.66it/s]
                                                  

 26%|██▌       | 658/2560 [03:27<08:39,  3.66it/s]
 26%|██▌       | 659/2560 [03:28<08:43,  3.63it/s]
 26%|██▌       | 660/2560 [03:28<08:39,  3.66it/s]
                                                  

 26%|██▌       | 660/2560 [03:28<08:39,  3.66it/s]
 26%|██▌       | 661/2560 [03:28<09:04,  3.49it/s]
 26%|██▌       | 662/2560 [03:28<08:56,  3.54it/s]
                                                  

 26%|██▌       | 662/2560 [03:28<08:56,  3.54it/s]
 26%|██▌       | 663/2560 [03:29<08:48,  3.59it/s]
 26%|██▌       | 664/2560 [03:29<08:41,  3.63it/s]
                                                  

 26%|██▌       | 664/2560 [03:29<08:41,  3.63it/s]
 26%|██▌       | 665/2560 [03:29<08:35,  3.67it/s]
 26%|██▌       | 666/2560 [03:30<08:30,  3.71it/s]
                                                  

 26%|██▌       | 666/2560 [03:30<08:30,  3.71it/s]
 26%|██▌       | 667/2560 [03:30<08:27,  3.73it/s]
 26%|██▌       | 668/2560 [03:30<08:22,  3.76it/s]
                                                  

 26%|██▌       | 668/2560 [03:30<08:22,  3.76it/s]
 26%|██▌       | 669/2560 [03:30<08:21,  3.77it/s]
 26%|██▌       | 670/2560 [03:31<08:19,  3.78it/s]
                                                  

 26%|██▌       | 670/2560 [03:31<08:19,  3.78it/s]
 26%|██▌       | 671/2560 [03:31<08:19,  3.78it/s]
 26%|██▋       | 672/2560 [03:31<08:19,  3.78it/s]
                                                  

 26%|██▋       | 672/2560 [03:31<08:19,  3.78it/s]
 26%|██▋       | 673/2560 [03:31<08:22,  3.75it/s]
 26%|██▋       | 674/2560 [03:32<08:19,  3.77it/s]
                                                  

 26%|██▋       | 674/2560 [03:32<08:19,  3.77it/s]
 26%|██▋       | 675/2560 [03:32<08:20,  3.77it/s]
 26%|██▋       | 676/2560 [03:32<08:18,  3.78it/s]
                                                  

 26%|██▋       | 676/2560 [03:32<08:18,  3.78it/s]
 26%|██▋       | 677/2560 [03:32<08:16,  3.79it/s]
 26%|██▋       | 678/2560 [03:33<08:15,  3.80it/s]
                                                  

 26%|██▋       | 678/2560 [03:33<08:15,  3.80it/s]
 27%|██▋       | 679/2560 [03:33<08:14,  3.80it/s]
 27%|██▋       | 680/2560 [03:33<08:13,  3.81it/s]
                                                  

 27%|██▋       | 680/2560 [03:33<08:13,  3.81it/s]
 27%|██▋       | 681/2560 [03:33<08:13,  3.81it/s]
 27%|██▋       | 682/2560 [03:34<08:11,  3.82it/s]
                                                  

 27%|██▋       | 682/2560 [03:34<08:11,  3.82it/s]
 27%|██▋       | 683/2560 [03:34<08:09,  3.83it/s]
 27%|██▋       | 684/2560 [03:34<08:08,  3.84it/s]
                                                  

 27%|██▋       | 684/2560 [03:34<08:08,  3.84it/s]
 27%|██▋       | 685/2560 [03:35<08:07,  3.85it/s]
 27%|██▋       | 686/2560 [03:35<08:08,  3.83it/s]
                                                  

 27%|██▋       | 686/2560 [03:35<08:08,  3.83it/s]
 27%|██▋       | 687/2560 [03:35<08:09,  3.82it/s]
 27%|██▋       | 688/2560 [03:35<08:08,  3.83it/s]
                                                  

 27%|██▋       | 688/2560 [03:35<08:08,  3.83it/s]
 27%|██▋       | 689/2560 [03:36<08:15,  3.77it/s]
 27%|██▋       | 690/2560 [03:36<08:17,  3.76it/s]
                                                  

 27%|██▋       | 690/2560 [03:36<08:17,  3.76it/s]
 27%|██▋       | 691/2560 [03:36<08:16,  3.76it/s]
 27%|██▋       | 692/2560 [03:36<08:15,  3.77it/s]
                                                  

 27%|██▋       | 692/2560 [03:36<08:15,  3.77it/s]
 27%|██▋       | 693/2560 [03:37<08:17,  3.75it/s]
 27%|██▋       | 694/2560 [03:37<08:14,  3.77it/s]
                                                  

 27%|██▋       | 694/2560 [03:37<08:14,  3.77it/s]
 27%|██▋       | 695/2560 [03:37<08:11,  3.79it/s]
 27%|██▋       | 696/2560 [03:37<08:12,  3.79it/s]
                                                  

 27%|██▋       | 696/2560 [03:37<08:12,  3.79it/s]
 27%|██▋       | 697/2560 [03:38<08:11,  3.79it/s]
 27%|██▋       | 698/2560 [03:38<08:13,  3.77it/s]
                                                  

 27%|██▋       | 698/2560 [03:38<08:13,  3.77it/s]
 27%|██▋       | 699/2560 [03:38<08:12,  3.78it/s]
 27%|██▋       | 700/2560 [03:38<08:14,  3.76it/s]
                                                  

 27%|██▋       | 700/2560 [03:38<08:14,  3.76it/s]
 27%|██▋       | 701/2560 [03:39<08:20,  3.71it/s]
 27%|██▋       | 702/2560 [03:39<08:21,  3.70it/s]
                                                  

 27%|██▋       | 702/2560 [03:39<08:21,  3.70it/s]
 27%|██▋       | 703/2560 [03:39<08:19,  3.72it/s]
 28%|██▊       | 704/2560 [03:39<07:03,  4.39it/s]
                                                  

 28%|██▊       | 704/2560 [03:39<07:03,  4.39it/s]
 28%|██▊       | 705/2560 [03:40<07:25,  4.16it/s]
 28%|██▊       | 706/2560 [03:40<07:40,  4.03it/s]
                                                  

 28%|██▊       | 706/2560 [03:40<07:40,  4.03it/s]
 28%|██▊       | 707/2560 [03:40<07:54,  3.91it/s]
 28%|██▊       | 708/2560 [03:41<08:00,  3.86it/s]
                                                  

 28%|██▊       | 708/2560 [03:41<08:00,  3.86it/s]
 28%|██▊       | 709/2560 [03:41<07:59,  3.86it/s]
 28%|██▊       | 710/2560 [03:41<08:01,  3.84it/s]
                                                  

 28%|██▊       | 710/2560 [03:41<08:01,  3.84it/s]
 28%|██▊       | 711/2560 [03:41<08:04,  3.82it/s]
 28%|██▊       | 712/2560 [03:42<08:05,  3.81it/s]
                                                  

 28%|██▊       | 712/2560 [03:42<08:05,  3.81it/s]
 28%|██▊       | 713/2560 [03:42<08:08,  3.78it/s]
 28%|██▊       | 714/2560 [03:42<08:06,  3.79it/s]
                                                  

 28%|██▊       | 714/2560 [03:42<08:06,  3.79it/s]
 28%|██▊       | 715/2560 [03:42<08:05,  3.80it/s]
 28%|██▊       | 716/2560 [03:43<08:09,  3.77it/s]
                                                  

 28%|██▊       | 716/2560 [03:43<08:09,  3.77it/s]
 28%|██▊       | 717/2560 [03:43<08:10,  3.76it/s]
 28%|██▊       | 718/2560 [03:43<08:06,  3.78it/s]
                                                  

 28%|██▊       | 718/2560 [03:43<08:06,  3.78it/s]
 28%|██▊       | 719/2560 [03:43<08:04,  3.80it/s]
 28%|██▊       | 720/2560 [03:44<08:04,  3.79it/s]
                                                  

 28%|██▊       | 720/2560 [03:44<08:04,  3.79it/s]
 28%|██▊       | 721/2560 [03:44<08:09,  3.76it/s]
 28%|██▊       | 722/2560 [03:44<08:14,  3.72it/s]
                                                  

 28%|██▊       | 722/2560 [03:44<08:14,  3.72it/s]
 28%|██▊       | 723/2560 [03:45<08:16,  3.70it/s]
 28%|██▊       | 724/2560 [03:45<08:16,  3.70it/s]
                                                  

 28%|██▊       | 724/2560 [03:45<08:16,  3.70it/s]
 28%|██▊       | 725/2560 [03:45<08:20,  3.66it/s]
 28%|██▊       | 726/2560 [03:45<08:24,  3.64it/s]
                                                  
{'loss': '0.02188', 'grad_norm': '0.4894', 'learning_rate': '0.0001857', 'epoch': '8.567'}
{'loss': '0.002214', 'grad_norm': '0.06205', 'learning_rate': '0.0001856', 'epoch': '8.598'}
{'loss': '0.01275', 'grad_norm': '0.04988', 'learning_rate': '0.0001854', 'epoch': '8.63'}
{'loss': '0.01971', 'grad_norm': '0.143', 'learning_rate': '0.0001853', 'epoch': '8.661'}
{'loss': '0.03477', 'grad_norm': '0.3581', 'learning_rate': '0.0001852', 'epoch': '8.693'}
{'loss': '0.004974', 'grad_norm': '0.1491', 'learning_rate': '0.000185', 'epoch': '8.724'}
{'loss': '0.02372', 'grad_norm': '0.395', 'learning_rate': '0.0001849', 'epoch': '8.756'}
{'loss': '0.002481', 'grad_norm': '0.06303', 'learning_rate': '0.0001848', 'epoch': '8.787'}
{'loss': '0.002963', 'grad_norm': '0.3319', 'learning_rate': '0.0001846', 'epoch': '8.819'}
{'loss': '0.01734', 'grad_norm': '0.5462', 'learning_rate': '0.0001845', 'epoch': '8.85'}
{'loss': '0.02691', 'grad_norm': '0.3988', 'learning_rate': '0.0001843', 'epoch': '8.882'}
{'loss': '0.01192', 'grad_norm': '0.05937', 'learning_rate': '0.0001842', 'epoch': '8.913'}
{'loss': '0.0118', 'grad_norm': '0.2473', 'learning_rate': '0.0001841', 'epoch': '8.945'}
{'loss': '0.009529', 'grad_norm': '0.09334', 'learning_rate': '0.0001839', 'epoch': '8.976'}
{'loss': '0.002439', 'grad_norm': '0.2139', 'learning_rate': '0.0001838', 'epoch': '9'}
{'loss': '0.002053', 'grad_norm': '0.08316', 'learning_rate': '0.0001836', 'epoch': '9.031'}
{'loss': '0.003562', 'grad_norm': '0.09788', 'learning_rate': '0.0001835', 'epoch': '9.063'}
{'loss': '0.002322', 'grad_norm': '0.1284', 'learning_rate': '0.0001834', 'epoch': '9.094'}
{'loss': '0.01304', 'grad_norm': '0.2535', 'learning_rate': '0.0001832', 'epoch': '9.126'}
{'loss': '0.02206', 'grad_norm': '0.3061', 'learning_rate': '0.0001831', 'epoch': '9.157'}
{'loss': '0.009542', 'grad_norm': '0.2241', 'learning_rate': '0.0001829', 'epoch': '9.189'}
{'loss': '0.02938', 'grad_norm': '0.03987', 'learning_rate': '0.0001828', 'epoch': '9.22'}
{'loss': '0.004323', 'grad_norm': '0.1927', 'learning_rate': '0.0001826', 'epoch': '9.252'}
{'loss': '0.01092', 'grad_norm': '0.6086', 'learning_rate': '0.0001825', 'epoch': '9.283'}
{'loss': '0.008472', 'grad_norm': '0.4005', 'learning_rate': '0.0001823', 'epoch': '9.315'}
{'loss': '0.01379', 'grad_norm': '0.4234', 'learning_rate': '0.0001822', 'epoch': '9.346'}
{'loss': '0.01468', 'grad_norm': '0.4214', 'learning_rate': '0.0001821', 'epoch': '9.378'}
{'loss': '0.01448', 'grad_norm': '0.5638', 'learning_rate': '0.0001819', 'epoch': '9.409'}
{'loss': '0.005433', 'grad_norm': '0.0955', 'learning_rate': '0.0001818', 'epoch': '9.441'}
{'loss': '0.007644', 'grad_norm': '0.3392', 'learning_rate': '0.0001816', 'epoch': '9.472'}
{'loss': '0.01358', 'grad_norm': '0.4119', 'learning_rate': '0.0001815', 'epoch': '9.504'}
{'loss': '0.008693', 'grad_norm': '0.297', 'learning_rate': '0.0001813', 'epoch': '9.535'}
{'loss': '0.002312', 'grad_norm': '0.04556', 'learning_rate': '0.0001812', 'epoch': '9.567'}
{'loss': '0.01621', 'grad_norm': '0.3451', 'learning_rate': '0.000181', 'epoch': '9.598'}
{'loss': '0.01602', 'grad_norm': '0.4615', 'learning_rate': '0.0001809', 'epoch': '9.63'}
{'loss': '0.009809', 'grad_norm': '0.3111', 'learning_rate': '0.0001807', 'epoch': '9.661'}
{'loss': '0.002182', 'grad_norm': '0.03887', 'learning_rate': '0.0001806', 'epoch': '9.693'}
{'loss': '0.02772', 'grad_norm': '0.5383', 'learning_rate': '0.0001804', 'epoch': '9.724'}
{'loss': '0.00577', 'grad_norm': '0.07968', 'learning_rate': '0.0001802', 'epoch': '9.756'}
{'loss': '0.008422', 'grad_norm': '0.3285', 'learning_rate': '0.0001801', 'epoch': '9.787'}
{'loss': '0.012', 'grad_norm': '0.3592', 'learning_rate': '0.0001799', 'epoch': '9.819'}
{'loss': '0.002569', 'grad_norm': '0.1463', 'learning_rate': '0.0001798', 'epoch': '9.85'}
{'loss': '0.0124', 'grad_norm': '0.04958', 'learning_rate': '0.0001796', 'epoch': '9.882'}
{'loss': '0.002248', 'grad_norm': '0.05543', 'learning_rate': '0.0001795', 'epoch': '9.913'}
{'loss': '0.002069', 'grad_norm': '0.0723', 'learning_rate': '0.0001793', 'epoch': '9.945'}
{'loss': '0.0385', 'grad_norm': '0.1298', 'learning_rate': '0.0001792', 'epoch': '9.976'}
{'loss': '0.02115', 'grad_norm': '0.6872', 'learning_rate': '0.000179', 'epoch': '10'}
{'loss': '0.002173', 'grad_norm': '0.05652', 'learning_rate': '0.0001788', 'epoch': '10.03'}
{'loss': '0.003673', 'grad_norm': '0.2487', 'learning_rate': '0.0001787', 'epoch': '10.06'}
{'loss': '0.005357', 'grad_norm': '0.295', 'learning_rate': '0.0001785', 'epoch': '10.09'}
{'loss': '0.005322', 'grad_norm': '0.2647', 'learning_rate': '0.0001784', 'epoch': '10.13'}
{'loss': '0.009488', 'grad_norm': '0.0889', 'learning_rate': '0.0001782', 'epoch': '10.16'}
{'loss': '0.01235', 'grad_norm': '0.4321', 'learning_rate': '0.000178', 'epoch': '10.19'}
{'loss': '0.003075', 'grad_norm': '0.2544', 'learning_rate': '0.0001779', 'epoch': '10.22'}
{'loss': '0.005115', 'grad_norm': '0.1103', 'learning_rate': '0.0001777', 'epoch': '10.25'}
{'loss': '0.009998', 'grad_norm': '0.2483', 'learning_rate': '0.0001775', 'epoch': '10.28'}
{'loss': '0.01056', 'grad_norm': '0.2111', 'learning_rate': '0.0001774', 'epoch': '10.31'}
{'loss': '0.01215', 'grad_norm': '0.0529', 'learning_rate': '0.0001772', 'epoch': '10.35'}
{'loss': '0.00785', 'grad_norm': '0.05698', 'learning_rate': '0.0001771', 'epoch': '10.38'}
{'loss': '0.001673', 'grad_norm': '0.06628', 'learning_rate': '0.0001769', 'epoch': '10.41'}
{'loss': '0.009974', 'grad_norm': '0.3308', 'learning_rate': '0.0001767', 'epoch': '10.44'}
{'loss': '0.004176', 'grad_norm': '0.114', 'learning_rate': '0.0001766', 'epoch': '10.47'}
{'loss': '0.004506', 'grad_norm': '0.2244', 'learning_rate': '0.0001764', 'epoch': '10.5'}
{'loss': '0.01143', 'grad_norm': '0.2912', 'learning_rate': '0.0001762', 'epoch': '10.54'}
{'loss': '0.01103', 'grad_norm': '0.4005', 'learning_rate': '0.0001761', 'epoch': '10.57'}
{'loss': '0.004024', 'grad_norm': '0.2533', 'learning_rate': '0.0001759', 'epoch': '10.6'}
{'loss': '0.01997', 'grad_norm': '0.5153', 'learning_rate': '0.0001757', 'epoch': '10.63'}
{'loss': '0.0189', 'grad_norm': '0.336', 'learning_rate': '0.0001756', 'epoch': '10.66'}
{'loss': '0.002828', 'grad_norm': '0.1348', 'learning_rate': '0.0001754', 'epoch': '10.69'}
{'loss': '0.004129', 'grad_norm': '0.1336', 'learning_rate': '0.0001752', 'epoch': '10.72'}
{'loss': '0.01945', 'grad_norm': '0.6313', 'learning_rate': '0.000175', 'epoch': '10.76'}
{'loss': '0.01713', 'grad_norm': '0.3918', 'learning_rate': '0.0001749', 'epoch': '10.79'}
{'loss': '0.02051', 'grad_norm': '0.4267', 'learning_rate': '0.0001747', 'epoch': '10.82'}
{'loss': '0.008202', 'grad_norm': '0.4512', 'learning_rate': '0.0001745', 'epoch': '10.85'}
{'loss': '0.02753', 'grad_norm': '0.618', 'learning_rate': '0.0001744', 'epoch': '10.88'}
{'loss': '0.005082', 'grad_norm': '0.1488', 'learning_rate': '0.0001742', 'epoch': '10.91'}
{'loss': '0.007563', 'grad_norm': '0.1049', 'learning_rate': '0.000174', 'epoch': '10.94'}
{'loss': '0.002373', 'grad_norm': '0.08763', 'learning_rate': '0.0001738', 'epoch': '10.98'}
{'loss': '0.01649', 'grad_norm': '0.7143', 'learning_rate': '0.0001737', 'epoch': '11'}
{'loss': '0.006293', 'grad_norm': '0.4058', 'learning_rate': '0.0001735', 'epoch': '11.03'}
{'loss': '0.006499', 'grad_norm': '0.3574', 'learning_rate': '0.0001733', 'epoch': '11.06'}
{'loss': '0.006408', 'grad_norm': '0.371', 'learning_rate': '0.0001731', 'epoch': '11.09'}
{'loss': '0.00986', 'grad_norm': '0.3028', 'learning_rate': '0.000173', 'epoch': '11.13'}
{'loss': '0.0162', 'grad_norm': '0.07007', 'learning_rate': '0.0001728', 'epoch': '11.16'}
{'loss': '0.01143', 'grad_norm': '0.04806', 'learning_rate': '0.0001726', 'epoch': '11.19'}
{'loss': '0.002107', 'grad_norm': '0.1121', 'learning_rate': '0.0001724', 'epoch': '11.22'}
{'loss': '0.01791', 'grad_norm': '0.4567', 'learning_rate': '0.0001722', 'epoch': '11.25'}
{'loss': '0.01281', 'grad_norm': '0.07928', 'learning_rate': '0.0001721', 'epoch': '11.28'}
{'loss': '0.001885', 'grad_norm': '0.04255', 'learning_rate': '0.0001719', 'epoch': '11.31'}
{'loss': '0.005895', 'grad_norm': '0.07884', 'learning_rate': '0.0001717', 'epoch': '11.35'}
 28%|██▊       | 726/2560 [03:45<08:24,  3.64it/s]
 28%|██▊       | 727/2560 [03:46<08:29,  3.60it/s]
 28%|██▊       | 728/2560 [03:46<08:23,  3.64it/s]
                                                  

 28%|██▊       | 728/2560 [03:46<08:23,  3.64it/s]
 28%|██▊       | 729/2560 [03:46<08:14,  3.70it/s]
 29%|██▊       | 730/2560 [03:46<08:09,  3.73it/s]
                                                  

 29%|██▊       | 730/2560 [03:46<08:09,  3.73it/s]
 29%|██▊       | 731/2560 [03:47<08:06,  3.76it/s]
 29%|██▊       | 732/2560 [03:47<08:03,  3.78it/s]
                                                  

 29%|██▊       | 732/2560 [03:47<08:03,  3.78it/s]
 29%|██▊       | 733/2560 [03:47<08:02,  3.79it/s]
 29%|██▊       | 734/2560 [03:47<08:12,  3.71it/s]
                                                  

 29%|██▊       | 734/2560 [03:47<08:12,  3.71it/s]
 29%|██▊       | 735/2560 [03:48<08:21,  3.64it/s]
 29%|██▉       | 736/2560 [03:48<08:20,  3.64it/s]
                                                  

 29%|██▉       | 736/2560 [03:48<08:20,  3.64it/s]
 29%|██▉       | 737/2560 [03:48<08:14,  3.69it/s]
 29%|██▉       | 738/2560 [03:49<08:12,  3.70it/s]
                                                  

 29%|██▉       | 738/2560 [03:49<08:12,  3.70it/s]
 29%|██▉       | 739/2560 [03:49<08:15,  3.68it/s]
 29%|██▉       | 740/2560 [03:49<08:12,  3.70it/s]
                                                  

 29%|██▉       | 740/2560 [03:49<08:12,  3.70it/s]
 29%|██▉       | 741/2560 [03:49<08:08,  3.73it/s]
 29%|██▉       | 742/2560 [03:50<08:04,  3.75it/s]
                                                  

 29%|██▉       | 742/2560 [03:50<08:04,  3.75it/s]
 29%|██▉       | 743/2560 [03:50<08:02,  3.77it/s]
 29%|██▉       | 744/2560 [03:50<07:59,  3.79it/s]
                                                  

 29%|██▉       | 744/2560 [03:50<07:59,  3.79it/s]
 29%|██▉       | 745/2560 [03:50<07:59,  3.79it/s]
 29%|██▉       | 746/2560 [03:51<07:57,  3.80it/s]
                                                  

 29%|██▉       | 746/2560 [03:51<07:57,  3.80it/s]
 29%|██▉       | 747/2560 [03:51<07:55,  3.81it/s]
 29%|██▉       | 748/2560 [03:51<07:55,  3.81it/s]
                                                  

 29%|██▉       | 748/2560 [03:51<07:55,  3.81it/s]
 29%|██▉       | 749/2560 [03:51<07:55,  3.81it/s]
 29%|██▉       | 750/2560 [03:52<08:01,  3.76it/s]
                                                  

 29%|██▉       | 750/2560 [03:52<08:01,  3.76it/s]
 29%|██▉       | 751/2560 [03:52<08:33,  3.52it/s]
 29%|██▉       | 752/2560 [03:52<08:27,  3.57it/s]
                                                  

 29%|██▉       | 752/2560 [03:52<08:27,  3.57it/s]
 29%|██▉       | 753/2560 [03:53<08:20,  3.61it/s]
 29%|██▉       | 754/2560 [03:53<08:13,  3.66it/s]
                                                  

 29%|██▉       | 754/2560 [03:53<08:13,  3.66it/s]
 29%|██▉       | 755/2560 [03:53<08:09,  3.69it/s]
 30%|██▉       | 756/2560 [03:53<08:06,  3.71it/s]
                                                  

 30%|██▉       | 756/2560 [03:53<08:06,  3.71it/s]
 30%|██▉       | 757/2560 [03:54<08:03,  3.73it/s]
 30%|██▉       | 758/2560 [03:54<08:00,  3.75it/s]
                                                  

 30%|██▉       | 758/2560 [03:54<08:00,  3.75it/s]
 30%|██▉       | 759/2560 [03:54<07:59,  3.76it/s]
 30%|██▉       | 760/2560 [03:54<08:01,  3.74it/s]
                                                  

 30%|██▉       | 760/2560 [03:54<08:01,  3.74it/s]
 30%|██▉       | 761/2560 [03:55<07:59,  3.75it/s]
 30%|██▉       | 762/2560 [03:55<08:00,  3.75it/s]
                                                  

 30%|██▉       | 762/2560 [03:55<08:00,  3.75it/s]
 30%|██▉       | 763/2560 [03:55<07:57,  3.76it/s]
 30%|██▉       | 764/2560 [03:56<07:56,  3.77it/s]
                                                  

 30%|██▉       | 764/2560 [03:56<07:56,  3.77it/s]
 30%|██▉       | 765/2560 [03:56<07:56,  3.76it/s]
 30%|██▉       | 766/2560 [03:56<07:56,  3.76it/s]
                                                  

 30%|██▉       | 766/2560 [03:56<07:56,  3.76it/s]
 30%|██▉       | 767/2560 [03:56<07:56,  3.77it/s]
 30%|███       | 768/2560 [03:56<06:42,  4.45it/s]
                                                  

 30%|███       | 768/2560 [03:56<06:42,  4.45it/s]
 30%|███       | 769/2560 [03:57<07:03,  4.23it/s]
 30%|███       | 770/2560 [03:57<07:16,  4.10it/s]
                                                  

 30%|███       | 770/2560 [03:57<07:16,  4.10it/s]
 30%|███       | 771/2560 [03:57<07:27,  3.99it/s]
 30%|███       | 772/2560 [03:58<07:34,  3.93it/s]
                                                  

 30%|███       | 772/2560 [03:58<07:34,  3.93it/s]
 30%|███       | 773/2560 [03:58<07:41,  3.87it/s]
 30%|███       | 774/2560 [03:58<07:42,  3.86it/s]
                                                  

 30%|███       | 774/2560 [03:58<07:42,  3.86it/s]
 30%|███       | 775/2560 [03:58<07:44,  3.84it/s]
 30%|███       | 776/2560 [03:59<07:44,  3.84it/s]
                                                  

 30%|███       | 776/2560 [03:59<07:44,  3.84it/s]
 30%|███       | 777/2560 [03:59<07:46,  3.82it/s]
 30%|███       | 778/2560 [03:59<07:47,  3.81it/s]
                                                  

 30%|███       | 778/2560 [03:59<07:47,  3.81it/s]
 30%|███       | 779/2560 [03:59<07:48,  3.80it/s]
 30%|███       | 780/2560 [04:00<07:53,  3.76it/s]
                                                  

 30%|███       | 780/2560 [04:00<07:53,  3.76it/s]
 31%|███       | 781/2560 [04:00<07:55,  3.74it/s]
 31%|███       | 782/2560 [04:00<07:56,  3.73it/s]
                                                  

 31%|███       | 782/2560 [04:00<07:56,  3.73it/s]
 31%|███       | 783/2560 [04:00<07:59,  3.71it/s]
 31%|███       | 784/2560 [04:01<07:56,  3.73it/s]
                                                  

 31%|███       | 784/2560 [04:01<07:56,  3.73it/s]
 31%|███       | 785/2560 [04:01<07:57,  3.71it/s]
 31%|███       | 786/2560 [04:01<08:01,  3.69it/s]
                                                  

 31%|███       | 786/2560 [04:01<08:01,  3.69it/s]
 31%|███       | 787/2560 [04:02<08:00,  3.69it/s]
 31%|███       | 788/2560 [04:02<07:58,  3.70it/s]
                                                  

 31%|███       | 788/2560 [04:02<07:58,  3.70it/s]
 31%|███       | 789/2560 [04:02<07:57,  3.71it/s]
 31%|███       | 790/2560 [04:02<07:54,  3.73it/s]
                                                  

 31%|███       | 790/2560 [04:02<07:54,  3.73it/s]
 31%|███       | 791/2560 [04:03<07:49,  3.77it/s]
 31%|███       | 792/2560 [04:03<07:49,  3.76it/s]
                                                  

 31%|███       | 792/2560 [04:03<07:49,  3.76it/s]
 31%|███       | 793/2560 [04:03<07:48,  3.77it/s]
 31%|███       | 794/2560 [04:03<07:47,  3.78it/s]
                                                  

 31%|███       | 794/2560 [04:03<07:47,  3.78it/s]
 31%|███       | 795/2560 [04:04<07:48,  3.77it/s]
 31%|███       | 796/2560 [04:04<07:53,  3.73it/s]
                                                  

 31%|███       | 796/2560 [04:04<07:53,  3.73it/s]
 31%|███       | 797/2560 [04:04<07:54,  3.71it/s]
 31%|███       | 798/2560 [04:04<07:58,  3.68it/s]
                                                  

 31%|███       | 798/2560 [04:04<07:58,  3.68it/s]
 31%|███       | 799/2560 [04:05<07:58,  3.68it/s]
 31%|███▏      | 800/2560 [04:05<07:59,  3.67it/s]
                                                  

 31%|███▏      | 800/2560 [04:05<07:59,  3.67it/s]
 31%|███▏      | 801/2560 [04:05<07:57,  3.68it/s]
 31%|███▏      | 802/2560 [04:06<07:55,  3.70it/s]
                                                  

 31%|███▏      | 802/2560 [04:06<07:55,  3.70it/s]
 31%|███▏      | 803/2560 [04:06<07:58,  3.67it/s]
 31%|███▏      | 804/2560 [04:06<07:56,  3.68it/s]
                                                  

 31%|███▏      | 804/2560 [04:06<07:56,  3.68it/s]
 31%|███▏      | 805/2560 [04:06<07:55,  3.69it/s]
 31%|███▏      | 806/2560 [04:07<07:48,  3.74it/s]
                                                  

 31%|███▏      | 806/2560 [04:07<07:48,  3.74it/s]
 32%|███▏      | 807/2560 [04:07<07:49,  3.73it/s]
 32%|███▏      | 808/2560 [04:07<07:52,  3.71it/s]
                                                  

 32%|███▏      | 808/2560 [04:07<07:52,  3.71it/s]
 32%|███▏      | 809/2560 [04:07<07:56,  3.68it/s]
 32%|███▏      | 810/2560 [04:08<07:52,  3.70it/s]
                                                  

 32%|███▏      | 810/2560 [04:08<07:52,  3.70it/s]
 32%|███▏      | 811/2560 [04:08<07:48,  3.73it/s]
 32%|███▏      | 812/2560 [04:08<07:43,  3.77it/s]
                                                  

 32%|███▏      | 812/2560 [04:08<07:43,  3.77it/s]
 32%|███▏      | 813/2560 [04:09<07:40,  3.79it/s]
 32%|███▏      | 814/2560 [04:09<07:38,  3.81it/s]
                                                  

 32%|███▏      | 814/2560 [04:09<07:38,  3.81it/s]
 32%|███▏      | 815/2560 [04:09<07:36,  3.82it/s]
 32%|███▏      | 816/2560 [04:09<07:35,  3.83it/s]
                                                  

 32%|███▏      | 816/2560 [04:09<07:35,  3.83it/s]
 32%|███▏      | 817/2560 [04:10<07:34,  3.83it/s]
 32%|███▏      | 818/2560 [04:10<07:34,  3.83it/s]
                                                  

 32%|███▏      | 818/2560 [04:10<07:34,  3.83it/s]
 32%|███▏      | 819/2560 [04:10<07:38,  3.80it/s]
 32%|███▏      | 820/2560 [04:10<07:38,  3.80it/s]
                                                  

 32%|███▏      | 820/2560 [04:10<07:38,  3.80it/s]
 32%|███▏      | 821/2560 [04:11<07:39,  3.78it/s]
 32%|███▏      | 822/2560 [04:11<07:43,  3.75it/s]
                                                  

 32%|███▏      | 822/2560 [04:11<07:43,  3.75it/s]
 32%|███▏      | 823/2560 [04:11<07:47,  3.72it/s]
 32%|███▏      | 824/2560 [04:11<07:48,  3.71it/s]
                                                  

 32%|███▏      | 824/2560 [04:11<07:48,  3.71it/s]
 32%|███▏      | 825/2560 [04:12<07:54,  3.66it/s]
 32%|███▏      | 826/2560 [04:12<07:53,  3.66it/s]
                                                  

 32%|███▏      | 826/2560 [04:12<07:53,  3.66it/s]
 32%|███▏      | 827/2560 [04:12<07:54,  3.65it/s]
 32%|███▏      | 828/2560 [04:13<07:52,  3.66it/s]
                                                  

 32%|███▏      | 828/2560 [04:13<07:52,  3.66it/s]
 32%|███▏      | 829/2560 [04:13<07:48,  3.70it/s]
 32%|███▏      | 830/2560 [04:13<07:49,  3.68it/s]
                                                  

 32%|███▏      | 830/2560 [04:13<07:49,  3.68it/s]
 32%|███▏      | 831/2560 [04:13<07:48,  3.69it/s]
 32%|███▎      | 832/2560 [04:13<06:35,  4.37it/s]
                                                  

 32%|███▎      | 832/2560 [04:13<06:35,  4.37it/s]
 33%|███▎      | 833/2560 [04:14<06:58,  4.13it/s]
 33%|███▎      | 834/2560 [04:14<07:17,  3.95it/s]
                                                  

 33%|███▎      | 834/2560 [04:14<07:17,  3.95it/s]
 33%|███▎      | 835/2560 [04:14<07:25,  3.87it/s]
 33%|███▎      | 836/2560 [04:15<07:36,  3.78it/s]
                                                  

 33%|███▎      | 836/2560 [04:15<07:36,  3.78it/s]
 33%|███▎      | 837/2560 [04:15<07:43,  3.71it/s]
 33%|███▎      | 838/2560 [04:15<07:49,  3.67it/s]
                                                  

 33%|███▎      | 838/2560 [04:15<07:49,  3.67it/s]
 33%|███▎      | 839/2560 [04:15<07:54,  3.63it/s]
 33%|███▎      | 840/2560 [04:16<07:51,  3.65it/s]
                                                  

 33%|███▎      | 840/2560 [04:16<07:51,  3.65it/s]
 33%|███▎      | 841/2560 [04:16<07:53,  3.63it/s]
 33%|███▎      | 842/2560 [04:16<07:52,  3.63it/s]
                                                  

 33%|███▎      | 842/2560 [04:16<07:52,  3.63it/s]
 33%|███▎      | 843/2560 [04:17<07:54,  3.62it/s]
 33%|███▎      | 844/2560 [04:17<07:53,  3.63it/s]
                                                  

 33%|███▎      | 844/2560 [04:17<07:53,  3.63it/s]
 33%|███▎      | 845/2560 [04:17<07:51,  3.64it/s]
 33%|███▎      | 846/2560 [04:17<07:49,  3.65it/s]
                                                  

 33%|███▎      | 846/2560 [04:17<07:49,  3.65it/s]
 33%|███▎      | 847/2560 [04:18<07:56,  3.60it/s]
 33%|███▎      | 848/2560 [04:18<07:52,  3.62it/s]
                                                  

 33%|███▎      | 848/2560 [04:18<07:52,  3.62it/s]
 33%|███▎      | 849/2560 [04:18<07:58,  3.58it/s]
 33%|███▎      | 850/2560 [04:18<08:02,  3.55it/s]
                                                  

 33%|███▎      | 850/2560 [04:18<08:02,  3.55it/s]
 33%|███▎      | 851/2560 [04:19<08:11,  3.48it/s]
 33%|███▎      | 852/2560 [04:19<08:05,  3.52it/s]
                                                  

 33%|███▎      | 852/2560 [04:19<08:05,  3.52it/s]
 33%|███▎      | 853/2560 [04:19<08:05,  3.52it/s]
 33%|███▎      | 854/2560 [04:20<08:11,  3.47it/s]
                                                  

 33%|███▎      | 854/2560 [04:20<08:11,  3.47it/s]
 33%|███▎      | 855/2560 [04:20<08:11,  3.47it/s]
 33%|███▎      | 856/2560 [04:20<08:12,  3.46it/s]
                                                  

 33%|███▎      | 856/2560 [04:20<08:12,  3.46it/s]
 33%|███▎      | 857/2560 [04:20<08:09,  3.48it/s]
 34%|███▎      | 858/2560 [04:21<08:10,  3.47it/s]
                                                  

 34%|███▎      | 858/2560 [04:21<08:10,  3.47it/s]
 34%|███▎      | 859/2560 [04:21<08:10,  3.47it/s]
 34%|███▎      | 860/2560 [04:21<08:06,  3.50it/s]
                                                  

 34%|███▎      | 860/2560 [04:21<08:06,  3.50it/s]
 34%|███▎      | 861/2560 [04:22<08:01,  3.53it/s]
 34%|███▎      | 862/2560 [04:22<08:05,  3.49it/s]
                                                  

 34%|███▎      | 862/2560 [04:22<08:05,  3.49it/s]
 34%|███▎      | 863/2560 [04:22<08:01,  3.52it/s]
 34%|███▍      | 864/2560 [04:22<08:05,  3.50it/s]
                                                  

 34%|███▍      | 864/2560 [04:22<08:05,  3.50it/s]
 34%|███▍      | 865/2560 [04:23<07:59,  3.54it/s]
 34%|███▍      | 866/2560 [04:23<07:50,  3.60it/s]
                                                  

 34%|███▍      | 866/2560 [04:23<07:50,  3.60it/s]
 34%|███▍      | 867/2560 [04:23<07:46,  3.63it/s]
 34%|███▍      | 868/2560 [04:24<07:42,  3.66it/s]
                                                  

 34%|███▍      | 868/2560 [04:24<07:42,  3.66it/s]
 34%|███▍      | 869/2560 [04:24<07:37,  3.70it/s]
 34%|███▍      | 870/2560 [04:24<07:30,  3.75it/s]
                                                  

 34%|███▍      | 870/2560 [04:24<07:30,  3.75it/s]
 34%|███▍      | 871/2560 [04:24<07:28,  3.77it/s]
 34%|███▍      | 872/2560 [04:25<07:27,  3.77it/s]
                                                  

 34%|███▍      | 872/2560 [04:25<07:27,  3.77it/s]
 34%|███▍      | 873/2560 [04:25<07:25,  3.79it/s]
 34%|███▍      | 874/2560 [04:25<07:22,  3.81it/s]
                                                  

 34%|███▍      | 874/2560 [04:25<07:22,  3.81it/s]
 34%|███▍      | 875/2560 [04:25<07:21,  3.81it/s]
 34%|███▍      | 876/2560 [04:26<07:19,  3.83it/s]
                                                  

 34%|███▍      | 876/2560 [04:26<07:19,  3.83it/s]
 34%|███▍      | 877/2560 [04:26<07:21,  3.81it/s]
 34%|███▍      | 878/2560 [04:26<07:23,  3.79it/s]
                                                  

 34%|███▍      | 878/2560 [04:26<07:23,  3.79it/s]
 34%|███▍      | 879/2560 [04:26<07:31,  3.73it/s]
 34%|███▍      | 880/2560 [04:27<07:32,  3.71it/s]
                                                  

 34%|███▍      | 880/2560 [04:27<07:32,  3.71it/s]
 34%|███▍      | 881/2560 [04:27<07:31,  3.72it/s]
 34%|███▍      | 882/2560 [04:27<07:31,  3.71it/s]
                                                  

 34%|███▍      | 882/2560 [04:27<07:31,  3.71it/s]
 34%|███▍      | 883/2560 [04:28<07:35,  3.68it/s]
 35%|███▍      | 884/2560 [04:28<07:35,  3.68it/s]
                                                  

 35%|███▍      | 884/2560 [04:28<07:35,  3.68it/s]
 35%|███▍      | 885/2560 [04:28<07:36,  3.67it/s]
 35%|███▍      | 886/2560 [04:28<07:36,  3.67it/s]
                                                  

 35%|███▍      | 886/2560 [04:28<07:36,  3.67it/s]
 35%|███▍      | 887/2560 [04:29<07:34,  3.68it/s]
 35%|███▍      | 888/2560 [04:29<07:33,  3.68it/s]
                                                  

 35%|███▍      | 888/2560 [04:29<07:33,  3.68it/s]
 35%|███▍      | 889/2560 [04:29<07:35,  3.67it/s]
 35%|███▍      | 890/2560 [04:29<07:37,  3.65it/s]
                                                  

 35%|███▍      | 890/2560 [04:29<07:37,  3.65it/s]
 35%|███▍      | 891/2560 [04:30<07:36,  3.66it/s]
 35%|███▍      | 892/2560 [04:30<07:30,  3.70it/s]
                                                  

 35%|███▍      | 892/2560 [04:30<07:30,  3.70it/s]
 35%|███▍      | 893/2560 [04:30<07:30,  3.70it/s]
 35%|███▍      | 894/2560 [04:31<07:32,  3.68it/s]
                                                  

 35%|███▍      | 894/2560 [04:31<07:32,  3.68it/s]
 35%|███▍      | 895/2560 [04:31<07:35,  3.66it/s]
 35%|███▌      | 896/2560 [04:31<06:23,  4.34it/s]
                                                  

 35%|███▌      | 896/2560 [04:31<06:23,  4.34it/s]
 35%|███▌      | 897/2560 [04:31<06:47,  4.08it/s]
 35%|███▌      | 898/2560 [04:32<07:02,  3.94it/s]
                                                  

 35%|███▌      | 898/2560 [04:32<07:02,  3.94it/s]
 35%|███▌      | 899/2560 [04:32<07:09,  3.87it/s]
 35%|███▌      | 900/2560 [04:32<07:19,  3.78it/s]
                                                  

 35%|███▌      | 900/2560 [04:32<07:19,  3.78it/s]
 35%|███▌      | 901/2560 [04:32<07:22,  3.75it/s]
 35%|███▌      | 902/2560 [04:33<07:26,  3.71it/s]
                                                  

 35%|███▌      | 902/2560 [04:33<07:26,  3.71it/s]
 35%|███▌      | 903/2560 [04:33<07:22,  3.74it/s]
 35%|███▌      | 904/2560 [04:33<07:18,  3.78it/s]
                                                  

 35%|███▌      | 904/2560 [04:33<07:18,  3.78it/s]
 35%|███▌      | 905/2560 [04:33<07:17,  3.78it/s]
 35%|███▌      | 906/2560 [04:34<07:18,  3.77it/s]
                                                  
{'loss': '0.00499', 'grad_norm': '0.3472', 'learning_rate': '0.0001715', 'epoch': '11.38'}
{'loss': '0.002479', 'grad_norm': '0.06532', 'learning_rate': '0.0001713', 'epoch': '11.41'}
{'loss': '0.008058', 'grad_norm': '0.2059', 'learning_rate': '0.0001712', 'epoch': '11.44'}
{'loss': '0.009145', 'grad_norm': '0.3633', 'learning_rate': '0.000171', 'epoch': '11.47'}
{'loss': '0.004979', 'grad_norm': '0.07525', 'learning_rate': '0.0001708', 'epoch': '11.5'}
{'loss': '0.02029', 'grad_norm': '0.4537', 'learning_rate': '0.0001706', 'epoch': '11.54'}
{'loss': '0.002405', 'grad_norm': '0.1246', 'learning_rate': '0.0001704', 'epoch': '11.57'}
{'loss': '0.002006', 'grad_norm': '0.06814', 'learning_rate': '0.0001703', 'epoch': '11.6'}
{'loss': '0.003734', 'grad_norm': '0.05898', 'learning_rate': '0.0001701', 'epoch': '11.63'}
{'loss': '0.01176', 'grad_norm': '0.1387', 'learning_rate': '0.0001699', 'epoch': '11.66'}
{'loss': '0.003753', 'grad_norm': '0.298', 'learning_rate': '0.0001697', 'epoch': '11.69'}
{'loss': '0.004873', 'grad_norm': '0.04002', 'learning_rate': '0.0001695', 'epoch': '11.72'}
{'loss': '0.002916', 'grad_norm': '0.1081', 'learning_rate': '0.0001693', 'epoch': '11.76'}
{'loss': '0.002077', 'grad_norm': '0.07391', 'learning_rate': '0.0001691', 'epoch': '11.79'}
{'loss': '0.01791', 'grad_norm': '0.2431', 'learning_rate': '0.000169', 'epoch': '11.82'}
{'loss': '0.01151', 'grad_norm': '0.3621', 'learning_rate': '0.0001688', 'epoch': '11.85'}
{'loss': '0.004323', 'grad_norm': '0.07282', 'learning_rate': '0.0001686', 'epoch': '11.88'}
{'loss': '0.005278', 'grad_norm': '0.2985', 'learning_rate': '0.0001684', 'epoch': '11.91'}
{'loss': '0.00487', 'grad_norm': '0.03578', 'learning_rate': '0.0001682', 'epoch': '11.94'}
{'loss': '0.008507', 'grad_norm': '0.3787', 'learning_rate': '0.000168', 'epoch': '11.98'}
{'loss': '0.01668', 'grad_norm': '0.6442', 'learning_rate': '0.0001678', 'epoch': '12'}
{'loss': '0.002266', 'grad_norm': '0.08676', 'learning_rate': '0.0001676', 'epoch': '12.03'}
{'loss': '0.004098', 'grad_norm': '0.2072', 'learning_rate': '0.0001674', 'epoch': '12.06'}
{'loss': '0.004437', 'grad_norm': '0.3267', 'learning_rate': '0.0001673', 'epoch': '12.09'}
{'loss': '0.001512', 'grad_norm': '0.03111', 'learning_rate': '0.0001671', 'epoch': '12.13'}
{'loss': '0.002312', 'grad_norm': '0.1116', 'learning_rate': '0.0001669', 'epoch': '12.16'}
{'loss': '0.003117', 'grad_norm': '0.1011', 'learning_rate': '0.0001667', 'epoch': '12.19'}
{'loss': '0.00764', 'grad_norm': '0.3136', 'learning_rate': '0.0001665', 'epoch': '12.22'}
{'loss': '0.01322', 'grad_norm': '0.3986', 'learning_rate': '0.0001663', 'epoch': '12.25'}
{'loss': '0.02089', 'grad_norm': '0.3204', 'learning_rate': '0.0001661', 'epoch': '12.28'}
{'loss': '0.003273', 'grad_norm': '0.1345', 'learning_rate': '0.0001659', 'epoch': '12.31'}
{'loss': '0.001449', 'grad_norm': '0.05294', 'learning_rate': '0.0001657', 'epoch': '12.35'}
{'loss': '0.009593', 'grad_norm': '0.3802', 'learning_rate': '0.0001655', 'epoch': '12.38'}
{'loss': '0.002309', 'grad_norm': '0.02818', 'learning_rate': '0.0001653', 'epoch': '12.41'}
{'loss': '0.007677', 'grad_norm': '0.3466', 'learning_rate': '0.0001651', 'epoch': '12.44'}
{'loss': '0.004405', 'grad_norm': '0.04401', 'learning_rate': '0.0001649', 'epoch': '12.47'}
{'loss': '0.001839', 'grad_norm': '0.04873', 'learning_rate': '0.0001647', 'epoch': '12.5'}
{'loss': '0.007652', 'grad_norm': '0.4731', 'learning_rate': '0.0001645', 'epoch': '12.54'}
{'loss': '0.001684', 'grad_norm': '0.04241', 'learning_rate': '0.0001643', 'epoch': '12.57'}
{'loss': '0.01389', 'grad_norm': '0.3085', 'learning_rate': '0.0001641', 'epoch': '12.6'}
{'loss': '0.006891', 'grad_norm': '0.2339', 'learning_rate': '0.0001639', 'epoch': '12.63'}
{'loss': '0.001913', 'grad_norm': '0.02897', 'learning_rate': '0.0001637', 'epoch': '12.66'}
{'loss': '0.005422', 'grad_norm': '0.1915', 'learning_rate': '0.0001635', 'epoch': '12.69'}
{'loss': '0.006907', 'grad_norm': '0.1153', 'learning_rate': '0.0001633', 'epoch': '12.72'}
{'loss': '0.001823', 'grad_norm': '0.06796', 'learning_rate': '0.0001631', 'epoch': '12.76'}
{'loss': '0.002547', 'grad_norm': '0.2523', 'learning_rate': '0.0001629', 'epoch': '12.79'}
{'loss': '0.007351', 'grad_norm': '0.2024', 'learning_rate': '0.0001627', 'epoch': '12.82'}
{'loss': '0.003312', 'grad_norm': '0.1984', 'learning_rate': '0.0001625', 'epoch': '12.85'}
{'loss': '0.01083', 'grad_norm': '0.1595', 'learning_rate': '0.0001623', 'epoch': '12.88'}
{'loss': '0.006346', 'grad_norm': '0.1319', 'learning_rate': '0.0001621', 'epoch': '12.91'}
{'loss': '0.002089', 'grad_norm': '0.1144', 'learning_rate': '0.0001619', 'epoch': '12.94'}
{'loss': '0.002078', 'grad_norm': '0.09184', 'learning_rate': '0.0001617', 'epoch': '12.98'}
{'loss': '0.005154', 'grad_norm': '0.07741', 'learning_rate': '0.0001615', 'epoch': '13'}
{'loss': '0.005391', 'grad_norm': '0.1164', 'learning_rate': '0.0001613', 'epoch': '13.03'}
{'loss': '0.002547', 'grad_norm': '0.05814', 'learning_rate': '0.0001611', 'epoch': '13.06'}
{'loss': '0.001443', 'grad_norm': '0.04347', 'learning_rate': '0.0001609', 'epoch': '13.09'}
{'loss': '0.00561', 'grad_norm': '0.09037', 'learning_rate': '0.0001607', 'epoch': '13.13'}
{'loss': '0.002212', 'grad_norm': '0.1632', 'learning_rate': '0.0001605', 'epoch': '13.16'}
{'loss': '0.001637', 'grad_norm': '0.08213', 'learning_rate': '0.0001603', 'epoch': '13.19'}
{'loss': '0.01152', 'grad_norm': '0.1625', 'learning_rate': '0.0001601', 'epoch': '13.22'}
{'loss': '0.003027', 'grad_norm': '0.09024', 'learning_rate': '0.0001599', 'epoch': '13.25'}
{'loss': '0.002629', 'grad_norm': '0.02061', 'learning_rate': '0.0001597', 'epoch': '13.28'}
{'loss': '0.004094', 'grad_norm': '0.09156', 'learning_rate': '0.0001595', 'epoch': '13.31'}
{'loss': '0.006241', 'grad_norm': '0.02141', 'learning_rate': '0.0001593', 'epoch': '13.35'}
{'loss': '0.001487', 'grad_norm': '0.01987', 'learning_rate': '0.000159', 'epoch': '13.38'}
{'loss': '0.003535', 'grad_norm': '0.1064', 'learning_rate': '0.0001588', 'epoch': '13.41'}
{'loss': '0.001532', 'grad_norm': '0.0308', 'learning_rate': '0.0001586', 'epoch': '13.44'}
{'loss': '0.004541', 'grad_norm': '0.136', 'learning_rate': '0.0001584', 'epoch': '13.47'}
{'loss': '0.001991', 'grad_norm': '0.07246', 'learning_rate': '0.0001582', 'epoch': '13.5'}
{'loss': '0.00216', 'grad_norm': '0.08983', 'learning_rate': '0.000158', 'epoch': '13.54'}
{'loss': '0.001851', 'grad_norm': '0.02371', 'learning_rate': '0.0001578', 'epoch': '13.57'}
{'loss': '0.002255', 'grad_norm': '0.09093', 'learning_rate': '0.0001576', 'epoch': '13.6'}
{'loss': '0.006284', 'grad_norm': '0.03453', 'learning_rate': '0.0001574', 'epoch': '13.63'}
{'loss': '0.001368', 'grad_norm': '0.03682', 'learning_rate': '0.0001572', 'epoch': '13.66'}
{'loss': '0.003771', 'grad_norm': '0.1377', 'learning_rate': '0.0001569', 'epoch': '13.69'}
{'loss': '0.005065', 'grad_norm': '0.1553', 'learning_rate': '0.0001567', 'epoch': '13.72'}
{'loss': '0.002579', 'grad_norm': '0.04171', 'learning_rate': '0.0001565', 'epoch': '13.76'}
{'loss': '0.003717', 'grad_norm': '0.1043', 'learning_rate': '0.0001563', 'epoch': '13.79'}
{'loss': '0.007149', 'grad_norm': '0.2', 'learning_rate': '0.0001561', 'epoch': '13.82'}
{'loss': '0.00486', 'grad_norm': '0.09129', 'learning_rate': '0.0001559', 'epoch': '13.85'}
{'loss': '0.009888', 'grad_norm': '0.2075', 'learning_rate': '0.0001557', 'epoch': '13.88'}
{'loss': '0.005351', 'grad_norm': '0.1153', 'learning_rate': '0.0001554', 'epoch': '13.91'}
{'loss': '0.004011', 'grad_norm': '0.1318', 'learning_rate': '0.0001552', 'epoch': '13.94'}
{'loss': '0.006549', 'grad_norm': '0.0474', 'learning_rate': '0.000155', 'epoch': '13.98'}
{'loss': '0.001862', 'grad_norm': '0.07965', 'learning_rate': '0.0001548', 'epoch': '14'}
{'loss': '0.001924', 'grad_norm': '0.01859', 'learning_rate': '0.0001546', 'epoch': '14.03'}
{'loss': '0.001523', 'grad_norm': '0.0265', 'learning_rate': '0.0001544', 'epoch': '14.06'}
{'loss': '0.003112', 'grad_norm': '0.03495', 'learning_rate': '0.0001542', 'epoch': '14.09'}
{'loss': '0.002562', 'grad_norm': '0.07407', 'learning_rate': '0.0001539', 'epoch': '14.13'}
{'loss': '0.001403', 'grad_norm': '0.04692', 'learning_rate': '0.0001537', 'epoch': '14.16'}
 35%|███▌      | 906/2560 [04:34<07:18,  3.77it/s]
 35%|███▌      | 907/2560 [04:34<07:18,  3.77it/s]
 35%|███▌      | 908/2560 [04:34<07:16,  3.78it/s]
                                                  

 35%|███▌      | 908/2560 [04:34<07:16,  3.78it/s]
 36%|███▌      | 909/2560 [04:34<07:16,  3.78it/s]
 36%|███▌      | 910/2560 [04:35<07:15,  3.79it/s]
                                                  

 36%|███▌      | 910/2560 [04:35<07:15,  3.79it/s]
 36%|███▌      | 911/2560 [04:35<07:15,  3.78it/s]
 36%|███▌      | 912/2560 [04:35<07:18,  3.75it/s]
                                                  

 36%|███▌      | 912/2560 [04:35<07:18,  3.75it/s]
 36%|███▌      | 913/2560 [04:36<07:16,  3.77it/s]
 36%|███▌      | 914/2560 [04:36<07:14,  3.79it/s]
                                                  

 36%|███▌      | 914/2560 [04:36<07:14,  3.79it/s]
 36%|███▌      | 915/2560 [04:36<07:10,  3.82it/s]
 36%|███▌      | 916/2560 [04:36<07:12,  3.80it/s]
                                                  

 36%|███▌      | 916/2560 [04:36<07:12,  3.80it/s]
 36%|███▌      | 917/2560 [04:37<07:12,  3.80it/s]
 36%|███▌      | 918/2560 [04:37<07:13,  3.78it/s]
                                                  

 36%|███▌      | 918/2560 [04:37<07:13,  3.78it/s]
 36%|███▌      | 919/2560 [04:37<07:15,  3.77it/s]
 36%|███▌      | 920/2560 [04:37<07:14,  3.77it/s]
                                                  

 36%|███▌      | 920/2560 [04:37<07:14,  3.77it/s]
 36%|███▌      | 921/2560 [04:38<07:23,  3.70it/s]
 36%|███▌      | 922/2560 [04:38<07:21,  3.71it/s]
                                                  

 36%|███▌      | 922/2560 [04:38<07:21,  3.71it/s]
 36%|███▌      | 923/2560 [04:38<07:22,  3.70it/s]
 36%|███▌      | 924/2560 [04:38<07:22,  3.70it/s]
                                                  

 36%|███▌      | 924/2560 [04:38<07:22,  3.70it/s]
 36%|███▌      | 925/2560 [04:39<07:20,  3.71it/s]
 36%|███▌      | 926/2560 [04:39<07:19,  3.72it/s]
                                                  

 36%|███▌      | 926/2560 [04:39<07:19,  3.72it/s]
 36%|███▌      | 927/2560 [04:39<07:16,  3.74it/s]
 36%|███▋      | 928/2560 [04:40<07:15,  3.75it/s]
                                                  

 36%|███▋      | 928/2560 [04:40<07:15,  3.75it/s]
 36%|███▋      | 929/2560 [04:40<07:14,  3.75it/s]
 36%|███▋      | 930/2560 [04:40<07:15,  3.75it/s]
                                                  

 36%|███▋      | 930/2560 [04:40<07:15,  3.75it/s]
 36%|███▋      | 931/2560 [04:40<07:17,  3.73it/s]
 36%|███▋      | 932/2560 [04:41<07:18,  3.72it/s]
                                                  

 36%|███▋      | 932/2560 [04:41<07:18,  3.72it/s]
 36%|███▋      | 933/2560 [04:41<07:20,  3.70it/s]
 36%|███▋      | 934/2560 [04:41<07:19,  3.70it/s]
                                                  

 36%|███▋      | 934/2560 [04:41<07:19,  3.70it/s]
 37%|███▋      | 935/2560 [04:41<07:19,  3.70it/s]
 37%|███▋      | 936/2560 [04:42<07:18,  3.71it/s]
                                                  

 37%|███▋      | 936/2560 [04:42<07:18,  3.71it/s]
 37%|███▋      | 937/2560 [04:42<07:24,  3.65it/s]
 37%|███▋      | 938/2560 [04:42<07:25,  3.64it/s]
                                                  

 37%|███▋      | 938/2560 [04:42<07:25,  3.64it/s]
 37%|███▋      | 939/2560 [04:42<07:21,  3.67it/s]
 37%|███▋      | 940/2560 [04:43<07:18,  3.70it/s]
                                                  

 37%|███▋      | 940/2560 [04:43<07:18,  3.70it/s]
 37%|███▋      | 941/2560 [04:43<07:17,  3.70it/s]
 37%|███▋      | 942/2560 [04:43<07:15,  3.72it/s]
                                                  

 37%|███▋      | 942/2560 [04:43<07:15,  3.72it/s]
 37%|███▋      | 943/2560 [04:44<07:14,  3.72it/s]
 37%|███▋      | 944/2560 [04:44<07:12,  3.74it/s]
                                                  

 37%|███▋      | 944/2560 [04:44<07:12,  3.74it/s]
 37%|███▋      | 945/2560 [04:44<07:13,  3.73it/s]
 37%|███▋      | 946/2560 [04:44<07:18,  3.68it/s]
                                                  

 37%|███▋      | 946/2560 [04:44<07:18,  3.68it/s]
 37%|███▋      | 947/2560 [04:45<07:20,  3.66it/s]
 37%|███▋      | 948/2560 [04:45<07:22,  3.64it/s]
                                                  

 37%|███▋      | 948/2560 [04:45<07:22,  3.64it/s]
 37%|███▋      | 949/2560 [04:45<07:21,  3.65it/s]
 37%|███▋      | 950/2560 [04:45<07:22,  3.64it/s]
                                                  

 37%|███▋      | 950/2560 [04:45<07:22,  3.64it/s]
 37%|███▋      | 951/2560 [04:46<07:23,  3.63it/s]
 37%|███▋      | 952/2560 [04:46<07:23,  3.63it/s]
                                                  

 37%|███▋      | 952/2560 [04:46<07:23,  3.63it/s]
 37%|███▋      | 953/2560 [04:46<07:21,  3.64it/s]
 37%|███▋      | 954/2560 [04:47<07:21,  3.64it/s]
                                                  

 37%|███▋      | 954/2560 [04:47<07:21,  3.64it/s]
 37%|███▋      | 955/2560 [04:47<07:20,  3.64it/s]
 37%|███▋      | 956/2560 [04:47<07:22,  3.62it/s]
                                                  

 37%|███▋      | 956/2560 [04:47<07:22,  3.62it/s]
 37%|███▋      | 957/2560 [04:47<07:23,  3.61it/s]
 37%|███▋      | 958/2560 [04:48<07:26,  3.59it/s]
                                                  

 37%|███▋      | 958/2560 [04:48<07:26,  3.59it/s]
 37%|███▋      | 959/2560 [04:48<07:27,  3.58it/s]
 38%|███▊      | 960/2560 [04:48<06:18,  4.23it/s]
                                                  

 38%|███▊      | 960/2560 [04:48<06:18,  4.23it/s]
 38%|███▊      | 961/2560 [04:48<06:39,  4.01it/s]
 38%|███▊      | 962/2560 [04:49<06:54,  3.85it/s]
                                                  

 38%|███▊      | 962/2560 [04:49<06:54,  3.85it/s]
 38%|███▊      | 963/2560 [04:49<07:04,  3.76it/s]
 38%|███▊      | 964/2560 [04:49<07:07,  3.73it/s]
                                                  

 38%|███▊      | 964/2560 [04:49<07:07,  3.73it/s]
 38%|███▊      | 965/2560 [04:50<07:09,  3.71it/s]
 38%|███▊      | 966/2560 [04:50<07:11,  3.70it/s]
                                                  

 38%|███▊      | 966/2560 [04:50<07:11,  3.70it/s]
 38%|███▊      | 967/2560 [04:50<07:11,  3.70it/s]
 38%|███▊      | 968/2560 [04:50<07:14,  3.66it/s]
                                                  

 38%|███▊      | 968/2560 [04:50<07:14,  3.66it/s]
 38%|███▊      | 969/2560 [04:51<07:17,  3.64it/s]
 38%|███▊      | 970/2560 [04:51<07:22,  3.59it/s]
                                                  

 38%|███▊      | 970/2560 [04:51<07:22,  3.59it/s]
 38%|███▊      | 971/2560 [04:51<07:23,  3.58it/s]
 38%|███▊      | 972/2560 [04:51<07:22,  3.59it/s]
                                                  

 38%|███▊      | 972/2560 [04:51<07:22,  3.59it/s]
 38%|███▊      | 973/2560 [04:52<07:19,  3.61it/s]
 38%|███▊      | 974/2560 [04:52<07:16,  3.63it/s]
                                                  

 38%|███▊      | 974/2560 [04:52<07:16,  3.63it/s]
 38%|███▊      | 975/2560 [04:52<07:12,  3.66it/s]
 38%|███▊      | 976/2560 [04:53<07:11,  3.67it/s]
                                                  

 38%|███▊      | 976/2560 [04:53<07:11,  3.67it/s]
 38%|███▊      | 977/2560 [04:53<07:10,  3.67it/s]
 38%|███▊      | 978/2560 [04:53<07:08,  3.69it/s]
                                                  

 38%|███▊      | 978/2560 [04:53<07:08,  3.69it/s]
 38%|███▊      | 979/2560 [04:53<07:06,  3.71it/s]
 38%|███▊      | 980/2560 [04:54<07:06,  3.70it/s]
                                                  

 38%|███▊      | 980/2560 [04:54<07:06,  3.70it/s]
 38%|███▊      | 981/2560 [04:54<07:08,  3.68it/s]
 38%|███▊      | 982/2560 [04:54<07:05,  3.71it/s]
                                                  

 38%|███▊      | 982/2560 [04:54<07:05,  3.71it/s]
 38%|███▊      | 983/2560 [04:54<07:03,  3.72it/s]
 38%|███▊      | 984/2560 [04:55<07:04,  3.71it/s]
                                                  

 38%|███▊      | 984/2560 [04:55<07:04,  3.71it/s]
 38%|███▊      | 985/2560 [04:55<07:06,  3.69it/s]
 39%|███▊      | 986/2560 [04:55<07:15,  3.62it/s]
                                                  

 39%|███▊      | 986/2560 [04:55<07:15,  3.62it/s]
 39%|███▊      | 987/2560 [04:56<07:18,  3.59it/s]
 39%|███▊      | 988/2560 [04:56<07:15,  3.61it/s]
                                                  

 39%|███▊      | 988/2560 [04:56<07:15,  3.61it/s]
 39%|███▊      | 989/2560 [04:56<07:11,  3.64it/s]
 39%|███▊      | 990/2560 [04:56<07:10,  3.64it/s]
                                                  

 39%|███▊      | 990/2560 [04:56<07:10,  3.64it/s]
 39%|███▊      | 991/2560 [04:57<07:10,  3.64it/s]
 39%|███▉      | 992/2560 [04:57<07:11,  3.63it/s]
                                                  

 39%|███▉      | 992/2560 [04:57<07:11,  3.63it/s]
 39%|███▉      | 993/2560 [04:57<07:13,  3.61it/s]
 39%|███▉      | 994/2560 [04:57<07:08,  3.65it/s]
                                                  

 39%|███▉      | 994/2560 [04:57<07:08,  3.65it/s]
 39%|███▉      | 995/2560 [04:58<07:04,  3.69it/s]
 39%|███▉      | 996/2560 [04:58<07:02,  3.70it/s]
                                                  

 39%|███▉      | 996/2560 [04:58<07:02,  3.70it/s]
 39%|███▉      | 997/2560 [04:58<07:00,  3.71it/s]
 39%|███▉      | 998/2560 [04:59<07:01,  3.71it/s]
                                                  

 39%|███▉      | 998/2560 [04:59<07:01,  3.71it/s]
 39%|███▉      | 999/2560 [04:59<06:55,  3.75it/s]
 39%|███▉      | 1000/2560 [04:59<06:58,  3.73it/s]
                                                   

 39%|███▉      | 1000/2560 [04:59<06:58,  3.73it/s]
 39%|███▉      | 1001/2560 [04:59<07:15,  3.58it/s]
 39%|███▉      | 1002/2560 [05:00<07:11,  3.61it/s]
                                                   

 39%|███▉      | 1002/2560 [05:00<07:11,  3.61it/s]
 39%|███▉      | 1003/2560 [05:00<07:04,  3.67it/s]
 39%|███▉      | 1004/2560 [05:00<06:56,  3.74it/s]
                                                   

 39%|███▉      | 1004/2560 [05:00<06:56,  3.74it/s]
 39%|███▉      | 1005/2560 [05:00<06:55,  3.74it/s]
 39%|███▉      | 1006/2560 [05:01<06:55,  3.74it/s]
                                                   

 39%|███▉      | 1006/2560 [05:01<06:55,  3.74it/s]
 39%|███▉      | 1007/2560 [05:01<06:51,  3.77it/s]
 39%|███▉      | 1008/2560 [05:01<06:47,  3.81it/s]
                                                   

 39%|███▉      | 1008/2560 [05:01<06:47,  3.81it/s]
 39%|███▉      | 1009/2560 [05:01<06:50,  3.78it/s]
 39%|███▉      | 1010/2560 [05:02<06:47,  3.80it/s]
                                                   

 39%|███▉      | 1010/2560 [05:02<06:47,  3.80it/s]
 39%|███▉      | 1011/2560 [05:02<06:43,  3.84it/s]
 40%|███▉      | 1012/2560 [05:02<06:43,  3.84it/s]
                                                   

 40%|███▉      | 1012/2560 [05:02<06:43,  3.84it/s]
 40%|███▉      | 1013/2560 [05:03<06:42,  3.84it/s]
 40%|███▉      | 1014/2560 [05:03<06:42,  3.84it/s]
                                                   

 40%|███▉      | 1014/2560 [05:03<06:42,  3.84it/s]
 40%|███▉      | 1015/2560 [05:03<06:40,  3.85it/s]
 40%|███▉      | 1016/2560 [05:03<06:42,  3.84it/s]
                                                   

 40%|███▉      | 1016/2560 [05:03<06:42,  3.84it/s]
 40%|███▉      | 1017/2560 [05:04<06:45,  3.80it/s]
 40%|███▉      | 1018/2560 [05:04<06:47,  3.79it/s]
                                                   

 40%|███▉      | 1018/2560 [05:04<06:47,  3.79it/s]
 40%|███▉      | 1019/2560 [05:04<06:47,  3.78it/s]
 40%|███▉      | 1020/2560 [05:04<06:47,  3.78it/s]
                                                   

 40%|███▉      | 1020/2560 [05:04<06:47,  3.78it/s]
 40%|███▉      | 1021/2560 [05:05<06:49,  3.76it/s]
 40%|███▉      | 1022/2560 [05:05<06:45,  3.79it/s]
                                                   

 40%|███▉      | 1022/2560 [05:05<06:45,  3.79it/s]
 40%|███▉      | 1023/2560 [05:05<06:47,  3.77it/s]
 40%|████      | 1024/2560 [05:05<05:46,  4.43it/s]
                                                   

 40%|████      | 1024/2560 [05:05<05:46,  4.43it/s]
 40%|████      | 1025/2560 [05:06<06:06,  4.19it/s]
 40%|████      | 1026/2560 [05:06<06:21,  4.02it/s]
                                                   

 40%|████      | 1026/2560 [05:06<06:21,  4.02it/s]
 40%|████      | 1027/2560 [05:06<06:28,  3.95it/s]
 40%|████      | 1028/2560 [05:06<06:35,  3.87it/s]
                                                   

 40%|████      | 1028/2560 [05:06<06:35,  3.87it/s]
 40%|████      | 1029/2560 [05:07<06:39,  3.83it/s]
 40%|████      | 1030/2560 [05:07<06:43,  3.80it/s]
                                                   

 40%|████      | 1030/2560 [05:07<06:43,  3.80it/s]
 40%|████      | 1031/2560 [05:07<06:46,  3.76it/s]
 40%|████      | 1032/2560 [05:07<06:49,  3.74it/s]
                                                   

 40%|████      | 1032/2560 [05:07<06:49,  3.74it/s]
 40%|████      | 1033/2560 [05:08<06:48,  3.74it/s]
 40%|████      | 1034/2560 [05:08<06:49,  3.73it/s]
                                                   

 40%|████      | 1034/2560 [05:08<06:49,  3.73it/s]
 40%|████      | 1035/2560 [05:08<06:48,  3.74it/s]
 40%|████      | 1036/2560 [05:09<06:45,  3.76it/s]
                                                   

 40%|████      | 1036/2560 [05:09<06:45,  3.76it/s]
 41%|████      | 1037/2560 [05:09<06:47,  3.73it/s]
 41%|████      | 1038/2560 [05:09<06:46,  3.75it/s]
                                                   

 41%|████      | 1038/2560 [05:09<06:46,  3.75it/s]
 41%|████      | 1039/2560 [05:09<06:50,  3.70it/s]
 41%|████      | 1040/2560 [05:10<06:47,  3.73it/s]
                                                   

 41%|████      | 1040/2560 [05:10<06:47,  3.73it/s]
 41%|████      | 1041/2560 [05:10<06:51,  3.69it/s]
 41%|████      | 1042/2560 [05:10<06:50,  3.70it/s]
                                                   

 41%|████      | 1042/2560 [05:10<06:50,  3.70it/s]
 41%|████      | 1043/2560 [05:10<06:47,  3.72it/s]
 41%|████      | 1044/2560 [05:11<06:46,  3.73it/s]
                                                   

 41%|████      | 1044/2560 [05:11<06:46,  3.73it/s]
 41%|████      | 1045/2560 [05:11<06:45,  3.74it/s]
 41%|████      | 1046/2560 [05:11<06:44,  3.74it/s]
                                                   

 41%|████      | 1046/2560 [05:11<06:44,  3.74it/s]
 41%|████      | 1047/2560 [05:11<06:48,  3.70it/s]
 41%|████      | 1048/2560 [05:12<06:48,  3.70it/s]
                                                   

 41%|████      | 1048/2560 [05:12<06:48,  3.70it/s]
 41%|████      | 1049/2560 [05:12<06:46,  3.72it/s]
 41%|████      | 1050/2560 [05:12<06:45,  3.73it/s]
                                                   

 41%|████      | 1050/2560 [05:12<06:45,  3.73it/s]
 41%|████      | 1051/2560 [05:13<06:47,  3.70it/s]
 41%|████      | 1052/2560 [05:13<06:44,  3.73it/s]
                                                   

 41%|████      | 1052/2560 [05:13<06:44,  3.73it/s]
 41%|████      | 1053/2560 [05:13<06:46,  3.71it/s]
 41%|████      | 1054/2560 [05:13<06:46,  3.71it/s]
                                                   

 41%|████      | 1054/2560 [05:13<06:46,  3.71it/s]
 41%|████      | 1055/2560 [05:14<06:48,  3.69it/s]
 41%|████▏     | 1056/2560 [05:14<06:44,  3.71it/s]
                                                   

 41%|████▏     | 1056/2560 [05:14<06:44,  3.71it/s]
 41%|████▏     | 1057/2560 [05:14<06:47,  3.69it/s]
 41%|████▏     | 1058/2560 [05:14<06:46,  3.69it/s]
                                                   

 41%|████▏     | 1058/2560 [05:14<06:46,  3.69it/s]
 41%|████▏     | 1059/2560 [05:15<06:44,  3.71it/s]
 41%|████▏     | 1060/2560 [05:15<06:46,  3.69it/s]
                                                   

 41%|████▏     | 1060/2560 [05:15<06:46,  3.69it/s]
 41%|████▏     | 1061/2560 [05:15<06:43,  3.71it/s]
 41%|████▏     | 1062/2560 [05:16<06:44,  3.70it/s]
                                                   

 41%|████▏     | 1062/2560 [05:16<06:44,  3.70it/s]
 42%|████▏     | 1063/2560 [05:16<06:42,  3.72it/s]
 42%|████▏     | 1064/2560 [05:16<06:42,  3.71it/s]
                                                   

 42%|████▏     | 1064/2560 [05:16<06:42,  3.71it/s]
 42%|████▏     | 1065/2560 [05:16<06:39,  3.74it/s]
 42%|████▏     | 1066/2560 [05:17<06:37,  3.76it/s]
                                                   

 42%|████▏     | 1066/2560 [05:17<06:37,  3.76it/s]
 42%|████▏     | 1067/2560 [05:17<06:34,  3.78it/s]
 42%|████▏     | 1068/2560 [05:17<06:30,  3.82it/s]
                                                   

 42%|████▏     | 1068/2560 [05:17<06:30,  3.82it/s]
 42%|████▏     | 1069/2560 [05:17<06:34,  3.78it/s]
 42%|████▏     | 1070/2560 [05:18<06:32,  3.80it/s]
                                                   

 42%|████▏     | 1070/2560 [05:18<06:32,  3.80it/s]
 42%|████▏     | 1071/2560 [05:18<06:32,  3.79it/s]
 42%|████▏     | 1072/2560 [05:18<06:37,  3.74it/s]
                                                   

 42%|████▏     | 1072/2560 [05:18<06:37,  3.74it/s]
 42%|████▏     | 1073/2560 [05:18<06:37,  3.74it/s]
 42%|████▏     | 1074/2560 [05:19<06:35,  3.76it/s]
                                                   

 42%|████▏     | 1074/2560 [05:19<06:35,  3.76it/s]
 42%|████▏     | 1075/2560 [05:19<06:37,  3.74it/s]
 42%|████▏     | 1076/2560 [05:19<06:37,  3.74it/s]
                                                   

 42%|████▏     | 1076/2560 [05:19<06:37,  3.74it/s]
 42%|████▏     | 1077/2560 [05:19<06:34,  3.76it/s]
 42%|████▏     | 1078/2560 [05:20<06:31,  3.79it/s]
                                                   

 42%|████▏     | 1078/2560 [05:20<06:31,  3.79it/s]
 42%|████▏     | 1079/2560 [05:20<06:30,  3.80it/s]
 42%|████▏     | 1080/2560 [05:20<06:28,  3.81it/s]
                                                   

 42%|████▏     | 1080/2560 [05:20<06:28,  3.81it/s]
 42%|████▏     | 1081/2560 [05:21<06:28,  3.80it/s]
 42%|████▏     | 1082/2560 [05:21<06:28,  3.81it/s]
                                                   

 42%|████▏     | 1082/2560 [05:21<06:28,  3.81it/s]
 42%|████▏     | 1083/2560 [05:21<06:26,  3.82it/s]
 42%|████▏     | 1084/2560 [05:21<06:26,  3.82it/s]
                                                   
{'loss': '0.008644', 'grad_norm': '0.209', 'learning_rate': '0.0001535', 'epoch': '14.19'}
{'loss': '0.001976', 'grad_norm': '0.03682', 'learning_rate': '0.0001533', 'epoch': '14.22'}
{'loss': '0.002587', 'grad_norm': '0.02552', 'learning_rate': '0.0001531', 'epoch': '14.25'}
{'loss': '0.005058', 'grad_norm': '0.0553', 'learning_rate': '0.0001528', 'epoch': '14.28'}
{'loss': '0.004211', 'grad_norm': '0.05146', 'learning_rate': '0.0001526', 'epoch': '14.31'}
{'loss': '0.003542', 'grad_norm': '0.05071', 'learning_rate': '0.0001524', 'epoch': '14.35'}
{'loss': '0.001752', 'grad_norm': '0.08789', 'learning_rate': '0.0001522', 'epoch': '14.38'}
{'loss': '0.004374', 'grad_norm': '0.08521', 'learning_rate': '0.000152', 'epoch': '14.41'}
{'loss': '0.005134', 'grad_norm': '0.03962', 'learning_rate': '0.0001517', 'epoch': '14.44'}
{'loss': '0.002008', 'grad_norm': '0.1079', 'learning_rate': '0.0001515', 'epoch': '14.47'}
{'loss': '0.006344', 'grad_norm': '0.0861', 'learning_rate': '0.0001513', 'epoch': '14.5'}
{'loss': '0.001721', 'grad_norm': '0.05388', 'learning_rate': '0.0001511', 'epoch': '14.54'}
{'loss': '0.00178', 'grad_norm': '0.05122', 'learning_rate': '0.0001509', 'epoch': '14.57'}
{'loss': '0.001972', 'grad_norm': '0.07769', 'learning_rate': '0.0001506', 'epoch': '14.6'}
{'loss': '0.001551', 'grad_norm': '0.02284', 'learning_rate': '0.0001504', 'epoch': '14.63'}
{'loss': '0.003327', 'grad_norm': '0.1406', 'learning_rate': '0.0001502', 'epoch': '14.66'}
{'loss': '0.004929', 'grad_norm': '0.1043', 'learning_rate': '0.00015', 'epoch': '14.69'}
{'loss': '0.006031', 'grad_norm': '0.1508', 'learning_rate': '0.0001497', 'epoch': '14.72'}
{'loss': '0.006702', 'grad_norm': '0.1464', 'learning_rate': '0.0001495', 'epoch': '14.76'}
{'loss': '0.001943', 'grad_norm': '0.05444', 'learning_rate': '0.0001493', 'epoch': '14.79'}
{'loss': '0.002007', 'grad_norm': '0.06177', 'learning_rate': '0.0001491', 'epoch': '14.82'}
{'loss': '0.002562', 'grad_norm': '0.03868', 'learning_rate': '0.0001488', 'epoch': '14.85'}
{'loss': '0.001668', 'grad_norm': '0.08199', 'learning_rate': '0.0001486', 'epoch': '14.88'}
{'loss': '0.003104', 'grad_norm': '0.1247', 'learning_rate': '0.0001484', 'epoch': '14.91'}
{'loss': '0.004885', 'grad_norm': '0.1459', 'learning_rate': '0.0001482', 'epoch': '14.94'}
{'loss': '0.001732', 'grad_norm': '0.03349', 'learning_rate': '0.0001479', 'epoch': '14.98'}
{'loss': '0.001951', 'grad_norm': '0.04206', 'learning_rate': '0.0001477', 'epoch': '15'}
{'loss': '0.003931', 'grad_norm': '0.089', 'learning_rate': '0.0001475', 'epoch': '15.03'}
{'loss': '0.001727', 'grad_norm': '0.03701', 'learning_rate': '0.0001473', 'epoch': '15.06'}
{'loss': '0.001675', 'grad_norm': '0.01773', 'learning_rate': '0.000147', 'epoch': '15.09'}
{'loss': '0.001415', 'grad_norm': '0.01929', 'learning_rate': '0.0001468', 'epoch': '15.13'}
{'loss': '0.002307', 'grad_norm': '0.03109', 'learning_rate': '0.0001466', 'epoch': '15.16'}
{'loss': '0.004171', 'grad_norm': '0.1175', 'learning_rate': '0.0001463', 'epoch': '15.19'}
{'loss': '0.00149', 'grad_norm': '0.0361', 'learning_rate': '0.0001461', 'epoch': '15.22'}
{'loss': '0.002304', 'grad_norm': '0.08301', 'learning_rate': '0.0001459', 'epoch': '15.25'}
{'loss': '0.003914', 'grad_norm': '0.03728', 'learning_rate': '0.0001457', 'epoch': '15.28'}
{'loss': '0.001526', 'grad_norm': '0.02498', 'learning_rate': '0.0001454', 'epoch': '15.31'}
{'loss': '0.002112', 'grad_norm': '0.08415', 'learning_rate': '0.0001452', 'epoch': '15.35'}
{'loss': '0.003166', 'grad_norm': '0.0763', 'learning_rate': '0.000145', 'epoch': '15.38'}
{'loss': '0.006282', 'grad_norm': '0.1799', 'learning_rate': '0.0001447', 'epoch': '15.41'}
{'loss': '0.002594', 'grad_norm': '0.02838', 'learning_rate': '0.0001445', 'epoch': '15.44'}
{'loss': '0.00367', 'grad_norm': '0.06102', 'learning_rate': '0.0001443', 'epoch': '15.47'}
{'loss': '0.003418', 'grad_norm': '0.09046', 'learning_rate': '0.000144', 'epoch': '15.5'}
{'loss': '0.005546', 'grad_norm': '0.1325', 'learning_rate': '0.0001438', 'epoch': '15.54'}
{'loss': '0.002337', 'grad_norm': '0.04638', 'learning_rate': '0.0001436', 'epoch': '15.57'}
{'loss': '0.003751', 'grad_norm': '0.1022', 'learning_rate': '0.0001433', 'epoch': '15.6'}
{'loss': '0.00296', 'grad_norm': '0.1046', 'learning_rate': '0.0001431', 'epoch': '15.63'}
{'loss': '0.002181', 'grad_norm': '0.06282', 'learning_rate': '0.0001429', 'epoch': '15.66'}
{'loss': '0.003916', 'grad_norm': '0.07453', 'learning_rate': '0.0001426', 'epoch': '15.69'}
{'loss': '0.002597', 'grad_norm': '0.02724', 'learning_rate': '0.0001424', 'epoch': '15.72'}
{'loss': '0.001669', 'grad_norm': '0.09795', 'learning_rate': '0.0001422', 'epoch': '15.76'}
{'loss': '0.002393', 'grad_norm': '0.09223', 'learning_rate': '0.0001419', 'epoch': '15.79'}
{'loss': '0.001317', 'grad_norm': '0.02123', 'learning_rate': '0.0001417', 'epoch': '15.82'}
{'loss': '0.002211', 'grad_norm': '0.04038', 'learning_rate': '0.0001415', 'epoch': '15.85'}
{'loss': '0.001655', 'grad_norm': '0.04251', 'learning_rate': '0.0001412', 'epoch': '15.88'}
{'loss': '0.00233', 'grad_norm': '0.09496', 'learning_rate': '0.000141', 'epoch': '15.91'}
{'loss': '0.002922', 'grad_norm': '0.06973', 'learning_rate': '0.0001408', 'epoch': '15.94'}
{'loss': '0.003905', 'grad_norm': '0.1358', 'learning_rate': '0.0001405', 'epoch': '15.98'}
{'loss': '0.004907', 'grad_norm': '0.3015', 'learning_rate': '0.0001403', 'epoch': '16'}
{'loss': '0.002334', 'grad_norm': '0.03031', 'learning_rate': '0.0001401', 'epoch': '16.03'}
{'loss': '0.001724', 'grad_norm': '0.06196', 'learning_rate': '0.0001398', 'epoch': '16.06'}
{'loss': '0.002729', 'grad_norm': '0.02077', 'learning_rate': '0.0001396', 'epoch': '16.09'}
{'loss': '0.004236', 'grad_norm': '0.08199', 'learning_rate': '0.0001393', 'epoch': '16.13'}
{'loss': '0.00125', 'grad_norm': '0.04754', 'learning_rate': '0.0001391', 'epoch': '16.16'}
{'loss': '0.003847', 'grad_norm': '0.0555', 'learning_rate': '0.0001389', 'epoch': '16.19'}
{'loss': '0.002778', 'grad_norm': '0.03439', 'learning_rate': '0.0001386', 'epoch': '16.22'}
{'loss': '0.002456', 'grad_norm': '0.05521', 'learning_rate': '0.0001384', 'epoch': '16.25'}
{'loss': '0.003574', 'grad_norm': '0.05484', 'learning_rate': '0.0001381', 'epoch': '16.28'}
{'loss': '0.00231', 'grad_norm': '0.1001', 'learning_rate': '0.0001379', 'epoch': '16.31'}
{'loss': '0.001608', 'grad_norm': '0.02502', 'learning_rate': '0.0001377', 'epoch': '16.35'}
{'loss': '0.002108', 'grad_norm': '0.05735', 'learning_rate': '0.0001374', 'epoch': '16.38'}
{'loss': '0.002349', 'grad_norm': '0.04906', 'learning_rate': '0.0001372', 'epoch': '16.41'}
{'loss': '0.001635', 'grad_norm': '0.05982', 'learning_rate': '0.000137', 'epoch': '16.44'}
{'loss': '0.005147', 'grad_norm': '0.1672', 'learning_rate': '0.0001367', 'epoch': '16.47'}
{'loss': '0.001265', 'grad_norm': '0.02059', 'learning_rate': '0.0001365', 'epoch': '16.5'}
{'loss': '0.002793', 'grad_norm': '0.1148', 'learning_rate': '0.0001362', 'epoch': '16.54'}
{'loss': '0.003955', 'grad_norm': '0.06885', 'learning_rate': '0.000136', 'epoch': '16.57'}
{'loss': '0.001549', 'grad_norm': '0.02721', 'learning_rate': '0.0001357', 'epoch': '16.6'}
{'loss': '0.002727', 'grad_norm': '0.09909', 'learning_rate': '0.0001355', 'epoch': '16.63'}
{'loss': '0.002283', 'grad_norm': '0.02488', 'learning_rate': '0.0001353', 'epoch': '16.66'}
{'loss': '0.001961', 'grad_norm': '0.018', 'learning_rate': '0.000135', 'epoch': '16.69'}
{'loss': '0.002179', 'grad_norm': '0.0285', 'learning_rate': '0.0001348', 'epoch': '16.72'}
{'loss': '0.004678', 'grad_norm': '0.0901', 'learning_rate': '0.0001345', 'epoch': '16.76'}
{'loss': '0.003321', 'grad_norm': '0.07136', 'learning_rate': '0.0001343', 'epoch': '16.79'}
{'loss': '0.002681', 'grad_norm': '0.01575', 'learning_rate': '0.0001341', 'epoch': '16.82'}
{'loss': '0.002229', 'grad_norm': '0.07025', 'learning_rate': '0.0001338', 'epoch': '16.85'}
{'loss': '0.003472', 'grad_norm': '0.05997', 'learning_rate': '0.0001336', 'epoch': '16.88'}
{'loss': '0.0019', 'grad_norm': '0.05514', 'learning_rate': '0.0001333', 'epoch': '16.91'}
{'loss': '0.003965', 'grad_norm': '0.1018', 'learning_rate': '0.0001331', 'epoch': '16.94'}
 42%|████▏     | 1084/2560 [05:21<06:26,  3.82it/s]
 42%|████▏     | 1085/2560 [05:22<06:27,  3.81it/s]
 42%|████▏     | 1086/2560 [05:22<06:28,  3.80it/s]
                                                   

 42%|████▏     | 1086/2560 [05:22<06:28,  3.80it/s]
 42%|████▏     | 1087/2560 [05:22<06:26,  3.81it/s]
 42%|████▎     | 1088/2560 [05:22<05:27,  4.49it/s]
                                                   

 42%|████▎     | 1088/2560 [05:22<05:27,  4.49it/s]
 43%|████▎     | 1089/2560 [05:23<05:50,  4.20it/s]
 43%|████▎     | 1090/2560 [05:23<06:00,  4.08it/s]
                                                   

 43%|████▎     | 1090/2560 [05:23<06:00,  4.08it/s]
 43%|████▎     | 1091/2560 [05:23<06:07,  4.00it/s]
 43%|████▎     | 1092/2560 [05:23<06:11,  3.95it/s]
                                                   

 43%|████▎     | 1092/2560 [05:23<06:11,  3.95it/s]
 43%|████▎     | 1093/2560 [05:24<06:15,  3.91it/s]
 43%|████▎     | 1094/2560 [05:24<06:16,  3.89it/s]
                                                   

 43%|████▎     | 1094/2560 [05:24<06:16,  3.89it/s]
 43%|████▎     | 1095/2560 [05:24<06:15,  3.90it/s]
 43%|████▎     | 1096/2560 [05:24<06:15,  3.90it/s]
                                                   

 43%|████▎     | 1096/2560 [05:24<06:15,  3.90it/s]
 43%|████▎     | 1097/2560 [05:25<06:16,  3.88it/s]
 43%|████▎     | 1098/2560 [05:25<06:16,  3.88it/s]
                                                   

 43%|████▎     | 1098/2560 [05:25<06:16,  3.88it/s]
 43%|████▎     | 1099/2560 [05:25<06:16,  3.88it/s]
 43%|████▎     | 1100/2560 [05:25<06:16,  3.87it/s]
                                                   

 43%|████▎     | 1100/2560 [05:25<06:16,  3.87it/s]
 43%|████▎     | 1101/2560 [05:26<06:17,  3.86it/s]
 43%|████▎     | 1102/2560 [05:26<06:16,  3.87it/s]
                                                   

 43%|████▎     | 1102/2560 [05:26<06:16,  3.87it/s]
 43%|████▎     | 1103/2560 [05:26<06:17,  3.86it/s]
 43%|████▎     | 1104/2560 [05:26<06:16,  3.87it/s]
                                                   

 43%|████▎     | 1104/2560 [05:26<06:16,  3.87it/s]
 43%|████▎     | 1105/2560 [05:27<06:17,  3.86it/s]
 43%|████▎     | 1106/2560 [05:27<06:16,  3.86it/s]
                                                   

 43%|████▎     | 1106/2560 [05:27<06:16,  3.86it/s]
 43%|████▎     | 1107/2560 [05:27<06:15,  3.87it/s]
 43%|████▎     | 1108/2560 [05:27<06:15,  3.87it/s]
                                                   

 43%|████▎     | 1108/2560 [05:27<06:15,  3.87it/s]
 43%|████▎     | 1109/2560 [05:28<06:14,  3.87it/s]
 43%|████▎     | 1110/2560 [05:28<06:19,  3.82it/s]
                                                   

 43%|████▎     | 1110/2560 [05:28<06:19,  3.82it/s]
 43%|████▎     | 1111/2560 [05:28<06:20,  3.81it/s]
 43%|████▎     | 1112/2560 [05:29<06:22,  3.79it/s]
                                                   

 43%|████▎     | 1112/2560 [05:29<06:22,  3.79it/s]
 43%|████▎     | 1113/2560 [05:29<06:21,  3.79it/s]
 44%|████▎     | 1114/2560 [05:29<06:24,  3.76it/s]
                                                   

 44%|████▎     | 1114/2560 [05:29<06:24,  3.76it/s]
 44%|████▎     | 1115/2560 [05:29<06:27,  3.73it/s]
 44%|████▎     | 1116/2560 [05:30<06:31,  3.69it/s]
                                                   

 44%|████▎     | 1116/2560 [05:30<06:31,  3.69it/s]
 44%|████▎     | 1117/2560 [05:30<06:32,  3.68it/s]
 44%|████▎     | 1118/2560 [05:30<06:30,  3.69it/s]
                                                   

 44%|████▎     | 1118/2560 [05:30<06:30,  3.69it/s]
 44%|████▎     | 1119/2560 [05:30<06:31,  3.68it/s]
 44%|████▍     | 1120/2560 [05:31<06:34,  3.65it/s]
                                                   

 44%|████▍     | 1120/2560 [05:31<06:34,  3.65it/s]
 44%|████▍     | 1121/2560 [05:31<06:36,  3.63it/s]
 44%|████▍     | 1122/2560 [05:31<06:36,  3.63it/s]
                                                   

 44%|████▍     | 1122/2560 [05:31<06:36,  3.63it/s]
 44%|████▍     | 1123/2560 [05:32<06:33,  3.65it/s]
 44%|████▍     | 1124/2560 [05:32<06:30,  3.67it/s]
                                                   

 44%|████▍     | 1124/2560 [05:32<06:30,  3.67it/s]
 44%|████▍     | 1125/2560 [05:32<06:34,  3.64it/s]
 44%|████▍     | 1126/2560 [05:32<06:33,  3.64it/s]
                                                   

 44%|████▍     | 1126/2560 [05:32<06:33,  3.64it/s]
 44%|████▍     | 1127/2560 [05:33<06:33,  3.64it/s]
 44%|████▍     | 1128/2560 [05:33<06:30,  3.66it/s]
                                                   

 44%|████▍     | 1128/2560 [05:33<06:30,  3.66it/s]
 44%|████▍     | 1129/2560 [05:33<06:29,  3.68it/s]
 44%|████▍     | 1130/2560 [05:33<06:30,  3.66it/s]
                                                   

 44%|████▍     | 1130/2560 [05:33<06:30,  3.66it/s]
 44%|████▍     | 1131/2560 [05:34<06:25,  3.71it/s]
 44%|████▍     | 1132/2560 [05:34<06:26,  3.69it/s]
                                                   

 44%|████▍     | 1132/2560 [05:34<06:26,  3.69it/s]
 44%|████▍     | 1133/2560 [05:34<06:24,  3.71it/s]
 44%|████▍     | 1134/2560 [05:34<06:21,  3.73it/s]
                                                   

 44%|████▍     | 1134/2560 [05:34<06:21,  3.73it/s]
 44%|████▍     | 1135/2560 [05:35<06:19,  3.75it/s]
 44%|████▍     | 1136/2560 [05:35<06:18,  3.76it/s]
                                                   

 44%|████▍     | 1136/2560 [05:35<06:18,  3.76it/s]
 44%|████▍     | 1137/2560 [05:35<06:18,  3.76it/s]
 44%|████▍     | 1138/2560 [05:36<06:16,  3.78it/s]
                                                   

 44%|████▍     | 1138/2560 [05:36<06:16,  3.78it/s]
 44%|████▍     | 1139/2560 [05:36<06:16,  3.78it/s]
 45%|████▍     | 1140/2560 [05:36<06:16,  3.77it/s]
                                                   

 45%|████▍     | 1140/2560 [05:36<06:16,  3.77it/s]
 45%|████▍     | 1141/2560 [05:36<06:14,  3.79it/s]
 45%|████▍     | 1142/2560 [05:37<06:12,  3.80it/s]
                                                   

 45%|████▍     | 1142/2560 [05:37<06:12,  3.80it/s]
 45%|████▍     | 1143/2560 [05:37<06:09,  3.84it/s]
 45%|████▍     | 1144/2560 [05:37<06:08,  3.84it/s]
                                                   

 45%|████▍     | 1144/2560 [05:37<06:08,  3.84it/s]
 45%|████▍     | 1145/2560 [05:37<06:14,  3.78it/s]
 45%|████▍     | 1146/2560 [05:38<06:14,  3.78it/s]
                                                   

 45%|████▍     | 1146/2560 [05:38<06:14,  3.78it/s]
 45%|████▍     | 1147/2560 [05:38<06:12,  3.80it/s]
 45%|████▍     | 1148/2560 [05:38<06:14,  3.77it/s]
                                                   

 45%|████▍     | 1148/2560 [05:38<06:14,  3.77it/s]
 45%|████▍     | 1149/2560 [05:38<06:13,  3.78it/s]
 45%|████▍     | 1150/2560 [05:39<06:18,  3.73it/s]
                                                   

 45%|████▍     | 1150/2560 [05:39<06:18,  3.73it/s]
 45%|████▍     | 1151/2560 [05:39<06:15,  3.75it/s]
 45%|████▌     | 1152/2560 [05:39<05:16,  4.44it/s]
                                                   

 45%|████▌     | 1152/2560 [05:39<05:16,  4.44it/s]
 45%|████▌     | 1153/2560 [05:39<05:33,  4.22it/s]
 45%|████▌     | 1154/2560 [05:40<05:47,  4.04it/s]
                                                   

 45%|████▌     | 1154/2560 [05:40<05:47,  4.04it/s]
 45%|████▌     | 1155/2560 [05:40<05:57,  3.93it/s]
 45%|████▌     | 1156/2560 [05:40<06:01,  3.88it/s]
                                                   

 45%|████▌     | 1156/2560 [05:40<06:01,  3.88it/s]
 45%|████▌     | 1157/2560 [05:40<06:08,  3.80it/s]
 45%|████▌     | 1158/2560 [05:41<06:10,  3.78it/s]
                                                   

 45%|████▌     | 1158/2560 [05:41<06:10,  3.78it/s]
 45%|████▌     | 1159/2560 [05:41<06:10,  3.78it/s]
 45%|████▌     | 1160/2560 [05:41<06:10,  3.78it/s]
                                                   

 45%|████▌     | 1160/2560 [05:41<06:10,  3.78it/s]
 45%|████▌     | 1161/2560 [05:42<06:10,  3.78it/s]
 45%|████▌     | 1162/2560 [05:42<06:09,  3.78it/s]
                                                   

 45%|████▌     | 1162/2560 [05:42<06:09,  3.78it/s]
 45%|████▌     | 1163/2560 [05:42<06:11,  3.76it/s]
 45%|████▌     | 1164/2560 [05:42<06:11,  3.75it/s]
                                                   

 45%|████▌     | 1164/2560 [05:42<06:11,  3.75it/s]
 46%|████▌     | 1165/2560 [05:43<06:10,  3.76it/s]
 46%|████▌     | 1166/2560 [05:43<06:12,  3.74it/s]
                                                   

 46%|████▌     | 1166/2560 [05:43<06:12,  3.74it/s]
 46%|████▌     | 1167/2560 [05:43<06:11,  3.75it/s]
 46%|████▌     | 1168/2560 [05:43<06:13,  3.73it/s]
                                                   

 46%|████▌     | 1168/2560 [05:43<06:13,  3.73it/s]
 46%|████▌     | 1169/2560 [05:44<06:17,  3.68it/s]
 46%|████▌     | 1170/2560 [05:44<06:16,  3.70it/s]
                                                   

 46%|████▌     | 1170/2560 [05:44<06:16,  3.70it/s]
 46%|████▌     | 1171/2560 [05:44<06:19,  3.66it/s]
 46%|████▌     | 1172/2560 [05:44<06:15,  3.69it/s]
                                                   

 46%|████▌     | 1172/2560 [05:44<06:15,  3.69it/s]
 46%|████▌     | 1173/2560 [05:45<06:15,  3.69it/s]
 46%|████▌     | 1174/2560 [05:45<06:14,  3.70it/s]
                                                   

 46%|████▌     | 1174/2560 [05:45<06:14,  3.70it/s]
 46%|████▌     | 1175/2560 [05:45<06:14,  3.70it/s]
 46%|████▌     | 1176/2560 [05:46<06:13,  3.70it/s]
                                                   

 46%|████▌     | 1176/2560 [05:46<06:13,  3.70it/s]
 46%|████▌     | 1177/2560 [05:46<06:11,  3.72it/s]
 46%|████▌     | 1178/2560 [05:46<06:09,  3.74it/s]
                                                   

 46%|████▌     | 1178/2560 [05:46<06:09,  3.74it/s]
 46%|████▌     | 1179/2560 [05:46<06:08,  3.75it/s]
 46%|████▌     | 1180/2560 [05:47<06:11,  3.71it/s]
                                                   

 46%|████▌     | 1180/2560 [05:47<06:11,  3.71it/s]
 46%|████▌     | 1181/2560 [05:47<06:10,  3.72it/s]
 46%|████▌     | 1182/2560 [05:47<06:13,  3.68it/s]
                                                   

 46%|████▌     | 1182/2560 [05:47<06:13,  3.68it/s]
 46%|████▌     | 1183/2560 [05:47<06:11,  3.70it/s]
 46%|████▋     | 1184/2560 [05:48<06:14,  3.67it/s]
                                                   

 46%|████▋     | 1184/2560 [05:48<06:14,  3.67it/s]
 46%|████▋     | 1185/2560 [05:48<06:10,  3.71it/s]
 46%|████▋     | 1186/2560 [05:48<06:05,  3.76it/s]
                                                   

 46%|████▋     | 1186/2560 [05:48<06:05,  3.76it/s]
 46%|████▋     | 1187/2560 [05:49<06:07,  3.74it/s]
 46%|████▋     | 1188/2560 [05:49<06:03,  3.77it/s]
                                                   

 46%|████▋     | 1188/2560 [05:49<06:03,  3.77it/s]
 46%|████▋     | 1189/2560 [05:49<06:02,  3.78it/s]
 46%|████▋     | 1190/2560 [05:49<05:59,  3.81it/s]
                                                   

 46%|████▋     | 1190/2560 [05:49<05:59,  3.81it/s]
 47%|████▋     | 1191/2560 [05:50<05:58,  3.82it/s]
 47%|████▋     | 1192/2560 [05:50<05:58,  3.82it/s]
                                                   

 47%|████▋     | 1192/2560 [05:50<05:58,  3.82it/s]
 47%|████▋     | 1193/2560 [05:50<05:57,  3.82it/s]
 47%|████▋     | 1194/2560 [05:50<05:56,  3.84it/s]
                                                   

 47%|████▋     | 1194/2560 [05:50<05:56,  3.84it/s]
 47%|████▋     | 1195/2560 [05:51<05:58,  3.81it/s]
 47%|████▋     | 1196/2560 [05:51<05:57,  3.81it/s]
                                                   

 47%|████▋     | 1196/2560 [05:51<05:57,  3.81it/s]
 47%|████▋     | 1197/2560 [05:51<05:57,  3.81it/s]
 47%|████▋     | 1198/2560 [05:51<05:57,  3.81it/s]
                                                   

 47%|████▋     | 1198/2560 [05:51<05:57,  3.81it/s]
 47%|████▋     | 1199/2560 [05:52<06:01,  3.76it/s]
 47%|████▋     | 1200/2560 [05:52<06:05,  3.72it/s]
                                                   

 47%|████▋     | 1200/2560 [05:52<06:05,  3.72it/s]
 47%|████▋     | 1201/2560 [05:52<06:07,  3.70it/s]
 47%|████▋     | 1202/2560 [05:52<06:08,  3.68it/s]
                                                   

 47%|████▋     | 1202/2560 [05:52<06:08,  3.68it/s]
 47%|████▋     | 1203/2560 [05:53<06:09,  3.67it/s]
 47%|████▋     | 1204/2560 [05:53<06:10,  3.66it/s]
                                                   

 47%|████▋     | 1204/2560 [05:53<06:10,  3.66it/s]
 47%|████▋     | 1205/2560 [05:53<06:08,  3.67it/s]
 47%|████▋     | 1206/2560 [05:54<06:09,  3.66it/s]
                                                   

 47%|████▋     | 1206/2560 [05:54<06:09,  3.66it/s]
 47%|████▋     | 1207/2560 [05:54<06:09,  3.66it/s]
 47%|████▋     | 1208/2560 [05:54<06:08,  3.67it/s]
                                                   

 47%|████▋     | 1208/2560 [05:54<06:08,  3.67it/s]
 47%|████▋     | 1209/2560 [05:54<06:08,  3.67it/s]
 47%|████▋     | 1210/2560 [05:55<06:09,  3.65it/s]
                                                   

 47%|████▋     | 1210/2560 [05:55<06:09,  3.65it/s]
 47%|████▋     | 1211/2560 [05:55<06:07,  3.67it/s]
 47%|████▋     | 1212/2560 [05:55<06:06,  3.67it/s]
                                                   

 47%|████▋     | 1212/2560 [05:55<06:06,  3.67it/s]
 47%|████▋     | 1213/2560 [05:55<06:07,  3.66it/s]
 47%|████▋     | 1214/2560 [05:56<06:07,  3.67it/s]
                                                   

 47%|████▋     | 1214/2560 [05:56<06:07,  3.67it/s]
 47%|████▋     | 1215/2560 [05:56<06:05,  3.68it/s]
 48%|████▊     | 1216/2560 [05:56<05:11,  4.31it/s]
                                                   

 48%|████▊     | 1216/2560 [05:56<05:11,  4.31it/s]
 48%|████▊     | 1217/2560 [05:56<05:26,  4.11it/s]
 48%|████▊     | 1218/2560 [05:57<05:39,  3.95it/s]
                                                   

 48%|████▊     | 1218/2560 [05:57<05:39,  3.95it/s]
 48%|████▊     | 1219/2560 [05:57<05:42,  3.92it/s]
 48%|████▊     | 1220/2560 [05:57<05:47,  3.85it/s]
                                                   

 48%|████▊     | 1220/2560 [05:57<05:47,  3.85it/s]
 48%|████▊     | 1221/2560 [05:58<05:50,  3.82it/s]
 48%|████▊     | 1222/2560 [05:58<05:56,  3.76it/s]
                                                   

 48%|████▊     | 1222/2560 [05:58<05:56,  3.76it/s]
 48%|████▊     | 1223/2560 [05:58<05:58,  3.72it/s]
 48%|████▊     | 1224/2560 [05:58<06:00,  3.70it/s]
                                                   

 48%|████▊     | 1224/2560 [05:58<06:00,  3.70it/s]
 48%|████▊     | 1225/2560 [05:59<05:58,  3.72it/s]
 48%|████▊     | 1226/2560 [05:59<05:57,  3.73it/s]
                                                   

 48%|████▊     | 1226/2560 [05:59<05:57,  3.73it/s]
 48%|████▊     | 1227/2560 [05:59<05:59,  3.71it/s]
 48%|████▊     | 1228/2560 [05:59<05:56,  3.74it/s]
                                                   

 48%|████▊     | 1228/2560 [05:59<05:56,  3.74it/s]
 48%|████▊     | 1229/2560 [06:00<05:52,  3.78it/s]
 48%|████▊     | 1230/2560 [06:00<05:52,  3.77it/s]
                                                   

 48%|████▊     | 1230/2560 [06:00<05:52,  3.77it/s]
 48%|████▊     | 1231/2560 [06:00<05:52,  3.77it/s]
 48%|████▊     | 1232/2560 [06:00<05:49,  3.80it/s]
                                                   

 48%|████▊     | 1232/2560 [06:00<05:49,  3.80it/s]
 48%|████▊     | 1233/2560 [06:01<05:48,  3.80it/s]
 48%|████▊     | 1234/2560 [06:01<05:49,  3.80it/s]
                                                   

 48%|████▊     | 1234/2560 [06:01<05:49,  3.80it/s]
 48%|████▊     | 1235/2560 [06:01<05:50,  3.78it/s]
 48%|████▊     | 1236/2560 [06:02<05:52,  3.75it/s]
                                                   

 48%|████▊     | 1236/2560 [06:02<05:52,  3.75it/s]
 48%|████▊     | 1237/2560 [06:02<05:53,  3.74it/s]
 48%|████▊     | 1238/2560 [06:02<05:53,  3.74it/s]
                                                   

 48%|████▊     | 1238/2560 [06:02<05:53,  3.74it/s]
 48%|████▊     | 1239/2560 [06:02<05:54,  3.73it/s]
 48%|████▊     | 1240/2560 [06:03<05:55,  3.72it/s]
                                                   

 48%|████▊     | 1240/2560 [06:03<05:55,  3.72it/s]
 48%|████▊     | 1241/2560 [06:03<05:55,  3.71it/s]
 49%|████▊     | 1242/2560 [06:03<05:54,  3.72it/s]
                                                   

 49%|████▊     | 1242/2560 [06:03<05:54,  3.72it/s]
 49%|████▊     | 1243/2560 [06:03<05:57,  3.68it/s]
 49%|████▊     | 1244/2560 [06:04<06:03,  3.62it/s]
                                                   

 49%|████▊     | 1244/2560 [06:04<06:03,  3.62it/s]
 49%|████▊     | 1245/2560 [06:04<06:11,  3.54it/s]
 49%|████▊     | 1246/2560 [06:04<06:15,  3.50it/s]
                                                   

 49%|████▊     | 1246/2560 [06:04<06:15,  3.50it/s]
 49%|████▊     | 1247/2560 [06:05<06:12,  3.53it/s]
 49%|████▉     | 1248/2560 [06:05<06:11,  3.54it/s]
                                                   

 49%|████▉     | 1248/2560 [06:05<06:11,  3.54it/s]
 49%|████▉     | 1249/2560 [06:05<06:15,  3.49it/s]
 49%|████▉     | 1250/2560 [06:05<06:17,  3.47it/s]
                                                   

 49%|████▉     | 1250/2560 [06:05<06:17,  3.47it/s]
 49%|████▉     | 1251/2560 [06:06<06:29,  3.36it/s]
 49%|████▉     | 1252/2560 [06:06<06:22,  3.42it/s]
                                                   

 49%|████▉     | 1252/2560 [06:06<06:22,  3.42it/s]
 49%|████▉     | 1253/2560 [06:06<06:15,  3.48it/s]
 49%|████▉     | 1254/2560 [06:07<06:08,  3.54it/s]
                                                   

 49%|████▉     | 1254/2560 [06:07<06:08,  3.54it/s]
 49%|████▉     | 1255/2560 [06:07<06:04,  3.58it/s]
 49%|████▉     | 1256/2560 [06:07<06:00,  3.62it/s]
                                                   

 49%|████▉     | 1256/2560 [06:07<06:00,  3.62it/s]
 49%|████▉     | 1257/2560 [06:07<05:58,  3.64it/s]
 49%|████▉     | 1258/2560 [06:08<05:54,  3.67it/s]
                                                   

 49%|████▉     | 1258/2560 [06:08<05:54,  3.67it/s]
 49%|████▉     | 1259/2560 [06:08<05:52,  3.70it/s]
 49%|████▉     | 1260/2560 [06:08<05:54,  3.67it/s]
                                                   

 49%|████▉     | 1260/2560 [06:08<05:54,  3.67it/s]
 49%|████▉     | 1261/2560 [06:08<05:52,  3.69it/s]
 49%|████▉     | 1262/2560 [06:09<05:51,  3.69it/s]
                                                   
{'loss': '0.001449', 'grad_norm': '0.02682', 'learning_rate': '0.0001328', 'epoch': '16.98'}
{'loss': '0.0009902', 'grad_norm': '0.05075', 'learning_rate': '0.0001326', 'epoch': '17'}
{'loss': '0.001844', 'grad_norm': '0.04961', 'learning_rate': '0.0001323', 'epoch': '17.03'}
{'loss': '0.002229', 'grad_norm': '0.06999', 'learning_rate': '0.0001321', 'epoch': '17.06'}
{'loss': '0.003555', 'grad_norm': '0.03858', 'learning_rate': '0.0001319', 'epoch': '17.09'}
{'loss': '0.00266', 'grad_norm': '0.04008', 'learning_rate': '0.0001316', 'epoch': '17.13'}
{'loss': '0.001994', 'grad_norm': '0.05234', 'learning_rate': '0.0001314', 'epoch': '17.16'}
{'loss': '0.002214', 'grad_norm': '0.08806', 'learning_rate': '0.0001311', 'epoch': '17.19'}
{'loss': '0.00278', 'grad_norm': '0.05158', 'learning_rate': '0.0001309', 'epoch': '17.22'}
{'loss': '0.001665', 'grad_norm': '0.05103', 'learning_rate': '0.0001306', 'epoch': '17.25'}
{'loss': '0.003898', 'grad_norm': '0.06282', 'learning_rate': '0.0001304', 'epoch': '17.28'}
{'loss': '0.003486', 'grad_norm': '0.129', 'learning_rate': '0.0001301', 'epoch': '17.31'}
{'loss': '0.002666', 'grad_norm': '0.01885', 'learning_rate': '0.0001299', 'epoch': '17.35'}
{'loss': '0.002851', 'grad_norm': '0.06168', 'learning_rate': '0.0001296', 'epoch': '17.38'}
{'loss': '0.001334', 'grad_norm': '0.01678', 'learning_rate': '0.0001294', 'epoch': '17.41'}
{'loss': '0.00223', 'grad_norm': '0.05577', 'learning_rate': '0.0001292', 'epoch': '17.44'}
{'loss': '0.001352', 'grad_norm': '0.01912', 'learning_rate': '0.0001289', 'epoch': '17.47'}
{'loss': '0.002795', 'grad_norm': '0.09051', 'learning_rate': '0.0001287', 'epoch': '17.5'}
{'loss': '0.001242', 'grad_norm': '0.01327', 'learning_rate': '0.0001284', 'epoch': '17.54'}
{'loss': '0.002815', 'grad_norm': '0.06478', 'learning_rate': '0.0001282', 'epoch': '17.57'}
{'loss': '0.002388', 'grad_norm': '0.02142', 'learning_rate': '0.0001279', 'epoch': '17.6'}
{'loss': '0.002066', 'grad_norm': '0.06271', 'learning_rate': '0.0001277', 'epoch': '17.63'}
{'loss': '0.001328', 'grad_norm': '0.03168', 'learning_rate': '0.0001274', 'epoch': '17.66'}
{'loss': '0.001622', 'grad_norm': '0.0337', 'learning_rate': '0.0001272', 'epoch': '17.69'}
{'loss': '0.002711', 'grad_norm': '0.0181', 'learning_rate': '0.0001269', 'epoch': '17.72'}
{'loss': '0.001682', 'grad_norm': '0.03622', 'learning_rate': '0.0001267', 'epoch': '17.76'}
{'loss': '0.00374', 'grad_norm': '0.06409', 'learning_rate': '0.0001264', 'epoch': '17.79'}
{'loss': '0.00235', 'grad_norm': '0.07367', 'learning_rate': '0.0001262', 'epoch': '17.82'}
{'loss': '0.003327', 'grad_norm': '0.09922', 'learning_rate': '0.0001259', 'epoch': '17.85'}
{'loss': '0.002958', 'grad_norm': '0.05761', 'learning_rate': '0.0001257', 'epoch': '17.88'}
{'loss': '0.00196', 'grad_norm': '0.0402', 'learning_rate': '0.0001254', 'epoch': '17.91'}
{'loss': '0.001502', 'grad_norm': '0.01844', 'learning_rate': '0.0001252', 'epoch': '17.94'}
{'loss': '0.001309', 'grad_norm': '0.03567', 'learning_rate': '0.0001249', 'epoch': '17.98'}
{'loss': '0.001382', 'grad_norm': '0.02624', 'learning_rate': '0.0001247', 'epoch': '18'}
{'loss': '0.001482', 'grad_norm': '0.03514', 'learning_rate': '0.0001244', 'epoch': '18.03'}
{'loss': '0.00114', 'grad_norm': '0.02575', 'learning_rate': '0.0001242', 'epoch': '18.06'}
{'loss': '0.002415', 'grad_norm': '0.03893', 'learning_rate': '0.0001239', 'epoch': '18.09'}
{'loss': '0.001993', 'grad_norm': '0.04649', 'learning_rate': '0.0001237', 'epoch': '18.13'}
{'loss': '0.002986', 'grad_norm': '0.08302', 'learning_rate': '0.0001234', 'epoch': '18.16'}
{'loss': '0.001924', 'grad_norm': '0.02014', 'learning_rate': '0.0001232', 'epoch': '18.19'}
{'loss': '0.001441', 'grad_norm': '0.02445', 'learning_rate': '0.0001229', 'epoch': '18.22'}
{'loss': '0.00163', 'grad_norm': '0.04136', 'learning_rate': '0.0001227', 'epoch': '18.25'}
{'loss': '0.002057', 'grad_norm': '0.02132', 'learning_rate': '0.0001224', 'epoch': '18.28'}
{'loss': '0.001516', 'grad_norm': '0.04257', 'learning_rate': '0.0001222', 'epoch': '18.31'}
{'loss': '0.001684', 'grad_norm': '0.01675', 'learning_rate': '0.0001219', 'epoch': '18.35'}
{'loss': '0.002468', 'grad_norm': '0.04272', 'learning_rate': '0.0001217', 'epoch': '18.38'}
{'loss': '0.002164', 'grad_norm': '0.04475', 'learning_rate': '0.0001214', 'epoch': '18.41'}
{'loss': '0.002601', 'grad_norm': '0.05484', 'learning_rate': '0.0001212', 'epoch': '18.44'}
{'loss': '0.00115', 'grad_norm': '0.06268', 'learning_rate': '0.0001209', 'epoch': '18.47'}
{'loss': '0.00307', 'grad_norm': '0.08919', 'learning_rate': '0.0001206', 'epoch': '18.5'}
{'loss': '0.00302', 'grad_norm': '0.05761', 'learning_rate': '0.0001204', 'epoch': '18.54'}
{'loss': '0.00148', 'grad_norm': '0.0496', 'learning_rate': '0.0001201', 'epoch': '18.57'}
{'loss': '0.00188', 'grad_norm': '0.03534', 'learning_rate': '0.0001199', 'epoch': '18.6'}
{'loss': '0.003389', 'grad_norm': '0.06044', 'learning_rate': '0.0001196', 'epoch': '18.63'}
{'loss': '0.001456', 'grad_norm': '0.04087', 'learning_rate': '0.0001194', 'epoch': '18.66'}
{'loss': '0.002922', 'grad_norm': '0.09637', 'learning_rate': '0.0001191', 'epoch': '18.69'}
{'loss': '0.002413', 'grad_norm': '0.08652', 'learning_rate': '0.0001189', 'epoch': '18.72'}
{'loss': '0.002755', 'grad_norm': '0.06422', 'learning_rate': '0.0001186', 'epoch': '18.76'}
{'loss': '0.002375', 'grad_norm': '0.04125', 'learning_rate': '0.0001184', 'epoch': '18.79'}
{'loss': '0.002034', 'grad_norm': '0.05442', 'learning_rate': '0.0001181', 'epoch': '18.82'}
{'loss': '0.002042', 'grad_norm': '0.05893', 'learning_rate': '0.0001179', 'epoch': '18.85'}
{'loss': '0.001633', 'grad_norm': '0.04792', 'learning_rate': '0.0001176', 'epoch': '18.88'}
{'loss': '0.002383', 'grad_norm': '0.06159', 'learning_rate': '0.0001174', 'epoch': '18.91'}
{'loss': '0.001531', 'grad_norm': '0.02144', 'learning_rate': '0.0001171', 'epoch': '18.94'}
{'loss': '0.003117', 'grad_norm': '0.07648', 'learning_rate': '0.0001168', 'epoch': '18.98'}
{'loss': '0.001438', 'grad_norm': '0.05632', 'learning_rate': '0.0001166', 'epoch': '19'}
{'loss': '0.0009072', 'grad_norm': '0.01626', 'learning_rate': '0.0001163', 'epoch': '19.03'}
{'loss': '0.001792', 'grad_norm': '0.02128', 'learning_rate': '0.0001161', 'epoch': '19.06'}
{'loss': '0.00127', 'grad_norm': '0.01715', 'learning_rate': '0.0001158', 'epoch': '19.09'}
{'loss': '0.00148', 'grad_norm': '0.03429', 'learning_rate': '0.0001156', 'epoch': '19.13'}
{'loss': '0.001993', 'grad_norm': '0.03426', 'learning_rate': '0.0001153', 'epoch': '19.16'}
{'loss': '0.001358', 'grad_norm': '0.0166', 'learning_rate': '0.0001151', 'epoch': '19.19'}
{'loss': '0.002266', 'grad_norm': '0.07119', 'learning_rate': '0.0001148', 'epoch': '19.22'}
{'loss': '0.00158', 'grad_norm': '0.04382', 'learning_rate': '0.0001145', 'epoch': '19.25'}
{'loss': '0.003072', 'grad_norm': '0.04577', 'learning_rate': '0.0001143', 'epoch': '19.28'}
{'loss': '0.002155', 'grad_norm': '0.1822', 'learning_rate': '0.000114', 'epoch': '19.31'}
{'loss': '0.001477', 'grad_norm': '0.02826', 'learning_rate': '0.0001138', 'epoch': '19.35'}
{'loss': '0.002924', 'grad_norm': '0.06464', 'learning_rate': '0.0001135', 'epoch': '19.38'}
{'loss': '0.002087', 'grad_norm': '0.07039', 'learning_rate': '0.0001133', 'epoch': '19.41'}
{'loss': '0.001727', 'grad_norm': '0.03546', 'learning_rate': '0.000113', 'epoch': '19.44'}
{'loss': '0.001751', 'grad_norm': '0.04927', 'learning_rate': '0.0001128', 'epoch': '19.47'}
{'loss': '0.004123', 'grad_norm': '0.04749', 'learning_rate': '0.0001125', 'epoch': '19.5'}
{'loss': '0.002021', 'grad_norm': '0.06212', 'learning_rate': '0.0001122', 'epoch': '19.54'}
{'loss': '0.001429', 'grad_norm': '0.0593', 'learning_rate': '0.000112', 'epoch': '19.57'}
{'loss': '0.003156', 'grad_norm': '0.1036', 'learning_rate': '0.0001117', 'epoch': '19.6'}
{'loss': '0.00226', 'grad_norm': '0.04847', 'learning_rate': '0.0001115', 'epoch': '19.63'}
{'loss': '0.001572', 'grad_norm': '0.06071', 'learning_rate': '0.0001112', 'epoch': '19.66'}
{'loss': '0.002528', 'grad_norm': '0.02753', 'learning_rate': '0.000111', 'epoch': '19.69'}
{'loss': '0.001759', 'grad_norm': '0.02042', 'learning_rate': '0.0001107', 'epoch': '19.72'}
 49%|████▉     | 1262/2560 [06:09<05:51,  3.69it/s]
 49%|████▉     | 1263/2560 [06:09<05:50,  3.70it/s]
 49%|████▉     | 1264/2560 [06:09<05:49,  3.71it/s]
                                                   

 49%|████▉     | 1264/2560 [06:09<05:49,  3.71it/s]
 49%|████▉     | 1265/2560 [06:10<05:51,  3.68it/s]
 49%|████▉     | 1266/2560 [06:10<05:49,  3.70it/s]
                                                   

 49%|████▉     | 1266/2560 [06:10<05:49,  3.70it/s]
 49%|████▉     | 1267/2560 [06:10<05:47,  3.72it/s]
 50%|████▉     | 1268/2560 [06:10<05:45,  3.74it/s]
                                                   

 50%|████▉     | 1268/2560 [06:10<05:45,  3.74it/s]
 50%|████▉     | 1269/2560 [06:11<05:45,  3.73it/s]
 50%|████▉     | 1270/2560 [06:11<05:44,  3.75it/s]
                                                   

 50%|████▉     | 1270/2560 [06:11<05:44,  3.75it/s]
 50%|████▉     | 1271/2560 [06:11<05:46,  3.72it/s]
 50%|████▉     | 1272/2560 [06:11<05:46,  3.72it/s]
                                                   

 50%|████▉     | 1272/2560 [06:11<05:46,  3.72it/s]
 50%|████▉     | 1273/2560 [06:12<05:46,  3.72it/s]
 50%|████▉     | 1274/2560 [06:12<05:44,  3.73it/s]
                                                   

 50%|████▉     | 1274/2560 [06:12<05:44,  3.73it/s]
 50%|████▉     | 1275/2560 [06:12<05:45,  3.72it/s]
 50%|████▉     | 1276/2560 [06:13<05:44,  3.73it/s]
                                                   

 50%|████▉     | 1276/2560 [06:13<05:44,  3.73it/s]
 50%|████▉     | 1277/2560 [06:13<05:42,  3.74it/s]
 50%|████▉     | 1278/2560 [06:13<05:42,  3.74it/s]
                                                   

 50%|████▉     | 1278/2560 [06:13<05:42,  3.74it/s]
 50%|████▉     | 1279/2560 [06:13<05:42,  3.73it/s]
 50%|█████     | 1280/2560 [06:13<04:53,  4.37it/s]
                                                   

 50%|█████     | 1280/2560 [06:13<04:53,  4.37it/s]
 50%|█████     | 1281/2560 [06:14<05:08,  4.14it/s]
 50%|█████     | 1282/2560 [06:14<05:20,  3.99it/s]
                                                   

 50%|█████     | 1282/2560 [06:14<05:20,  3.99it/s]
 50%|█████     | 1283/2560 [06:14<05:29,  3.87it/s]
 50%|█████     | 1284/2560 [06:15<05:37,  3.79it/s]
                                                   

 50%|█████     | 1284/2560 [06:15<05:37,  3.79it/s]
 50%|█████     | 1285/2560 [06:15<05:42,  3.72it/s]
 50%|█████     | 1286/2560 [06:15<05:42,  3.72it/s]
                                                   

 50%|█████     | 1286/2560 [06:15<05:42,  3.72it/s]
 50%|█████     | 1287/2560 [06:15<05:44,  3.70it/s]
 50%|█████     | 1288/2560 [06:16<05:45,  3.68it/s]
                                                   

 50%|█████     | 1288/2560 [06:16<05:45,  3.68it/s]
 50%|█████     | 1289/2560 [06:16<05:46,  3.66it/s]
 50%|█████     | 1290/2560 [06:16<05:46,  3.67it/s]
                                                   

 50%|█████     | 1290/2560 [06:16<05:46,  3.67it/s]
 50%|█████     | 1291/2560 [06:16<05:44,  3.68it/s]
 50%|█████     | 1292/2560 [06:17<05:44,  3.68it/s]
                                                   

 50%|█████     | 1292/2560 [06:17<05:44,  3.68it/s]
 51%|█████     | 1293/2560 [06:17<05:42,  3.69it/s]
 51%|█████     | 1294/2560 [06:17<05:46,  3.65it/s]
                                                   

 51%|█████     | 1294/2560 [06:17<05:46,  3.65it/s]
 51%|█████     | 1295/2560 [06:18<05:48,  3.63it/s]
 51%|█████     | 1296/2560 [06:18<05:45,  3.66it/s]
                                                   

 51%|█████     | 1296/2560 [06:18<05:45,  3.66it/s]
 51%|█████     | 1297/2560 [06:18<05:44,  3.67it/s]
 51%|█████     | 1298/2560 [06:18<05:44,  3.66it/s]
                                                   

 51%|█████     | 1298/2560 [06:18<05:44,  3.66it/s]
 51%|█████     | 1299/2560 [06:19<05:44,  3.66it/s]
 51%|█████     | 1300/2560 [06:19<05:43,  3.67it/s]
                                                   

 51%|█████     | 1300/2560 [06:19<05:43,  3.67it/s]
 51%|█████     | 1301/2560 [06:19<05:42,  3.68it/s]
 51%|█████     | 1302/2560 [06:19<05:41,  3.68it/s]
                                                   

 51%|█████     | 1302/2560 [06:19<05:41,  3.68it/s]
 51%|█████     | 1303/2560 [06:20<05:41,  3.68it/s]
 51%|█████     | 1304/2560 [06:20<05:38,  3.71it/s]
                                                   

 51%|█████     | 1304/2560 [06:20<05:38,  3.71it/s]
 51%|█████     | 1305/2560 [06:20<05:41,  3.68it/s]
 51%|█████     | 1306/2560 [06:21<05:37,  3.71it/s]
                                                   

 51%|█████     | 1306/2560 [06:21<05:37,  3.71it/s]
 51%|█████     | 1307/2560 [06:21<05:38,  3.70it/s]
 51%|█████     | 1308/2560 [06:21<05:33,  3.75it/s]
                                                   

 51%|█████     | 1308/2560 [06:21<05:33,  3.75it/s]
 51%|█████     | 1309/2560 [06:21<05:31,  3.77it/s]
 51%|█████     | 1310/2560 [06:22<05:33,  3.75it/s]
                                                   

 51%|█████     | 1310/2560 [06:22<05:33,  3.75it/s]
 51%|█████     | 1311/2560 [06:22<05:32,  3.75it/s]
 51%|█████▏    | 1312/2560 [06:22<05:36,  3.71it/s]
                                                   

 51%|█████▏    | 1312/2560 [06:22<05:36,  3.71it/s]
 51%|█████▏    | 1313/2560 [06:22<05:37,  3.70it/s]
 51%|█████▏    | 1314/2560 [06:23<05:37,  3.69it/s]
                                                   

 51%|█████▏    | 1314/2560 [06:23<05:37,  3.69it/s]
 51%|█████▏    | 1315/2560 [06:23<05:35,  3.71it/s]
 51%|█████▏    | 1316/2560 [06:23<05:34,  3.72it/s]
                                                   

 51%|█████▏    | 1316/2560 [06:23<05:34,  3.72it/s]
 51%|█████▏    | 1317/2560 [06:23<05:35,  3.70it/s]
 51%|█████▏    | 1318/2560 [06:24<05:35,  3.71it/s]
                                                   

 51%|█████▏    | 1318/2560 [06:24<05:35,  3.71it/s]
 52%|█████▏    | 1319/2560 [06:24<05:34,  3.71it/s]
 52%|█████▏    | 1320/2560 [06:24<05:35,  3.69it/s]
                                                   

 52%|█████▏    | 1320/2560 [06:24<05:35,  3.69it/s]
 52%|█████▏    | 1321/2560 [06:25<05:31,  3.73it/s]
 52%|█████▏    | 1322/2560 [06:25<05:28,  3.77it/s]
                                                   

 52%|█████▏    | 1322/2560 [06:25<05:28,  3.77it/s]
 52%|█████▏    | 1323/2560 [06:25<05:28,  3.77it/s]
 52%|█████▏    | 1324/2560 [06:25<05:26,  3.79it/s]
                                                   

 52%|█████▏    | 1324/2560 [06:25<05:26,  3.79it/s]
 52%|█████▏    | 1325/2560 [06:26<05:23,  3.82it/s]
 52%|█████▏    | 1326/2560 [06:26<05:22,  3.83it/s]
                                                   

 52%|█████▏    | 1326/2560 [06:26<05:22,  3.83it/s]
 52%|█████▏    | 1327/2560 [06:26<05:22,  3.82it/s]
 52%|█████▏    | 1328/2560 [06:26<05:23,  3.81it/s]
                                                   

 52%|█████▏    | 1328/2560 [06:26<05:23,  3.81it/s]
 52%|█████▏    | 1329/2560 [06:27<05:22,  3.81it/s]
 52%|█████▏    | 1330/2560 [06:27<05:21,  3.83it/s]
                                                   

 52%|█████▏    | 1330/2560 [06:27<05:21,  3.83it/s]
 52%|█████▏    | 1331/2560 [06:27<05:20,  3.83it/s]
 52%|█████▏    | 1332/2560 [06:27<05:20,  3.83it/s]
                                                   

 52%|█████▏    | 1332/2560 [06:27<05:20,  3.83it/s]
 52%|█████▏    | 1333/2560 [06:28<05:19,  3.84it/s]
 52%|█████▏    | 1334/2560 [06:28<05:19,  3.83it/s]
                                                   

 52%|█████▏    | 1334/2560 [06:28<05:19,  3.83it/s]
 52%|█████▏    | 1335/2560 [06:28<05:25,  3.76it/s]
 52%|█████▏    | 1336/2560 [06:29<05:32,  3.68it/s]
                                                   

 52%|█████▏    | 1336/2560 [06:29<05:32,  3.68it/s]
 52%|█████▏    | 1337/2560 [06:29<05:34,  3.66it/s]
 52%|█████▏    | 1338/2560 [06:29<05:32,  3.68it/s]
                                                   

 52%|█████▏    | 1338/2560 [06:29<05:32,  3.68it/s]
 52%|█████▏    | 1339/2560 [06:29<05:28,  3.71it/s]
 52%|█████▏    | 1340/2560 [06:30<05:28,  3.72it/s]
                                                   

 52%|█████▏    | 1340/2560 [06:30<05:28,  3.72it/s]
 52%|█████▏    | 1341/2560 [06:30<05:27,  3.72it/s]
 52%|█████▏    | 1342/2560 [06:30<05:23,  3.76it/s]
                                                   

 52%|█████▏    | 1342/2560 [06:30<05:23,  3.76it/s]
 52%|█████▏    | 1343/2560 [06:30<05:24,  3.75it/s]
 52%|█████▎    | 1344/2560 [06:31<04:35,  4.41it/s]
                                                   

 52%|█████▎    | 1344/2560 [06:31<04:35,  4.41it/s]
 53%|█████▎    | 1345/2560 [06:31<04:50,  4.18it/s]
 53%|█████▎    | 1346/2560 [06:31<05:09,  3.92it/s]
                                                   

 53%|█████▎    | 1346/2560 [06:31<05:09,  3.92it/s]
 53%|█████▎    | 1347/2560 [06:31<05:15,  3.85it/s]
 53%|█████▎    | 1348/2560 [06:32<05:18,  3.80it/s]
                                                   

 53%|█████▎    | 1348/2560 [06:32<05:18,  3.80it/s]
 53%|█████▎    | 1349/2560 [06:32<05:16,  3.83it/s]
 53%|█████▎    | 1350/2560 [06:32<05:14,  3.85it/s]
                                                   

 53%|█████▎    | 1350/2560 [06:32<05:14,  3.85it/s]
 53%|█████▎    | 1351/2560 [06:32<05:13,  3.85it/s]
 53%|█████▎    | 1352/2560 [06:33<05:14,  3.85it/s]
                                                   

 53%|█████▎    | 1352/2560 [06:33<05:14,  3.85it/s]
 53%|█████▎    | 1353/2560 [06:33<05:17,  3.81it/s]
 53%|█████▎    | 1354/2560 [06:33<05:15,  3.83it/s]
                                                   

 53%|█████▎    | 1354/2560 [06:33<05:15,  3.83it/s]
 53%|█████▎    | 1355/2560 [06:33<05:14,  3.83it/s]
 53%|█████▎    | 1356/2560 [06:34<05:13,  3.84it/s]
                                                   

 53%|█████▎    | 1356/2560 [06:34<05:13,  3.84it/s]
 53%|█████▎    | 1357/2560 [06:34<05:13,  3.84it/s]
 53%|█████▎    | 1358/2560 [06:34<05:12,  3.85it/s]
                                                   

 53%|█████▎    | 1358/2560 [06:34<05:12,  3.85it/s]
 53%|█████▎    | 1359/2560 [06:34<05:11,  3.85it/s]
 53%|█████▎    | 1360/2560 [06:35<05:11,  3.85it/s]
                                                   

 53%|█████▎    | 1360/2560 [06:35<05:11,  3.85it/s]
 53%|█████▎    | 1361/2560 [06:35<05:09,  3.87it/s]
 53%|█████▎    | 1362/2560 [06:35<05:09,  3.87it/s]
                                                   

 53%|█████▎    | 1362/2560 [06:35<05:09,  3.87it/s]
 53%|█████▎    | 1363/2560 [06:36<05:09,  3.87it/s]
 53%|█████▎    | 1364/2560 [06:36<05:09,  3.87it/s]
                                                   

 53%|█████▎    | 1364/2560 [06:36<05:09,  3.87it/s]
 53%|█████▎    | 1365/2560 [06:36<05:09,  3.86it/s]
 53%|█████▎    | 1366/2560 [06:36<05:13,  3.81it/s]
                                                   

 53%|█████▎    | 1366/2560 [06:36<05:13,  3.81it/s]
 53%|█████▎    | 1367/2560 [06:37<05:14,  3.79it/s]
 53%|█████▎    | 1368/2560 [06:37<05:15,  3.78it/s]
                                                   

 53%|█████▎    | 1368/2560 [06:37<05:15,  3.78it/s]
 53%|█████▎    | 1369/2560 [06:37<05:13,  3.80it/s]
 54%|█████▎    | 1370/2560 [06:37<05:10,  3.83it/s]
                                                   

 54%|█████▎    | 1370/2560 [06:37<05:10,  3.83it/s]
 54%|█████▎    | 1371/2560 [06:38<05:13,  3.79it/s]
 54%|█████▎    | 1372/2560 [06:38<05:15,  3.77it/s]
                                                   

 54%|█████▎    | 1372/2560 [06:38<05:15,  3.77it/s]
 54%|█████▎    | 1373/2560 [06:38<05:19,  3.71it/s]
 54%|█████▎    | 1374/2560 [06:38<05:24,  3.66it/s]
                                                   

 54%|█████▎    | 1374/2560 [06:38<05:24,  3.66it/s]
 54%|█████▎    | 1375/2560 [06:39<05:26,  3.63it/s]
 54%|█████▍    | 1376/2560 [06:39<05:29,  3.60it/s]
                                                   

 54%|█████▍    | 1376/2560 [06:39<05:29,  3.60it/s]
 54%|█████▍    | 1377/2560 [06:39<05:32,  3.56it/s]
 54%|█████▍    | 1378/2560 [06:40<05:31,  3.56it/s]
                                                   

 54%|█████▍    | 1378/2560 [06:40<05:31,  3.56it/s]
 54%|█████▍    | 1379/2560 [06:40<05:30,  3.58it/s]
 54%|█████▍    | 1380/2560 [06:40<05:24,  3.64it/s]
                                                   

 54%|█████▍    | 1380/2560 [06:40<05:24,  3.64it/s]
 54%|█████▍    | 1381/2560 [06:40<05:19,  3.69it/s]
 54%|█████▍    | 1382/2560 [06:41<05:17,  3.71it/s]
                                                   

 54%|█████▍    | 1382/2560 [06:41<05:17,  3.71it/s]
 54%|█████▍    | 1383/2560 [06:41<05:15,  3.73it/s]
 54%|█████▍    | 1384/2560 [06:41<05:14,  3.75it/s]
                                                   

 54%|█████▍    | 1384/2560 [06:41<05:14,  3.75it/s]
 54%|█████▍    | 1385/2560 [06:41<05:12,  3.76it/s]
 54%|█████▍    | 1386/2560 [06:42<05:13,  3.75it/s]
                                                   

 54%|█████▍    | 1386/2560 [06:42<05:13,  3.75it/s]
 54%|█████▍    | 1387/2560 [06:42<05:10,  3.77it/s]
 54%|█████▍    | 1388/2560 [06:42<05:09,  3.79it/s]
                                                   

 54%|█████▍    | 1388/2560 [06:42<05:09,  3.79it/s]
 54%|█████▍    | 1389/2560 [06:43<05:07,  3.80it/s]
 54%|█████▍    | 1390/2560 [06:43<05:06,  3.82it/s]
                                                   

 54%|█████▍    | 1390/2560 [06:43<05:06,  3.82it/s]
 54%|█████▍    | 1391/2560 [06:43<05:05,  3.83it/s]
 54%|█████▍    | 1392/2560 [06:43<05:04,  3.84it/s]
                                                   

 54%|█████▍    | 1392/2560 [06:43<05:04,  3.84it/s]
 54%|█████▍    | 1393/2560 [06:44<05:04,  3.83it/s]
 54%|█████▍    | 1394/2560 [06:44<05:03,  3.84it/s]
                                                   

 54%|█████▍    | 1394/2560 [06:44<05:03,  3.84it/s]
 54%|█████▍    | 1395/2560 [06:44<05:02,  3.85it/s]
 55%|█████▍    | 1396/2560 [06:44<05:03,  3.83it/s]
                                                   

 55%|█████▍    | 1396/2560 [06:44<05:03,  3.83it/s]
 55%|█████▍    | 1397/2560 [06:45<05:04,  3.82it/s]
 55%|█████▍    | 1398/2560 [06:45<05:04,  3.82it/s]
                                                   

 55%|█████▍    | 1398/2560 [06:45<05:04,  3.82it/s]
 55%|█████▍    | 1399/2560 [06:45<05:03,  3.83it/s]
 55%|█████▍    | 1400/2560 [06:45<05:02,  3.83it/s]
                                                   

 55%|█████▍    | 1400/2560 [06:45<05:02,  3.83it/s]
 55%|█████▍    | 1401/2560 [06:46<05:02,  3.83it/s]
 55%|█████▍    | 1402/2560 [06:46<05:02,  3.83it/s]
                                                   

 55%|█████▍    | 1402/2560 [06:46<05:02,  3.83it/s]
 55%|█████▍    | 1403/2560 [06:46<05:02,  3.83it/s]
 55%|█████▍    | 1404/2560 [06:46<05:01,  3.83it/s]
                                                   

 55%|█████▍    | 1404/2560 [06:46<05:01,  3.83it/s]
 55%|█████▍    | 1405/2560 [06:47<05:02,  3.82it/s]
 55%|█████▍    | 1406/2560 [06:47<05:02,  3.81it/s]
                                                   

 55%|█████▍    | 1406/2560 [06:47<05:02,  3.81it/s]
 55%|█████▍    | 1407/2560 [06:47<05:02,  3.81it/s]
 55%|█████▌    | 1408/2560 [06:47<04:16,  4.48it/s]
                                                   

 55%|█████▌    | 1408/2560 [06:47<04:16,  4.48it/s]
 55%|█████▌    | 1409/2560 [06:48<04:31,  4.24it/s]
 55%|█████▌    | 1410/2560 [06:48<04:41,  4.08it/s]
                                                   

 55%|█████▌    | 1410/2560 [06:48<04:41,  4.08it/s]
 55%|█████▌    | 1411/2560 [06:48<04:47,  4.00it/s]
 55%|█████▌    | 1412/2560 [06:48<04:52,  3.92it/s]
                                                   

 55%|█████▌    | 1412/2560 [06:48<04:52,  3.92it/s]
 55%|█████▌    | 1413/2560 [06:49<04:56,  3.86it/s]
 55%|█████▌    | 1414/2560 [06:49<04:59,  3.83it/s]
                                                   

 55%|█████▌    | 1414/2560 [06:49<04:59,  3.83it/s]
 55%|█████▌    | 1415/2560 [06:49<05:00,  3.81it/s]
 55%|█████▌    | 1416/2560 [06:49<05:01,  3.79it/s]
                                                   

 55%|█████▌    | 1416/2560 [06:49<05:01,  3.79it/s]
 55%|█████▌    | 1417/2560 [06:50<05:02,  3.78it/s]
 55%|█████▌    | 1418/2560 [06:50<04:58,  3.83it/s]
                                                   

 55%|█████▌    | 1418/2560 [06:50<04:58,  3.83it/s]
 55%|█████▌    | 1419/2560 [06:50<05:00,  3.80it/s]
 55%|█████▌    | 1420/2560 [06:51<04:58,  3.82it/s]
                                                   

 55%|█████▌    | 1420/2560 [06:51<04:58,  3.82it/s]
 56%|█████▌    | 1421/2560 [06:51<04:59,  3.80it/s]
 56%|█████▌    | 1422/2560 [06:51<04:58,  3.81it/s]
                                                   

 56%|█████▌    | 1422/2560 [06:51<04:58,  3.81it/s]
 56%|█████▌    | 1423/2560 [06:51<04:56,  3.83it/s]
 56%|█████▌    | 1424/2560 [06:52<04:58,  3.81it/s]
                                                   

 56%|█████▌    | 1424/2560 [06:52<04:58,  3.81it/s]
 56%|█████▌    | 1425/2560 [06:52<04:58,  3.80it/s]
 56%|█████▌    | 1426/2560 [06:52<04:56,  3.82it/s]
                                                   

 56%|█████▌    | 1426/2560 [06:52<04:56,  3.82it/s]
 56%|█████▌    | 1427/2560 [06:52<04:55,  3.83it/s]
 56%|█████▌    | 1428/2560 [06:53<04:55,  3.83it/s]
                                                   

 56%|█████▌    | 1428/2560 [06:53<04:55,  3.83it/s]
 56%|█████▌    | 1429/2560 [06:53<04:55,  3.83it/s]
 56%|█████▌    | 1430/2560 [06:53<04:53,  3.84it/s]
                                                   

 56%|█████▌    | 1430/2560 [06:53<04:53,  3.84it/s]
 56%|█████▌    | 1431/2560 [06:53<04:54,  3.83it/s]
 56%|█████▌    | 1432/2560 [06:54<04:56,  3.80it/s]
                                                   

 56%|█████▌    | 1432/2560 [06:54<04:56,  3.80it/s]
 56%|█████▌    | 1433/2560 [06:54<04:58,  3.78it/s]
 56%|█████▌    | 1434/2560 [06:54<04:58,  3.77it/s]
                                                   

 56%|█████▌    | 1434/2560 [06:54<04:58,  3.77it/s]
 56%|█████▌    | 1435/2560 [06:54<05:00,  3.74it/s]
 56%|█████▌    | 1436/2560 [06:55<04:59,  3.75it/s]
                                                   

 56%|█████▌    | 1436/2560 [06:55<04:59,  3.75it/s]
 56%|█████▌    | 1437/2560 [06:55<04:59,  3.75it/s]
 56%|█████▌    | 1438/2560 [06:55<05:00,  3.73it/s]
                                                   

 56%|█████▌    | 1438/2560 [06:55<05:00,  3.73it/s]
 56%|█████▌    | 1439/2560 [06:56<04:59,  3.74it/s]
 56%|█████▋    | 1440/2560 [06:56<05:01,  3.72it/s]
                                                   
{'loss': '0.002012', 'grad_norm': '0.02222', 'learning_rate': '0.0001104', 'epoch': '19.76'}
{'loss': '0.001359', 'grad_norm': '0.02018', 'learning_rate': '0.0001102', 'epoch': '19.79'}
{'loss': '0.001859', 'grad_norm': '0.08586', 'learning_rate': '0.0001099', 'epoch': '19.82'}
{'loss': '0.002263', 'grad_norm': '0.07777', 'learning_rate': '0.0001097', 'epoch': '19.85'}
{'loss': '0.002025', 'grad_norm': '0.06662', 'learning_rate': '0.0001094', 'epoch': '19.88'}
{'loss': '0.001307', 'grad_norm': '0.02185', 'learning_rate': '0.0001092', 'epoch': '19.91'}
{'loss': '0.001932', 'grad_norm': '0.05611', 'learning_rate': '0.0001089', 'epoch': '19.94'}
{'loss': '0.003121', 'grad_norm': '0.08632', 'learning_rate': '0.0001086', 'epoch': '19.98'}
{'loss': '0.003884', 'grad_norm': '0.1046', 'learning_rate': '0.0001084', 'epoch': '20'}
{'loss': '0.001983', 'grad_norm': '0.0536', 'learning_rate': '0.0001081', 'epoch': '20.03'}
{'loss': '0.003518', 'grad_norm': '0.07875', 'learning_rate': '0.0001079', 'epoch': '20.06'}
{'loss': '0.001516', 'grad_norm': '0.01757', 'learning_rate': '0.0001076', 'epoch': '20.09'}
{'loss': '0.001626', 'grad_norm': '0.07437', 'learning_rate': '0.0001074', 'epoch': '20.13'}
{'loss': '0.00213', 'grad_norm': '0.02039', 'learning_rate': '0.0001071', 'epoch': '20.16'}
{'loss': '0.002666', 'grad_norm': '0.03902', 'learning_rate': '0.0001068', 'epoch': '20.19'}
{'loss': '0.001539', 'grad_norm': '0.02174', 'learning_rate': '0.0001066', 'epoch': '20.22'}
{'loss': '0.001282', 'grad_norm': '0.02687', 'learning_rate': '0.0001063', 'epoch': '20.25'}
{'loss': '0.001496', 'grad_norm': '0.01969', 'learning_rate': '0.0001061', 'epoch': '20.28'}
{'loss': '0.002024', 'grad_norm': '0.01792', 'learning_rate': '0.0001058', 'epoch': '20.31'}
{'loss': '0.0029', 'grad_norm': '0.08564', 'learning_rate': '0.0001056', 'epoch': '20.35'}
{'loss': '0.001345', 'grad_norm': '0.03335', 'learning_rate': '0.0001053', 'epoch': '20.38'}
{'loss': '0.001247', 'grad_norm': '0.01345', 'learning_rate': '0.000105', 'epoch': '20.41'}
{'loss': '0.00187', 'grad_norm': '0.04344', 'learning_rate': '0.0001048', 'epoch': '20.44'}
{'loss': '0.001594', 'grad_norm': '0.04739', 'learning_rate': '0.0001045', 'epoch': '20.47'}
{'loss': '0.002224', 'grad_norm': '0.02029', 'learning_rate': '0.0001043', 'epoch': '20.5'}
{'loss': '0.001612', 'grad_norm': '0.02915', 'learning_rate': '0.000104', 'epoch': '20.54'}
{'loss': '0.002173', 'grad_norm': '0.04787', 'learning_rate': '0.0001037', 'epoch': '20.57'}
{'loss': '0.001618', 'grad_norm': '0.03', 'learning_rate': '0.0001035', 'epoch': '20.6'}
{'loss': '0.00224', 'grad_norm': '0.0693', 'learning_rate': '0.0001032', 'epoch': '20.63'}
{'loss': '0.002326', 'grad_norm': '0.1144', 'learning_rate': '0.000103', 'epoch': '20.66'}
{'loss': '0.001985', 'grad_norm': '0.07032', 'learning_rate': '0.0001027', 'epoch': '20.69'}
{'loss': '0.003131', 'grad_norm': '0.05935', 'learning_rate': '0.0001025', 'epoch': '20.72'}
{'loss': '0.001644', 'grad_norm': '0.01765', 'learning_rate': '0.0001022', 'epoch': '20.76'}
{'loss': '0.001508', 'grad_norm': '0.03867', 'learning_rate': '0.0001019', 'epoch': '20.79'}
{'loss': '0.001551', 'grad_norm': '0.02189', 'learning_rate': '0.0001017', 'epoch': '20.82'}
{'loss': '0.002191', 'grad_norm': '0.0368', 'learning_rate': '0.0001014', 'epoch': '20.85'}
{'loss': '0.002846', 'grad_norm': '0.1311', 'learning_rate': '0.0001012', 'epoch': '20.88'}
{'loss': '0.001528', 'grad_norm': '0.02271', 'learning_rate': '0.0001009', 'epoch': '20.91'}
{'loss': '0.0019', 'grad_norm': '0.06672', 'learning_rate': '0.0001006', 'epoch': '20.94'}
{'loss': '0.002358', 'grad_norm': '0.05893', 'learning_rate': '0.0001004', 'epoch': '20.98'}
{'loss': '0.0009781', 'grad_norm': '0.04518', 'learning_rate': '0.0001001', 'epoch': '21'}
{'loss': '0.002144', 'grad_norm': '0.07081', 'learning_rate': '9.987e-05', 'epoch': '21.03'}
{'loss': '0.00181', 'grad_norm': '0.06768', 'learning_rate': '9.961e-05', 'epoch': '21.06'}
{'loss': '0.001656', 'grad_norm': '0.04149', 'learning_rate': '9.935e-05', 'epoch': '21.09'}
{'loss': '0.001426', 'grad_norm': '0.03368', 'learning_rate': '9.91e-05', 'epoch': '21.13'}
{'loss': '0.002535', 'grad_norm': '0.01622', 'learning_rate': '9.884e-05', 'epoch': '21.16'}
{'loss': '0.001762', 'grad_norm': '0.01619', 'learning_rate': '9.858e-05', 'epoch': '21.19'}
{'loss': '0.002532', 'grad_norm': '0.1608', 'learning_rate': '9.832e-05', 'epoch': '21.22'}
{'loss': '0.001654', 'grad_norm': '0.04016', 'learning_rate': '9.806e-05', 'epoch': '21.25'}
{'loss': '0.002291', 'grad_norm': '0.06398', 'learning_rate': '9.78e-05', 'epoch': '21.28'}
{'loss': '0.002069', 'grad_norm': '0.0474', 'learning_rate': '9.755e-05', 'epoch': '21.31'}
{'loss': '0.003117', 'grad_norm': '0.01502', 'learning_rate': '9.729e-05', 'epoch': '21.35'}
{'loss': '0.00179', 'grad_norm': '0.1029', 'learning_rate': '9.703e-05', 'epoch': '21.38'}
{'loss': '0.001973', 'grad_norm': '0.0535', 'learning_rate': '9.677e-05', 'epoch': '21.41'}
{'loss': '0.001002', 'grad_norm': '0.03094', 'learning_rate': '9.651e-05', 'epoch': '21.44'}
{'loss': '0.001603', 'grad_norm': '0.05216', 'learning_rate': '9.625e-05', 'epoch': '21.47'}
{'loss': '0.001345', 'grad_norm': '0.02793', 'learning_rate': '9.6e-05', 'epoch': '21.5'}
{'loss': '0.002546', 'grad_norm': '0.06738', 'learning_rate': '9.574e-05', 'epoch': '21.54'}
{'loss': '0.002011', 'grad_norm': '0.05275', 'learning_rate': '9.548e-05', 'epoch': '21.57'}
{'loss': '0.001754', 'grad_norm': '0.02782', 'learning_rate': '9.522e-05', 'epoch': '21.6'}
{'loss': '0.001562', 'grad_norm': '0.04527', 'learning_rate': '9.496e-05', 'epoch': '21.63'}
{'loss': '0.002094', 'grad_norm': '0.04717', 'learning_rate': '9.471e-05', 'epoch': '21.66'}
{'loss': '0.001597', 'grad_norm': '0.01702', 'learning_rate': '9.445e-05', 'epoch': '21.69'}
{'loss': '0.001503', 'grad_norm': '0.03237', 'learning_rate': '9.419e-05', 'epoch': '21.72'}
{'loss': '0.002228', 'grad_norm': '0.0469', 'learning_rate': '9.393e-05', 'epoch': '21.76'}
{'loss': '0.002591', 'grad_norm': '0.04211', 'learning_rate': '9.367e-05', 'epoch': '21.79'}
{'loss': '0.001878', 'grad_norm': '0.02963', 'learning_rate': '9.342e-05', 'epoch': '21.82'}
{'loss': '0.001314', 'grad_norm': '0.03822', 'learning_rate': '9.316e-05', 'epoch': '21.85'}
{'loss': '0.001981', 'grad_norm': '0.05484', 'learning_rate': '9.29e-05', 'epoch': '21.88'}
{'loss': '0.00118', 'grad_norm': '0.02135', 'learning_rate': '9.264e-05', 'epoch': '21.91'}
{'loss': '0.002993', 'grad_norm': '0.08161', 'learning_rate': '9.239e-05', 'epoch': '21.94'}
{'loss': '0.001649', 'grad_norm': '0.08088', 'learning_rate': '9.213e-05', 'epoch': '21.98'}
{'loss': '0.001886', 'grad_norm': '0.06722', 'learning_rate': '9.187e-05', 'epoch': '22'}
{'loss': '0.00167', 'grad_norm': '0.02759', 'learning_rate': '9.161e-05', 'epoch': '22.03'}
{'loss': '0.001717', 'grad_norm': '0.08528', 'learning_rate': '9.136e-05', 'epoch': '22.06'}
{'loss': '0.001828', 'grad_norm': '0.04295', 'learning_rate': '9.11e-05', 'epoch': '22.09'}
{'loss': '0.001321', 'grad_norm': '0.01712', 'learning_rate': '9.084e-05', 'epoch': '22.13'}
{'loss': '0.002071', 'grad_norm': '0.03519', 'learning_rate': '9.058e-05', 'epoch': '22.16'}
{'loss': '0.00174', 'grad_norm': '0.04991', 'learning_rate': '9.033e-05', 'epoch': '22.19'}
{'loss': '0.00166', 'grad_norm': '0.03922', 'learning_rate': '9.007e-05', 'epoch': '22.22'}
{'loss': '0.001925', 'grad_norm': '0.03817', 'learning_rate': '8.981e-05', 'epoch': '22.25'}
{'loss': '0.0028', 'grad_norm': '0.0416', 'learning_rate': '8.956e-05', 'epoch': '22.28'}
{'loss': '0.0016', 'grad_norm': '0.03987', 'learning_rate': '8.93e-05', 'epoch': '22.31'}
{'loss': '0.001748', 'grad_norm': '0.04551', 'learning_rate': '8.904e-05', 'epoch': '22.35'}
{'loss': '0.001922', 'grad_norm': '0.02328', 'learning_rate': '8.879e-05', 'epoch': '22.38'}
{'loss': '0.001774', 'grad_norm': '0.04773', 'learning_rate': '8.853e-05', 'epoch': '22.41'}
{'loss': '0.001518', 'grad_norm': '0.03846', 'learning_rate': '8.827e-05', 'epoch': '22.44'}
{'loss': '0.00169', 'grad_norm': '0.04988', 'learning_rate': '8.802e-05', 'epoch': '22.47'}
{'loss': '0.003056', 'grad_norm': '0.05997', 'learning_rate': '8.776e-05', 'epoch': '22.5'}
 56%|█████▋    | 1440/2560 [06:56<05:01,  3.72it/s]
 56%|█████▋    | 1441/2560 [06:56<05:03,  3.69it/s]
 56%|█████▋    | 1442/2560 [06:56<05:04,  3.67it/s]
                                                   

 56%|█████▋    | 1442/2560 [06:56<05:04,  3.67it/s]
 56%|█████▋    | 1443/2560 [06:57<05:04,  3.67it/s]
 56%|█████▋    | 1444/2560 [06:57<05:05,  3.65it/s]
                                                   

 56%|█████▋    | 1444/2560 [06:57<05:05,  3.65it/s]
 56%|█████▋    | 1445/2560 [06:57<05:03,  3.67it/s]
 56%|█████▋    | 1446/2560 [06:57<05:02,  3.68it/s]
                                                   

 56%|█████▋    | 1446/2560 [06:57<05:02,  3.68it/s]
 57%|█████▋    | 1447/2560 [06:58<05:00,  3.70it/s]
 57%|█████▋    | 1448/2560 [06:58<04:59,  3.71it/s]
                                                   

 57%|█████▋    | 1448/2560 [06:58<04:59,  3.71it/s]
 57%|█████▋    | 1449/2560 [06:58<05:00,  3.69it/s]
 57%|█████▋    | 1450/2560 [06:59<05:00,  3.69it/s]
                                                   

 57%|█████▋    | 1450/2560 [06:59<05:00,  3.69it/s]
 57%|█████▋    | 1451/2560 [06:59<04:59,  3.70it/s]
 57%|█████▋    | 1452/2560 [06:59<05:00,  3.69it/s]
                                                   

 57%|█████▋    | 1452/2560 [06:59<05:00,  3.69it/s]
 57%|█████▋    | 1453/2560 [06:59<05:01,  3.67it/s]
 57%|█████▋    | 1454/2560 [07:00<04:59,  3.69it/s]
                                                   

 57%|█████▋    | 1454/2560 [07:00<04:59,  3.69it/s]
 57%|█████▋    | 1455/2560 [07:00<04:59,  3.68it/s]
 57%|█████▋    | 1456/2560 [07:00<05:01,  3.66it/s]
                                                   

 57%|█████▋    | 1456/2560 [07:00<05:01,  3.66it/s]
 57%|█████▋    | 1457/2560 [07:00<05:03,  3.63it/s]
 57%|█████▋    | 1458/2560 [07:01<05:04,  3.62it/s]
                                                   

 57%|█████▋    | 1458/2560 [07:01<05:04,  3.62it/s]
 57%|█████▋    | 1459/2560 [07:01<05:04,  3.62it/s]
 57%|█████▋    | 1460/2560 [07:01<05:05,  3.60it/s]
                                                   

 57%|█████▋    | 1460/2560 [07:01<05:05,  3.60it/s]
 57%|█████▋    | 1461/2560 [07:02<05:03,  3.62it/s]
 57%|█████▋    | 1462/2560 [07:02<05:05,  3.59it/s]
                                                   

 57%|█████▋    | 1462/2560 [07:02<05:05,  3.59it/s]
 57%|█████▋    | 1463/2560 [07:02<05:01,  3.64it/s]
 57%|█████▋    | 1464/2560 [07:02<04:59,  3.66it/s]
                                                   

 57%|█████▋    | 1464/2560 [07:02<04:59,  3.66it/s]
 57%|█████▋    | 1465/2560 [07:03<04:59,  3.66it/s]
 57%|█████▋    | 1466/2560 [07:03<04:57,  3.68it/s]
                                                   

 57%|█████▋    | 1466/2560 [07:03<04:57,  3.68it/s]
 57%|█████▋    | 1467/2560 [07:03<04:57,  3.68it/s]
 57%|█████▋    | 1468/2560 [07:03<04:59,  3.64it/s]
                                                   

 57%|█████▋    | 1468/2560 [07:03<04:59,  3.64it/s]
 57%|█████▋    | 1469/2560 [07:04<04:57,  3.67it/s]
 57%|█████▋    | 1470/2560 [07:04<04:58,  3.65it/s]
                                                   

 57%|█████▋    | 1470/2560 [07:04<04:58,  3.65it/s]
 57%|█████▋    | 1471/2560 [07:04<05:00,  3.62it/s]
 57%|█████▊    | 1472/2560 [07:04<04:13,  4.29it/s]
                                                   

 57%|█████▊    | 1472/2560 [07:04<04:13,  4.29it/s]
 58%|█████▊    | 1473/2560 [07:05<04:30,  4.03it/s]
 58%|█████▊    | 1474/2560 [07:05<04:37,  3.91it/s]
                                                   

 58%|█████▊    | 1474/2560 [07:05<04:37,  3.91it/s]
 58%|█████▊    | 1475/2560 [07:05<04:45,  3.80it/s]
 58%|█████▊    | 1476/2560 [07:06<04:51,  3.72it/s]
                                                   

 58%|█████▊    | 1476/2560 [07:06<04:51,  3.72it/s]
 58%|█████▊    | 1477/2560 [07:06<04:55,  3.67it/s]
 58%|█████▊    | 1478/2560 [07:06<04:54,  3.67it/s]
                                                   

 58%|█████▊    | 1478/2560 [07:06<04:54,  3.67it/s]
 58%|█████▊    | 1479/2560 [07:06<04:57,  3.63it/s]
 58%|█████▊    | 1480/2560 [07:07<05:01,  3.59it/s]
                                                   

 58%|█████▊    | 1480/2560 [07:07<05:01,  3.59it/s]
 58%|█████▊    | 1481/2560 [07:07<05:00,  3.59it/s]
 58%|█████▊    | 1482/2560 [07:07<05:00,  3.59it/s]
                                                   

 58%|█████▊    | 1482/2560 [07:07<05:00,  3.59it/s]
 58%|█████▊    | 1483/2560 [07:07<04:58,  3.61it/s]
 58%|█████▊    | 1484/2560 [07:08<04:54,  3.65it/s]
                                                   

 58%|█████▊    | 1484/2560 [07:08<04:54,  3.65it/s]
 58%|█████▊    | 1485/2560 [07:08<04:52,  3.68it/s]
 58%|█████▊    | 1486/2560 [07:08<04:48,  3.72it/s]
                                                   

 58%|█████▊    | 1486/2560 [07:08<04:48,  3.72it/s]
 58%|█████▊    | 1487/2560 [07:09<04:47,  3.74it/s]
 58%|█████▊    | 1488/2560 [07:09<04:49,  3.70it/s]
                                                   

 58%|█████▊    | 1488/2560 [07:09<04:49,  3.70it/s]
 58%|█████▊    | 1489/2560 [07:09<04:48,  3.72it/s]
 58%|█████▊    | 1490/2560 [07:09<04:45,  3.75it/s]
                                                   

 58%|█████▊    | 1490/2560 [07:09<04:45,  3.75it/s]
 58%|█████▊    | 1491/2560 [07:10<04:44,  3.75it/s]
 58%|█████▊    | 1492/2560 [07:10<04:43,  3.77it/s]
                                                   

 58%|█████▊    | 1492/2560 [07:10<04:43,  3.77it/s]
 58%|█████▊    | 1493/2560 [07:10<04:41,  3.79it/s]
 58%|█████▊    | 1494/2560 [07:10<04:42,  3.78it/s]
                                                   

 58%|█████▊    | 1494/2560 [07:10<04:42,  3.78it/s]
 58%|█████▊    | 1495/2560 [07:11<04:42,  3.76it/s]
 58%|█████▊    | 1496/2560 [07:11<04:40,  3.79it/s]
                                                   

 58%|█████▊    | 1496/2560 [07:11<04:40,  3.79it/s]
 58%|█████▊    | 1497/2560 [07:11<04:39,  3.80it/s]
 59%|█████▊    | 1498/2560 [07:11<04:38,  3.81it/s]
                                                   

 59%|█████▊    | 1498/2560 [07:11<04:38,  3.81it/s]
 59%|█████▊    | 1499/2560 [07:12<04:36,  3.84it/s]
 59%|█████▊    | 1500/2560 [07:12<04:36,  3.84it/s]
                                                   

 59%|█████▊    | 1500/2560 [07:12<04:36,  3.84it/s]
 59%|█████▊    | 1501/2560 [07:12<04:56,  3.57it/s]
 59%|█████▊    | 1502/2560 [07:13<04:54,  3.59it/s]
                                                   

 59%|█████▊    | 1502/2560 [07:13<04:54,  3.59it/s]
 59%|█████▊    | 1503/2560 [07:13<04:50,  3.63it/s]
 59%|█████▉    | 1504/2560 [07:13<04:47,  3.68it/s]
                                                   

 59%|█████▉    | 1504/2560 [07:13<04:47,  3.68it/s]
 59%|█████▉    | 1505/2560 [07:13<04:45,  3.69it/s]
 59%|█████▉    | 1506/2560 [07:14<04:48,  3.65it/s]
                                                   

 59%|█████▉    | 1506/2560 [07:14<04:48,  3.65it/s]
 59%|█████▉    | 1507/2560 [07:14<04:46,  3.68it/s]
 59%|█████▉    | 1508/2560 [07:14<04:41,  3.74it/s]
                                                   

 59%|█████▉    | 1508/2560 [07:14<04:41,  3.74it/s]
 59%|█████▉    | 1509/2560 [07:14<04:38,  3.77it/s]
 59%|█████▉    | 1510/2560 [07:15<04:36,  3.80it/s]
                                                   

 59%|█████▉    | 1510/2560 [07:15<04:36,  3.80it/s]
 59%|█████▉    | 1511/2560 [07:15<04:34,  3.83it/s]
 59%|█████▉    | 1512/2560 [07:15<04:31,  3.86it/s]
                                                   

 59%|█████▉    | 1512/2560 [07:15<04:31,  3.86it/s]
 59%|█████▉    | 1513/2560 [07:15<04:31,  3.86it/s]
 59%|█████▉    | 1514/2560 [07:16<04:30,  3.87it/s]
                                                   

 59%|█████▉    | 1514/2560 [07:16<04:30,  3.87it/s]
 59%|█████▉    | 1515/2560 [07:16<04:30,  3.86it/s]
 59%|█████▉    | 1516/2560 [07:16<04:29,  3.87it/s]
                                                   

 59%|█████▉    | 1516/2560 [07:16<04:29,  3.87it/s]
 59%|█████▉    | 1517/2560 [07:17<04:29,  3.86it/s]
 59%|█████▉    | 1518/2560 [07:17<04:29,  3.87it/s]
                                                   

 59%|█████▉    | 1518/2560 [07:17<04:29,  3.87it/s]
 59%|█████▉    | 1519/2560 [07:17<04:28,  3.88it/s]
 59%|█████▉    | 1520/2560 [07:17<04:28,  3.88it/s]
                                                   

 59%|█████▉    | 1520/2560 [07:17<04:28,  3.88it/s]
 59%|█████▉    | 1521/2560 [07:18<04:27,  3.89it/s]
 59%|█████▉    | 1522/2560 [07:18<04:28,  3.87it/s]
                                                   

 59%|█████▉    | 1522/2560 [07:18<04:28,  3.87it/s]
 59%|█████▉    | 1523/2560 [07:18<04:29,  3.84it/s]
 60%|█████▉    | 1524/2560 [07:18<04:29,  3.85it/s]
                                                   

 60%|█████▉    | 1524/2560 [07:18<04:29,  3.85it/s]
 60%|█████▉    | 1525/2560 [07:19<04:28,  3.86it/s]
 60%|█████▉    | 1526/2560 [07:19<04:33,  3.78it/s]
                                                   

 60%|█████▉    | 1526/2560 [07:19<04:33,  3.78it/s]
 60%|█████▉    | 1527/2560 [07:19<04:32,  3.79it/s]
 60%|█████▉    | 1528/2560 [07:19<04:32,  3.79it/s]
                                                   

 60%|█████▉    | 1528/2560 [07:19<04:32,  3.79it/s]
 60%|█████▉    | 1529/2560 [07:20<04:31,  3.80it/s]
 60%|█████▉    | 1530/2560 [07:20<04:30,  3.81it/s]
                                                   

 60%|█████▉    | 1530/2560 [07:20<04:30,  3.81it/s]
 60%|█████▉    | 1531/2560 [07:20<04:30,  3.80it/s]
 60%|█████▉    | 1532/2560 [07:20<04:29,  3.81it/s]
                                                   

 60%|█████▉    | 1532/2560 [07:20<04:29,  3.81it/s]
 60%|█████▉    | 1533/2560 [07:21<04:29,  3.82it/s]
 60%|█████▉    | 1534/2560 [07:21<04:28,  3.82it/s]
                                                   

 60%|█████▉    | 1534/2560 [07:21<04:28,  3.82it/s]
 60%|█████▉    | 1535/2560 [07:21<04:27,  3.84it/s]
 60%|██████    | 1536/2560 [07:21<03:46,  4.52it/s]
                                                   

 60%|██████    | 1536/2560 [07:21<03:46,  4.52it/s]
 60%|██████    | 1537/2560 [07:22<03:59,  4.27it/s]
 60%|██████    | 1538/2560 [07:22<04:08,  4.11it/s]
                                                   

 60%|██████    | 1538/2560 [07:22<04:08,  4.11it/s]
 60%|██████    | 1539/2560 [07:22<04:17,  3.96it/s]
 60%|██████    | 1540/2560 [07:22<04:20,  3.91it/s]
                                                   

 60%|██████    | 1540/2560 [07:22<04:20,  3.91it/s]
 60%|██████    | 1541/2560 [07:23<04:24,  3.85it/s]
 60%|██████    | 1542/2560 [07:23<04:26,  3.82it/s]
                                                   

 60%|██████    | 1542/2560 [07:23<04:26,  3.82it/s]
 60%|██████    | 1543/2560 [07:23<04:28,  3.79it/s]
 60%|██████    | 1544/2560 [07:23<04:26,  3.81it/s]
                                                   

 60%|██████    | 1544/2560 [07:23<04:26,  3.81it/s]
 60%|██████    | 1545/2560 [07:24<04:26,  3.81it/s]
 60%|██████    | 1546/2560 [07:24<04:25,  3.82it/s]
                                                   

 60%|██████    | 1546/2560 [07:24<04:25,  3.82it/s]
 60%|██████    | 1547/2560 [07:24<04:25,  3.82it/s]
 60%|██████    | 1548/2560 [07:25<04:24,  3.82it/s]
                                                   

 60%|██████    | 1548/2560 [07:25<04:24,  3.82it/s]
 61%|██████    | 1549/2560 [07:25<04:23,  3.83it/s]
 61%|██████    | 1550/2560 [07:25<04:23,  3.84it/s]
                                                   

 61%|██████    | 1550/2560 [07:25<04:23,  3.84it/s]
 61%|██████    | 1551/2560 [07:25<04:24,  3.82it/s]
 61%|██████    | 1552/2560 [07:26<04:25,  3.80it/s]
                                                   

 61%|██████    | 1552/2560 [07:26<04:25,  3.80it/s]
 61%|██████    | 1553/2560 [07:26<04:27,  3.77it/s]
 61%|██████    | 1554/2560 [07:26<04:26,  3.77it/s]
                                                   

 61%|██████    | 1554/2560 [07:26<04:26,  3.77it/s]
 61%|██████    | 1555/2560 [07:26<04:30,  3.72it/s]
 61%|██████    | 1556/2560 [07:27<04:30,  3.71it/s]
                                                   

 61%|██████    | 1556/2560 [07:27<04:30,  3.71it/s]
 61%|██████    | 1557/2560 [07:27<04:32,  3.68it/s]
 61%|██████    | 1558/2560 [07:27<04:32,  3.68it/s]
                                                   

 61%|██████    | 1558/2560 [07:27<04:32,  3.68it/s]
 61%|██████    | 1559/2560 [07:27<04:31,  3.69it/s]
 61%|██████    | 1560/2560 [07:28<04:28,  3.72it/s]
                                                   

 61%|██████    | 1560/2560 [07:28<04:28,  3.72it/s]
 61%|██████    | 1561/2560 [07:28<04:29,  3.70it/s]
 61%|██████    | 1562/2560 [07:28<04:34,  3.63it/s]
                                                   

 61%|██████    | 1562/2560 [07:28<04:34,  3.63it/s]
 61%|██████    | 1563/2560 [07:29<04:31,  3.67it/s]
 61%|██████    | 1564/2560 [07:29<04:27,  3.72it/s]
                                                   

 61%|██████    | 1564/2560 [07:29<04:27,  3.72it/s]
 61%|██████    | 1565/2560 [07:29<04:25,  3.74it/s]
 61%|██████    | 1566/2560 [07:29<04:27,  3.71it/s]
                                                   

 61%|██████    | 1566/2560 [07:29<04:27,  3.71it/s]
 61%|██████    | 1567/2560 [07:30<04:27,  3.72it/s]
 61%|██████▏   | 1568/2560 [07:30<04:27,  3.71it/s]
                                                   

 61%|██████▏   | 1568/2560 [07:30<04:27,  3.71it/s]
 61%|██████▏   | 1569/2560 [07:30<04:24,  3.75it/s]
 61%|██████▏   | 1570/2560 [07:30<04:21,  3.78it/s]
                                                   

 61%|██████▏   | 1570/2560 [07:30<04:21,  3.78it/s]
 61%|██████▏   | 1571/2560 [07:31<04:20,  3.80it/s]
 61%|██████▏   | 1572/2560 [07:31<04:19,  3.80it/s]
                                                   

 61%|██████▏   | 1572/2560 [07:31<04:19,  3.80it/s]
 61%|██████▏   | 1573/2560 [07:31<04:18,  3.82it/s]
 61%|██████▏   | 1574/2560 [07:31<04:18,  3.82it/s]
                                                   

 61%|██████▏   | 1574/2560 [07:31<04:18,  3.82it/s]
 62%|██████▏   | 1575/2560 [07:32<04:18,  3.81it/s]
 62%|██████▏   | 1576/2560 [07:32<04:18,  3.80it/s]
                                                   

 62%|██████▏   | 1576/2560 [07:32<04:18,  3.80it/s]
 62%|██████▏   | 1577/2560 [07:32<04:20,  3.77it/s]
 62%|██████▏   | 1578/2560 [07:33<04:19,  3.79it/s]
                                                   

 62%|██████▏   | 1578/2560 [07:33<04:19,  3.79it/s]
 62%|██████▏   | 1579/2560 [07:33<04:17,  3.80it/s]
 62%|██████▏   | 1580/2560 [07:33<04:17,  3.81it/s]
                                                   

 62%|██████▏   | 1580/2560 [07:33<04:17,  3.81it/s]
 62%|██████▏   | 1581/2560 [07:33<04:17,  3.81it/s]
 62%|██████▏   | 1582/2560 [07:34<04:18,  3.79it/s]
                                                   

 62%|██████▏   | 1582/2560 [07:34<04:18,  3.79it/s]
 62%|██████▏   | 1583/2560 [07:34<04:18,  3.78it/s]
 62%|██████▏   | 1584/2560 [07:34<04:21,  3.73it/s]
                                                   

 62%|██████▏   | 1584/2560 [07:34<04:21,  3.73it/s]
 62%|██████▏   | 1585/2560 [07:34<04:22,  3.72it/s]
 62%|██████▏   | 1586/2560 [07:35<04:22,  3.71it/s]
                                                   

 62%|██████▏   | 1586/2560 [07:35<04:22,  3.71it/s]
 62%|██████▏   | 1587/2560 [07:35<04:25,  3.67it/s]
 62%|██████▏   | 1588/2560 [07:35<04:24,  3.68it/s]
                                                   

 62%|██████▏   | 1588/2560 [07:35<04:24,  3.68it/s]
 62%|██████▏   | 1589/2560 [07:35<04:25,  3.66it/s]
 62%|██████▏   | 1590/2560 [07:36<04:27,  3.62it/s]
                                                   

 62%|██████▏   | 1590/2560 [07:36<04:27,  3.62it/s]
 62%|██████▏   | 1591/2560 [07:36<04:29,  3.59it/s]
 62%|██████▏   | 1592/2560 [07:36<04:29,  3.59it/s]
                                                   

 62%|██████▏   | 1592/2560 [07:36<04:29,  3.59it/s]
 62%|██████▏   | 1593/2560 [07:37<04:30,  3.58it/s]
 62%|██████▏   | 1594/2560 [07:37<04:32,  3.54it/s]
                                                   

 62%|██████▏   | 1594/2560 [07:37<04:32,  3.54it/s]
 62%|██████▏   | 1595/2560 [07:37<04:30,  3.56it/s]
 62%|██████▏   | 1596/2560 [07:37<04:28,  3.60it/s]
                                                   

 62%|██████▏   | 1596/2560 [07:37<04:28,  3.60it/s]
 62%|██████▏   | 1597/2560 [07:38<04:24,  3.64it/s]
 62%|██████▏   | 1598/2560 [07:38<04:23,  3.65it/s]
                                                   

 62%|██████▏   | 1598/2560 [07:38<04:23,  3.65it/s]
 62%|██████▏   | 1599/2560 [07:38<04:19,  3.70it/s]
 62%|██████▎   | 1600/2560 [07:38<03:40,  4.35it/s]
                                                   

 62%|██████▎   | 1600/2560 [07:38<03:40,  4.35it/s]
 63%|██████▎   | 1601/2560 [07:39<03:53,  4.10it/s]
 63%|██████▎   | 1602/2560 [07:39<04:03,  3.94it/s]
                                                   

 63%|██████▎   | 1602/2560 [07:39<04:03,  3.94it/s]
 63%|██████▎   | 1603/2560 [07:39<04:08,  3.86it/s]
 63%|██████▎   | 1604/2560 [07:39<04:08,  3.85it/s]
                                                   

 63%|██████▎   | 1604/2560 [07:39<04:08,  3.85it/s]
 63%|██████▎   | 1605/2560 [07:40<04:13,  3.77it/s]
 63%|██████▎   | 1606/2560 [07:40<04:12,  3.78it/s]
                                                   

 63%|██████▎   | 1606/2560 [07:40<04:12,  3.78it/s]
 63%|██████▎   | 1607/2560 [07:40<04:11,  3.79it/s]
 63%|██████▎   | 1608/2560 [07:41<04:12,  3.78it/s]
                                                   

 63%|██████▎   | 1608/2560 [07:41<04:12,  3.78it/s]
 63%|██████▎   | 1609/2560 [07:41<04:12,  3.77it/s]
 63%|██████▎   | 1610/2560 [07:41<04:12,  3.76it/s]
                                                   

 63%|██████▎   | 1610/2560 [07:41<04:12,  3.76it/s]
 63%|██████▎   | 1611/2560 [07:41<04:12,  3.77it/s]
 63%|██████▎   | 1612/2560 [07:42<04:10,  3.79it/s]
                                                   

 63%|██████▎   | 1612/2560 [07:42<04:10,  3.79it/s]
 63%|██████▎   | 1613/2560 [07:42<04:09,  3.80it/s]
 63%|██████▎   | 1614/2560 [07:42<04:10,  3.78it/s]
                                                   

 63%|██████▎   | 1614/2560 [07:42<04:10,  3.78it/s]
 63%|██████▎   | 1615/2560 [07:42<04:09,  3.79it/s]
 63%|██████▎   | 1616/2560 [07:43<04:09,  3.78it/s]
                                                   

 63%|██████▎   | 1616/2560 [07:43<04:09,  3.78it/s]
 63%|██████▎   | 1617/2560 [07:43<04:10,  3.77it/s]
 63%|██████▎   | 1618/2560 [07:43<04:12,  3.73it/s]
                                                   
{'loss': '0.001567', 'grad_norm': '0.02552', 'learning_rate': '8.75e-05', 'epoch': '22.54'}
{'loss': '0.001252', 'grad_norm': '0.02104', 'learning_rate': '8.725e-05', 'epoch': '22.57'}
{'loss': '0.001557', 'grad_norm': '0.02764', 'learning_rate': '8.699e-05', 'epoch': '22.6'}
{'loss': '0.001367', 'grad_norm': '0.0321', 'learning_rate': '8.673e-05', 'epoch': '22.63'}
{'loss': '0.002533', 'grad_norm': '0.05757', 'learning_rate': '8.648e-05', 'epoch': '22.66'}
{'loss': '0.001371', 'grad_norm': '0.05799', 'learning_rate': '8.622e-05', 'epoch': '22.69'}
{'loss': '0.001938', 'grad_norm': '0.0388', 'learning_rate': '8.597e-05', 'epoch': '22.72'}
{'loss': '0.002079', 'grad_norm': '0.03523', 'learning_rate': '8.571e-05', 'epoch': '22.76'}
{'loss': '0.001652', 'grad_norm': '0.03881', 'learning_rate': '8.545e-05', 'epoch': '22.79'}
{'loss': '0.001753', 'grad_norm': '0.04721', 'learning_rate': '8.52e-05', 'epoch': '22.82'}
{'loss': '0.001441', 'grad_norm': '0.0753', 'learning_rate': '8.494e-05', 'epoch': '22.85'}
{'loss': '0.001794', 'grad_norm': '0.03212', 'learning_rate': '8.469e-05', 'epoch': '22.88'}
{'loss': '0.001655', 'grad_norm': '0.05804', 'learning_rate': '8.443e-05', 'epoch': '22.91'}
{'loss': '0.001274', 'grad_norm': '0.01222', 'learning_rate': '8.418e-05', 'epoch': '22.94'}
{'loss': '0.001976', 'grad_norm': '0.05734', 'learning_rate': '8.392e-05', 'epoch': '22.98'}
{'loss': '0.002854', 'grad_norm': '0.05795', 'learning_rate': '8.367e-05', 'epoch': '23'}
{'loss': '0.001457', 'grad_norm': '0.02738', 'learning_rate': '8.341e-05', 'epoch': '23.03'}
{'loss': '0.001461', 'grad_norm': '0.01284', 'learning_rate': '8.316e-05', 'epoch': '23.06'}
{'loss': '0.002661', 'grad_norm': '0.01818', 'learning_rate': '8.29e-05', 'epoch': '23.09'}
{'loss': '0.001602', 'grad_norm': '0.01712', 'learning_rate': '8.265e-05', 'epoch': '23.13'}
{'loss': '0.0016', 'grad_norm': '0.03794', 'learning_rate': '8.239e-05', 'epoch': '23.16'}
{'loss': '0.002165', 'grad_norm': '0.0279', 'learning_rate': '8.214e-05', 'epoch': '23.19'}
{'loss': '0.002603', 'grad_norm': '0.0787', 'learning_rate': '8.189e-05', 'epoch': '23.22'}
{'loss': '0.001363', 'grad_norm': '0.03181', 'learning_rate': '8.163e-05', 'epoch': '23.25'}
{'loss': '0.001771', 'grad_norm': '0.04179', 'learning_rate': '8.138e-05', 'epoch': '23.28'}
{'loss': '0.001717', 'grad_norm': '0.06008', 'learning_rate': '8.112e-05', 'epoch': '23.31'}
{'loss': '0.00138', 'grad_norm': '0.02877', 'learning_rate': '8.087e-05', 'epoch': '23.35'}
{'loss': '0.001461', 'grad_norm': '0.04822', 'learning_rate': '8.062e-05', 'epoch': '23.38'}
{'loss': '0.001464', 'grad_norm': '0.04684', 'learning_rate': '8.036e-05', 'epoch': '23.41'}
{'loss': '0.001571', 'grad_norm': '0.04927', 'learning_rate': '8.011e-05', 'epoch': '23.44'}
{'loss': '0.002576', 'grad_norm': '0.05059', 'learning_rate': '7.986e-05', 'epoch': '23.47'}
{'loss': '0.001676', 'grad_norm': '0.02098', 'learning_rate': '7.96e-05', 'epoch': '23.5'}
{'loss': '0.001466', 'grad_norm': '0.01958', 'learning_rate': '7.935e-05', 'epoch': '23.54'}
{'loss': '0.002251', 'grad_norm': '0.09238', 'learning_rate': '7.91e-05', 'epoch': '23.57'}
{'loss': '0.00147', 'grad_norm': '0.06391', 'learning_rate': '7.885e-05', 'epoch': '23.6'}
{'loss': '0.002439', 'grad_norm': '0.03025', 'learning_rate': '7.859e-05', 'epoch': '23.63'}
{'loss': '0.001548', 'grad_norm': '0.042', 'learning_rate': '7.834e-05', 'epoch': '23.66'}
{'loss': '0.002786', 'grad_norm': '0.04133', 'learning_rate': '7.809e-05', 'epoch': '23.69'}
{'loss': '0.001565', 'grad_norm': '0.03873', 'learning_rate': '7.784e-05', 'epoch': '23.72'}
{'loss': '0.001854', 'grad_norm': '0.04124', 'learning_rate': '7.759e-05', 'epoch': '23.76'}
{'loss': '0.001528', 'grad_norm': '0.03256', 'learning_rate': '7.733e-05', 'epoch': '23.79'}
{'loss': '0.002065', 'grad_norm': '0.04083', 'learning_rate': '7.708e-05', 'epoch': '23.82'}
{'loss': '0.001995', 'grad_norm': '0.01723', 'learning_rate': '7.683e-05', 'epoch': '23.85'}
{'loss': '0.001347', 'grad_norm': '0.03263', 'learning_rate': '7.658e-05', 'epoch': '23.88'}
{'loss': '0.001752', 'grad_norm': '0.03919', 'learning_rate': '7.633e-05', 'epoch': '23.91'}
{'loss': '0.001383', 'grad_norm': '0.01406', 'learning_rate': '7.608e-05', 'epoch': '23.94'}
{'loss': '0.001806', 'grad_norm': '0.04302', 'learning_rate': '7.583e-05', 'epoch': '23.98'}
{'loss': '0.001194', 'grad_norm': '0.04374', 'learning_rate': '7.558e-05', 'epoch': '24'}
{'loss': '0.001286', 'grad_norm': '0.04165', 'learning_rate': '7.533e-05', 'epoch': '24.03'}
{'loss': '0.000863', 'grad_norm': '0.02949', 'learning_rate': '7.508e-05', 'epoch': '24.06'}
{'loss': '0.002288', 'grad_norm': '0.03551', 'learning_rate': '7.483e-05', 'epoch': '24.09'}
{'loss': '0.002196', 'grad_norm': '0.01706', 'learning_rate': '7.458e-05', 'epoch': '24.13'}
{'loss': '0.001857', 'grad_norm': '0.0573', 'learning_rate': '7.433e-05', 'epoch': '24.16'}
{'loss': '0.001897', 'grad_norm': '0.01502', 'learning_rate': '7.408e-05', 'epoch': '24.19'}
{'loss': '0.002942', 'grad_norm': '0.05657', 'learning_rate': '7.383e-05', 'epoch': '24.22'}
{'loss': '0.001702', 'grad_norm': '0.02504', 'learning_rate': '7.358e-05', 'epoch': '24.25'}
{'loss': '0.001624', 'grad_norm': '0.03435', 'learning_rate': '7.333e-05', 'epoch': '24.28'}
{'loss': '0.001457', 'grad_norm': '0.02787', 'learning_rate': '7.308e-05', 'epoch': '24.31'}
{'loss': '0.001857', 'grad_norm': '0.02257', 'learning_rate': '7.283e-05', 'epoch': '24.35'}
{'loss': '0.001386', 'grad_norm': '0.03889', 'learning_rate': '7.258e-05', 'epoch': '24.38'}
{'loss': '0.001314', 'grad_norm': '0.01415', 'learning_rate': '7.233e-05', 'epoch': '24.41'}
{'loss': '0.002869', 'grad_norm': '0.1158', 'learning_rate': '7.209e-05', 'epoch': '24.44'}
{'loss': '0.001059', 'grad_norm': '0.05294', 'learning_rate': '7.184e-05', 'epoch': '24.47'}
{'loss': '0.001666', 'grad_norm': '0.04182', 'learning_rate': '7.159e-05', 'epoch': '24.5'}
{'loss': '0.00123', 'grad_norm': '0.01504', 'learning_rate': '7.134e-05', 'epoch': '24.54'}
{'loss': '0.001982', 'grad_norm': '0.04063', 'learning_rate': '7.11e-05', 'epoch': '24.57'}
{'loss': '0.002496', 'grad_norm': '0.04489', 'learning_rate': '7.085e-05', 'epoch': '24.6'}
{'loss': '0.00141', 'grad_norm': '0.01726', 'learning_rate': '7.06e-05', 'epoch': '24.63'}
{'loss': '0.001434', 'grad_norm': '0.03785', 'learning_rate': '7.035e-05', 'epoch': '24.66'}
{'loss': '0.00184', 'grad_norm': '0.03038', 'learning_rate': '7.011e-05', 'epoch': '24.69'}
{'loss': '0.001795', 'grad_norm': '0.05077', 'learning_rate': '6.986e-05', 'epoch': '24.72'}
{'loss': '0.001599', 'grad_norm': '0.02225', 'learning_rate': '6.961e-05', 'epoch': '24.76'}
{'loss': '0.001806', 'grad_norm': '0.02449', 'learning_rate': '6.937e-05', 'epoch': '24.79'}
{'loss': '0.00141', 'grad_norm': '0.04099', 'learning_rate': '6.912e-05', 'epoch': '24.82'}
{'loss': '0.00151', 'grad_norm': '0.07112', 'learning_rate': '6.888e-05', 'epoch': '24.85'}
{'loss': '0.001847', 'grad_norm': '0.04596', 'learning_rate': '6.863e-05', 'epoch': '24.88'}
{'loss': '0.001394', 'grad_norm': '0.02985', 'learning_rate': '6.839e-05', 'epoch': '24.91'}
{'loss': '0.00165', 'grad_norm': '0.02253', 'learning_rate': '6.814e-05', 'epoch': '24.94'}
{'loss': '0.001474', 'grad_norm': '0.06225', 'learning_rate': '6.79e-05', 'epoch': '24.98'}
{'loss': '0.0006658', 'grad_norm': '0.0449', 'learning_rate': '6.765e-05', 'epoch': '25'}
{'loss': '0.001957', 'grad_norm': '0.05021', 'learning_rate': '6.741e-05', 'epoch': '25.03'}
{'loss': '0.0007446', 'grad_norm': '0.02557', 'learning_rate': '6.716e-05', 'epoch': '25.06'}
{'loss': '0.00172', 'grad_norm': '0.07293', 'learning_rate': '6.692e-05', 'epoch': '25.09'}
{'loss': '0.001879', 'grad_norm': '0.06012', 'learning_rate': '6.668e-05', 'epoch': '25.13'}
{'loss': '0.001523', 'grad_norm': '0.03652', 'learning_rate': '6.643e-05', 'epoch': '25.16'}
{'loss': '0.001658', 'grad_norm': '0.02462', 'learning_rate': '6.619e-05', 'epoch': '25.19'}
{'loss': '0.00175', 'grad_norm': '0.04532', 'learning_rate': '6.595e-05', 'epoch': '25.22'}
{'loss': '0.001379', 'grad_norm': '0.01333', 'learning_rate': '6.57e-05', 'epoch': '25.25'}
{'loss': '0.00117', 'grad_norm': '0.05397', 'learning_rate': '6.546e-05', 'epoch': '25.28'}
 63%|██████▎   | 1618/2560 [07:43<04:12,  3.73it/s]
 63%|██████▎   | 1619/2560 [07:43<04:14,  3.70it/s]
 63%|██████▎   | 1620/2560 [07:44<04:15,  3.67it/s]
                                                   

 63%|██████▎   | 1620/2560 [07:44<04:15,  3.67it/s]
 63%|██████▎   | 1621/2560 [07:44<04:15,  3.67it/s]
 63%|██████▎   | 1622/2560 [07:44<04:16,  3.66it/s]
                                                   

 63%|██████▎   | 1622/2560 [07:44<04:16,  3.66it/s]
 63%|██████▎   | 1623/2560 [07:45<04:17,  3.64it/s]
 63%|██████▎   | 1624/2560 [07:45<04:19,  3.61it/s]
                                                   

 63%|██████▎   | 1624/2560 [07:45<04:19,  3.61it/s]
 63%|██████▎   | 1625/2560 [07:45<04:19,  3.60it/s]
 64%|██████▎   | 1626/2560 [07:45<04:18,  3.61it/s]
                                                   

 64%|██████▎   | 1626/2560 [07:45<04:18,  3.61it/s]
 64%|██████▎   | 1627/2560 [07:46<04:16,  3.64it/s]
 64%|██████▎   | 1628/2560 [07:46<04:14,  3.66it/s]
                                                   

 64%|██████▎   | 1628/2560 [07:46<04:14,  3.66it/s]
 64%|██████▎   | 1629/2560 [07:46<04:17,  3.62it/s]
 64%|██████▎   | 1630/2560 [07:47<04:17,  3.61it/s]
                                                   

 64%|██████▎   | 1630/2560 [07:47<04:17,  3.61it/s]
 64%|██████▎   | 1631/2560 [07:47<04:16,  3.63it/s]
 64%|██████▍   | 1632/2560 [07:47<04:16,  3.62it/s]
                                                   

 64%|██████▍   | 1632/2560 [07:47<04:16,  3.62it/s]
 64%|██████▍   | 1633/2560 [07:47<04:18,  3.58it/s]
 64%|██████▍   | 1634/2560 [07:48<04:18,  3.58it/s]
                                                   

 64%|██████▍   | 1634/2560 [07:48<04:18,  3.58it/s]
 64%|██████▍   | 1635/2560 [07:48<04:23,  3.51it/s]
 64%|██████▍   | 1636/2560 [07:48<04:23,  3.50it/s]
                                                   

 64%|██████▍   | 1636/2560 [07:48<04:23,  3.50it/s]
 64%|██████▍   | 1637/2560 [07:48<04:23,  3.51it/s]
 64%|██████▍   | 1638/2560 [07:49<04:21,  3.52it/s]
                                                   

 64%|██████▍   | 1638/2560 [07:49<04:21,  3.52it/s]
 64%|██████▍   | 1639/2560 [07:49<04:20,  3.54it/s]
 64%|██████▍   | 1640/2560 [07:49<04:18,  3.56it/s]
                                                   

 64%|██████▍   | 1640/2560 [07:49<04:18,  3.56it/s]
 64%|██████▍   | 1641/2560 [07:50<04:16,  3.58it/s]
 64%|██████▍   | 1642/2560 [07:50<04:16,  3.58it/s]
                                                   

 64%|██████▍   | 1642/2560 [07:50<04:16,  3.58it/s]
 64%|██████▍   | 1643/2560 [07:50<04:14,  3.60it/s]
 64%|██████▍   | 1644/2560 [07:50<04:15,  3.59it/s]
                                                   

 64%|██████▍   | 1644/2560 [07:50<04:15,  3.59it/s]
 64%|██████▍   | 1645/2560 [07:51<04:13,  3.61it/s]
 64%|██████▍   | 1646/2560 [07:51<04:12,  3.62it/s]
                                                   

 64%|██████▍   | 1646/2560 [07:51<04:12,  3.62it/s]
 64%|██████▍   | 1647/2560 [07:51<04:14,  3.59it/s]
 64%|██████▍   | 1648/2560 [07:52<04:13,  3.59it/s]
                                                   

 64%|██████▍   | 1648/2560 [07:52<04:13,  3.59it/s]
 64%|██████▍   | 1649/2560 [07:52<04:11,  3.62it/s]
 64%|██████▍   | 1650/2560 [07:52<04:13,  3.58it/s]
                                                   

 64%|██████▍   | 1650/2560 [07:52<04:13,  3.58it/s]
 64%|██████▍   | 1651/2560 [07:52<04:12,  3.60it/s]
 65%|██████▍   | 1652/2560 [07:53<04:11,  3.61it/s]
                                                   

 65%|██████▍   | 1652/2560 [07:53<04:11,  3.61it/s]
 65%|██████▍   | 1653/2560 [07:53<04:08,  3.65it/s]
 65%|██████▍   | 1654/2560 [07:53<04:09,  3.63it/s]
                                                   

 65%|██████▍   | 1654/2560 [07:53<04:09,  3.63it/s]
 65%|██████▍   | 1655/2560 [07:53<04:08,  3.64it/s]
 65%|██████▍   | 1656/2560 [07:54<04:09,  3.62it/s]
                                                   

 65%|██████▍   | 1656/2560 [07:54<04:09,  3.62it/s]
 65%|██████▍   | 1657/2560 [07:54<04:11,  3.60it/s]
 65%|██████▍   | 1658/2560 [07:54<04:08,  3.62it/s]
                                                   

 65%|██████▍   | 1658/2560 [07:54<04:08,  3.62it/s]
 65%|██████▍   | 1659/2560 [07:55<04:09,  3.61it/s]
 65%|██████▍   | 1660/2560 [07:55<04:07,  3.64it/s]
                                                   

 65%|██████▍   | 1660/2560 [07:55<04:07,  3.64it/s]
 65%|██████▍   | 1661/2560 [07:55<04:07,  3.63it/s]
 65%|██████▍   | 1662/2560 [07:55<04:06,  3.65it/s]
                                                   

 65%|██████▍   | 1662/2560 [07:55<04:06,  3.65it/s]
 65%|██████▍   | 1663/2560 [07:56<04:07,  3.62it/s]
 65%|██████▌   | 1664/2560 [07:56<03:30,  4.26it/s]
                                                   

 65%|██████▌   | 1664/2560 [07:56<03:30,  4.26it/s]
 65%|██████▌   | 1665/2560 [07:56<03:41,  4.05it/s]
 65%|██████▌   | 1666/2560 [07:56<03:50,  3.88it/s]
                                                   

 65%|██████▌   | 1666/2560 [07:56<03:50,  3.88it/s]
 65%|██████▌   | 1667/2560 [07:57<03:54,  3.81it/s]
 65%|██████▌   | 1668/2560 [07:57<03:57,  3.76it/s]
                                                   

 65%|██████▌   | 1668/2560 [07:57<03:57,  3.76it/s]
 65%|██████▌   | 1669/2560 [07:57<04:00,  3.71it/s]
 65%|██████▌   | 1670/2560 [07:57<04:01,  3.69it/s]
                                                   

 65%|██████▌   | 1670/2560 [07:57<04:01,  3.69it/s]
 65%|██████▌   | 1671/2560 [07:58<04:01,  3.69it/s]
 65%|██████▌   | 1672/2560 [07:58<04:00,  3.69it/s]
                                                   

 65%|██████▌   | 1672/2560 [07:58<04:00,  3.69it/s]
 65%|██████▌   | 1673/2560 [07:58<04:01,  3.67it/s]
 65%|██████▌   | 1674/2560 [07:59<04:03,  3.64it/s]
                                                   

 65%|██████▌   | 1674/2560 [07:59<04:03,  3.64it/s]
 65%|██████▌   | 1675/2560 [07:59<04:05,  3.60it/s]
 65%|██████▌   | 1676/2560 [07:59<04:04,  3.62it/s]
                                                   

 65%|██████▌   | 1676/2560 [07:59<04:04,  3.62it/s]
 66%|██████▌   | 1677/2560 [07:59<04:03,  3.63it/s]
 66%|██████▌   | 1678/2560 [08:00<04:01,  3.65it/s]
                                                   

 66%|██████▌   | 1678/2560 [08:00<04:01,  3.65it/s]
 66%|██████▌   | 1679/2560 [08:00<04:00,  3.67it/s]
 66%|██████▌   | 1680/2560 [08:00<03:57,  3.70it/s]
                                                   

 66%|██████▌   | 1680/2560 [08:00<03:57,  3.70it/s]
 66%|██████▌   | 1681/2560 [08:00<03:57,  3.69it/s]
 66%|██████▌   | 1682/2560 [08:01<03:55,  3.72it/s]
                                                   

 66%|██████▌   | 1682/2560 [08:01<03:55,  3.72it/s]
 66%|██████▌   | 1683/2560 [08:01<03:54,  3.74it/s]
 66%|██████▌   | 1684/2560 [08:01<03:54,  3.73it/s]
                                                   

 66%|██████▌   | 1684/2560 [08:01<03:54,  3.73it/s]
 66%|██████▌   | 1685/2560 [08:02<03:54,  3.73it/s]
 66%|██████▌   | 1686/2560 [08:02<03:54,  3.73it/s]
                                                   

 66%|██████▌   | 1686/2560 [08:02<03:54,  3.73it/s]
 66%|██████▌   | 1687/2560 [08:02<03:53,  3.74it/s]
 66%|██████▌   | 1688/2560 [08:02<03:51,  3.76it/s]
                                                   

 66%|██████▌   | 1688/2560 [08:02<03:51,  3.76it/s]
 66%|██████▌   | 1689/2560 [08:03<03:50,  3.77it/s]
 66%|██████▌   | 1690/2560 [08:03<03:49,  3.79it/s]
                                                   

 66%|██████▌   | 1690/2560 [08:03<03:49,  3.79it/s]
 66%|██████▌   | 1691/2560 [08:03<03:48,  3.81it/s]
 66%|██████▌   | 1692/2560 [08:03<03:48,  3.81it/s]
                                                   

 66%|██████▌   | 1692/2560 [08:03<03:48,  3.81it/s]
 66%|██████▌   | 1693/2560 [08:04<03:48,  3.79it/s]
 66%|██████▌   | 1694/2560 [08:04<03:48,  3.79it/s]
                                                   

 66%|██████▌   | 1694/2560 [08:04<03:48,  3.79it/s]
 66%|██████▌   | 1695/2560 [08:04<03:48,  3.78it/s]
 66%|██████▋   | 1696/2560 [08:04<03:47,  3.80it/s]
                                                   

 66%|██████▋   | 1696/2560 [08:04<03:47,  3.80it/s]
 66%|██████▋   | 1697/2560 [08:05<03:49,  3.76it/s]
 66%|██████▋   | 1698/2560 [08:05<03:49,  3.75it/s]
                                                   

 66%|██████▋   | 1698/2560 [08:05<03:49,  3.75it/s]
 66%|██████▋   | 1699/2560 [08:05<03:49,  3.75it/s]
 66%|██████▋   | 1700/2560 [08:06<03:49,  3.75it/s]
                                                   

 66%|██████▋   | 1700/2560 [08:06<03:49,  3.75it/s]
 66%|██████▋   | 1701/2560 [08:06<03:50,  3.73it/s]
 66%|██████▋   | 1702/2560 [08:06<03:49,  3.73it/s]
                                                   

 66%|██████▋   | 1702/2560 [08:06<03:49,  3.73it/s]
 67%|██████▋   | 1703/2560 [08:06<03:50,  3.72it/s]
 67%|██████▋   | 1704/2560 [08:07<03:48,  3.75it/s]
                                                   

 67%|██████▋   | 1704/2560 [08:07<03:48,  3.75it/s]
 67%|██████▋   | 1705/2560 [08:07<03:46,  3.77it/s]
 67%|██████▋   | 1706/2560 [08:07<03:46,  3.76it/s]
                                                   

 67%|██████▋   | 1706/2560 [08:07<03:46,  3.76it/s]
 67%|██████▋   | 1707/2560 [08:07<03:47,  3.75it/s]
 67%|██████▋   | 1708/2560 [08:08<03:48,  3.73it/s]
                                                   

 67%|██████▋   | 1708/2560 [08:08<03:48,  3.73it/s]
 67%|██████▋   | 1709/2560 [08:08<03:48,  3.72it/s]
 67%|██████▋   | 1710/2560 [08:08<03:48,  3.71it/s]
                                                   

 67%|██████▋   | 1710/2560 [08:08<03:48,  3.71it/s]
 67%|██████▋   | 1711/2560 [08:08<03:45,  3.77it/s]
 67%|██████▋   | 1712/2560 [08:09<03:43,  3.79it/s]
                                                   

 67%|██████▋   | 1712/2560 [08:09<03:43,  3.79it/s]
 67%|██████▋   | 1713/2560 [08:09<03:41,  3.82it/s]
 67%|██████▋   | 1714/2560 [08:09<03:40,  3.84it/s]
                                                   

 67%|██████▋   | 1714/2560 [08:09<03:40,  3.84it/s]
 67%|██████▋   | 1715/2560 [08:09<03:39,  3.85it/s]
 67%|██████▋   | 1716/2560 [08:10<03:38,  3.87it/s]
                                                   

 67%|██████▋   | 1716/2560 [08:10<03:38,  3.87it/s]
 67%|██████▋   | 1717/2560 [08:10<03:40,  3.83it/s]
 67%|██████▋   | 1718/2560 [08:10<03:40,  3.81it/s]
                                                   

 67%|██████▋   | 1718/2560 [08:10<03:40,  3.81it/s]
 67%|██████▋   | 1719/2560 [08:11<03:39,  3.84it/s]
 67%|██████▋   | 1720/2560 [08:11<03:39,  3.83it/s]
                                                   

 67%|██████▋   | 1720/2560 [08:11<03:39,  3.83it/s]
 67%|██████▋   | 1721/2560 [08:11<03:38,  3.84it/s]
 67%|██████▋   | 1722/2560 [08:11<03:39,  3.83it/s]
                                                   

 67%|██████▋   | 1722/2560 [08:11<03:39,  3.83it/s]
 67%|██████▋   | 1723/2560 [08:12<03:39,  3.82it/s]
 67%|██████▋   | 1724/2560 [08:12<03:41,  3.77it/s]
                                                   

 67%|██████▋   | 1724/2560 [08:12<03:41,  3.77it/s]
 67%|██████▋   | 1725/2560 [08:12<03:39,  3.80it/s]
 67%|██████▋   | 1726/2560 [08:12<03:38,  3.81it/s]
                                                   

 67%|██████▋   | 1726/2560 [08:12<03:38,  3.81it/s]
 67%|██████▋   | 1727/2560 [08:13<03:38,  3.82it/s]
 68%|██████▊   | 1728/2560 [08:13<03:05,  4.48it/s]
                                                   

 68%|██████▊   | 1728/2560 [08:13<03:05,  4.48it/s]
 68%|██████▊   | 1729/2560 [08:13<03:15,  4.25it/s]
 68%|██████▊   | 1730/2560 [08:13<03:22,  4.10it/s]
                                                   

 68%|██████▊   | 1730/2560 [08:13<03:22,  4.10it/s]
 68%|██████▊   | 1731/2560 [08:14<03:27,  3.99it/s]
 68%|██████▊   | 1732/2560 [08:14<03:30,  3.94it/s]
                                                   

 68%|██████▊   | 1732/2560 [08:14<03:30,  3.94it/s]
 68%|██████▊   | 1733/2560 [08:14<03:33,  3.87it/s]
 68%|██████▊   | 1734/2560 [08:14<03:35,  3.84it/s]
                                                   

 68%|██████▊   | 1734/2560 [08:14<03:35,  3.84it/s]
 68%|██████▊   | 1735/2560 [08:15<03:35,  3.83it/s]
 68%|██████▊   | 1736/2560 [08:15<03:34,  3.84it/s]
                                                   

 68%|██████▊   | 1736/2560 [08:15<03:34,  3.84it/s]
 68%|██████▊   | 1737/2560 [08:15<03:37,  3.78it/s]
 68%|██████▊   | 1738/2560 [08:15<03:37,  3.78it/s]
                                                   

 68%|██████▊   | 1738/2560 [08:15<03:37,  3.78it/s]
 68%|██████▊   | 1739/2560 [08:16<03:38,  3.76it/s]
 68%|██████▊   | 1740/2560 [08:16<03:39,  3.74it/s]
                                                   

 68%|██████▊   | 1740/2560 [08:16<03:39,  3.74it/s]
 68%|██████▊   | 1741/2560 [08:16<03:39,  3.72it/s]
 68%|██████▊   | 1742/2560 [08:17<03:39,  3.73it/s]
                                                   

 68%|██████▊   | 1742/2560 [08:17<03:39,  3.73it/s]
 68%|██████▊   | 1743/2560 [08:17<03:37,  3.76it/s]
 68%|██████▊   | 1744/2560 [08:17<03:35,  3.79it/s]
                                                   

 68%|██████▊   | 1744/2560 [08:17<03:35,  3.79it/s]
 68%|██████▊   | 1745/2560 [08:17<03:35,  3.78it/s]
 68%|██████▊   | 1746/2560 [08:18<03:38,  3.72it/s]
                                                   

 68%|██████▊   | 1746/2560 [08:18<03:38,  3.72it/s]
 68%|██████▊   | 1747/2560 [08:18<03:37,  3.75it/s]
 68%|██████▊   | 1748/2560 [08:18<03:41,  3.67it/s]
                                                   

 68%|██████▊   | 1748/2560 [08:18<03:41,  3.67it/s]
 68%|██████▊   | 1749/2560 [08:18<03:39,  3.70it/s]
 68%|██████▊   | 1750/2560 [08:19<03:40,  3.67it/s]
                                                   

 68%|██████▊   | 1750/2560 [08:19<03:40,  3.67it/s]
 68%|██████▊   | 1751/2560 [08:19<03:51,  3.50it/s]
 68%|██████▊   | 1752/2560 [08:19<03:51,  3.50it/s]
                                                   

 68%|██████▊   | 1752/2560 [08:19<03:51,  3.50it/s]
 68%|██████▊   | 1753/2560 [08:20<03:48,  3.54it/s]
 69%|██████▊   | 1754/2560 [08:20<03:44,  3.59it/s]
                                                   

 69%|██████▊   | 1754/2560 [08:20<03:44,  3.59it/s]
 69%|██████▊   | 1755/2560 [08:20<03:41,  3.64it/s]
 69%|██████▊   | 1756/2560 [08:20<03:40,  3.65it/s]
                                                   

 69%|██████▊   | 1756/2560 [08:20<03:40,  3.65it/s]
 69%|██████▊   | 1757/2560 [08:21<03:39,  3.65it/s]
 69%|██████▊   | 1758/2560 [08:21<03:41,  3.63it/s]
                                                   

 69%|██████▊   | 1758/2560 [08:21<03:41,  3.63it/s]
 69%|██████▊   | 1759/2560 [08:21<03:41,  3.61it/s]
 69%|██████▉   | 1760/2560 [08:21<03:44,  3.56it/s]
                                                   

 69%|██████▉   | 1760/2560 [08:21<03:44,  3.56it/s]
 69%|██████▉   | 1761/2560 [08:22<03:42,  3.59it/s]
 69%|██████▉   | 1762/2560 [08:22<03:41,  3.60it/s]
                                                   

 69%|██████▉   | 1762/2560 [08:22<03:41,  3.60it/s]
 69%|██████▉   | 1763/2560 [08:22<03:42,  3.58it/s]
 69%|██████▉   | 1764/2560 [08:23<03:42,  3.58it/s]
                                                   

 69%|██████▉   | 1764/2560 [08:23<03:42,  3.58it/s]
 69%|██████▉   | 1765/2560 [08:23<03:44,  3.54it/s]
 69%|██████▉   | 1766/2560 [08:23<03:47,  3.49it/s]
                                                   

 69%|██████▉   | 1766/2560 [08:23<03:47,  3.49it/s]
 69%|██████▉   | 1767/2560 [08:23<03:42,  3.57it/s]
 69%|██████▉   | 1768/2560 [08:24<03:38,  3.63it/s]
                                                   

 69%|██████▉   | 1768/2560 [08:24<03:38,  3.63it/s]
 69%|██████▉   | 1769/2560 [08:24<03:36,  3.65it/s]
 69%|██████▉   | 1770/2560 [08:24<03:37,  3.64it/s]
                                                   

 69%|██████▉   | 1770/2560 [08:24<03:37,  3.64it/s]
 69%|██████▉   | 1771/2560 [08:25<03:35,  3.66it/s]
 69%|██████▉   | 1772/2560 [08:25<03:35,  3.66it/s]
                                                   

 69%|██████▉   | 1772/2560 [08:25<03:35,  3.66it/s]
 69%|██████▉   | 1773/2560 [08:25<03:35,  3.65it/s]
 69%|██████▉   | 1774/2560 [08:25<03:34,  3.66it/s]
                                                   

 69%|██████▉   | 1774/2560 [08:25<03:34,  3.66it/s]
 69%|██████▉   | 1775/2560 [08:26<03:36,  3.63it/s]
 69%|██████▉   | 1776/2560 [08:26<03:33,  3.67it/s]
                                                   

 69%|██████▉   | 1776/2560 [08:26<03:33,  3.67it/s]
 69%|██████▉   | 1777/2560 [08:26<03:33,  3.67it/s]
 69%|██████▉   | 1778/2560 [08:26<03:31,  3.69it/s]
                                                   

 69%|██████▉   | 1778/2560 [08:26<03:31,  3.69it/s]
 69%|██████▉   | 1779/2560 [08:27<03:32,  3.67it/s]
 70%|██████▉   | 1780/2560 [08:27<03:32,  3.67it/s]
                                                   

 70%|██████▉   | 1780/2560 [08:27<03:32,  3.67it/s]
 70%|██████▉   | 1781/2560 [08:27<03:32,  3.67it/s]
 70%|██████▉   | 1782/2560 [08:28<03:32,  3.66it/s]
                                                   

 70%|██████▉   | 1782/2560 [08:28<03:32,  3.66it/s]
 70%|██████▉   | 1783/2560 [08:28<03:33,  3.64it/s]
 70%|██████▉   | 1784/2560 [08:28<03:34,  3.62it/s]
                                                   

 70%|██████▉   | 1784/2560 [08:28<03:34,  3.62it/s]
 70%|██████▉   | 1785/2560 [08:28<03:33,  3.63it/s]
 70%|██████▉   | 1786/2560 [08:29<03:30,  3.67it/s]
                                                   

 70%|██████▉   | 1786/2560 [08:29<03:30,  3.67it/s]
 70%|██████▉   | 1787/2560 [08:29<03:28,  3.70it/s]
 70%|██████▉   | 1788/2560 [08:29<03:30,  3.67it/s]
                                                   

 70%|██████▉   | 1788/2560 [08:29<03:30,  3.67it/s]
 70%|██████▉   | 1789/2560 [08:29<03:29,  3.68it/s]
 70%|██████▉   | 1790/2560 [08:30<03:28,  3.70it/s]
                                                   

 70%|██████▉   | 1790/2560 [08:30<03:28,  3.70it/s]
 70%|██████▉   | 1791/2560 [08:30<03:26,  3.73it/s]
 70%|███████   | 1792/2560 [08:30<02:54,  4.39it/s]
                                                   

 70%|███████   | 1792/2560 [08:30<02:54,  4.39it/s]
 70%|███████   | 1793/2560 [08:30<03:06,  4.11it/s]
 70%|███████   | 1794/2560 [08:31<03:11,  4.01it/s]
                                                   

 70%|███████   | 1794/2560 [08:31<03:11,  4.01it/s]
 70%|███████   | 1795/2560 [08:31<03:20,  3.82it/s]
 70%|███████   | 1796/2560 [08:31<03:24,  3.74it/s]
                                                   
{'loss': '0.001842', 'grad_norm': '0.02876', 'learning_rate': '6.522e-05', 'epoch': '25.31'}
{'loss': '0.001907', 'grad_norm': '0.06232', 'learning_rate': '6.498e-05', 'epoch': '25.35'}
{'loss': '0.001103', 'grad_norm': '0.03577', 'learning_rate': '6.473e-05', 'epoch': '25.38'}
{'loss': '0.002071', 'grad_norm': '0.01087', 'learning_rate': '6.449e-05', 'epoch': '25.41'}
{'loss': '0.001392', 'grad_norm': '0.02315', 'learning_rate': '6.425e-05', 'epoch': '25.44'}
{'loss': '0.001587', 'grad_norm': '0.05237', 'learning_rate': '6.401e-05', 'epoch': '25.47'}
{'loss': '0.001635', 'grad_norm': '0.02117', 'learning_rate': '6.377e-05', 'epoch': '25.5'}
{'loss': '0.001703', 'grad_norm': '0.02628', 'learning_rate': '6.353e-05', 'epoch': '25.54'}
{'loss': '0.001466', 'grad_norm': '0.01303', 'learning_rate': '6.329e-05', 'epoch': '25.57'}
{'loss': '0.001489', 'grad_norm': '0.0364', 'learning_rate': '6.305e-05', 'epoch': '25.6'}
{'loss': '0.002021', 'grad_norm': '0.01813', 'learning_rate': '6.281e-05', 'epoch': '25.63'}
{'loss': '0.001866', 'grad_norm': '0.03856', 'learning_rate': '6.257e-05', 'epoch': '25.66'}
{'loss': '0.001241', 'grad_norm': '0.0228', 'learning_rate': '6.233e-05', 'epoch': '25.69'}
{'loss': '0.001354', 'grad_norm': '0.04212', 'learning_rate': '6.209e-05', 'epoch': '25.72'}
{'loss': '0.001875', 'grad_norm': '0.03478', 'learning_rate': '6.185e-05', 'epoch': '25.76'}
{'loss': '0.001513', 'grad_norm': '0.03543', 'learning_rate': '6.161e-05', 'epoch': '25.79'}
{'loss': '0.002151', 'grad_norm': '0.02936', 'learning_rate': '6.137e-05', 'epoch': '25.82'}
{'loss': '0.001603', 'grad_norm': '0.01787', 'learning_rate': '6.114e-05', 'epoch': '25.85'}
{'loss': '0.002914', 'grad_norm': '0.07605', 'learning_rate': '6.09e-05', 'epoch': '25.88'}
{'loss': '0.001203', 'grad_norm': '0.01601', 'learning_rate': '6.066e-05', 'epoch': '25.91'}
{'loss': '0.002357', 'grad_norm': '0.04206', 'learning_rate': '6.042e-05', 'epoch': '25.94'}
{'loss': '0.001536', 'grad_norm': '0.02852', 'learning_rate': '6.019e-05', 'epoch': '25.98'}
{'loss': '0.001532', 'grad_norm': '0.06623', 'learning_rate': '5.995e-05', 'epoch': '26'}
{'loss': '0.001775', 'grad_norm': '0.05379', 'learning_rate': '5.971e-05', 'epoch': '26.03'}
{'loss': '0.001449', 'grad_norm': '0.05192', 'learning_rate': '5.948e-05', 'epoch': '26.06'}
{'loss': '0.001649', 'grad_norm': '0.1042', 'learning_rate': '5.924e-05', 'epoch': '26.09'}
{'loss': '0.001389', 'grad_norm': '0.04213', 'learning_rate': '5.9e-05', 'epoch': '26.13'}
{'loss': '0.001678', 'grad_norm': '0.05239', 'learning_rate': '5.877e-05', 'epoch': '26.16'}
{'loss': '0.001323', 'grad_norm': '0.0215', 'learning_rate': '5.853e-05', 'epoch': '26.19'}
{'loss': '0.002104', 'grad_norm': '0.02997', 'learning_rate': '5.83e-05', 'epoch': '26.22'}
{'loss': '0.00174', 'grad_norm': '0.05956', 'learning_rate': '5.806e-05', 'epoch': '26.25'}
{'loss': '0.001462', 'grad_norm': '0.02349', 'learning_rate': '5.783e-05', 'epoch': '26.28'}
{'loss': '0.002196', 'grad_norm': '0.03073', 'learning_rate': '5.76e-05', 'epoch': '26.31'}
{'loss': '0.001797', 'grad_norm': '0.019', 'learning_rate': '5.736e-05', 'epoch': '26.35'}
{'loss': '0.001131', 'grad_norm': '0.04285', 'learning_rate': '5.713e-05', 'epoch': '26.38'}
{'loss': '0.001574', 'grad_norm': '0.02858', 'learning_rate': '5.689e-05', 'epoch': '26.41'}
{'loss': '0.001959', 'grad_norm': '0.03565', 'learning_rate': '5.666e-05', 'epoch': '26.44'}
{'loss': '0.001878', 'grad_norm': '0.03027', 'learning_rate': '5.643e-05', 'epoch': '26.47'}
{'loss': '0.002377', 'grad_norm': '0.05914', 'learning_rate': '5.62e-05', 'epoch': '26.5'}
{'loss': '0.001812', 'grad_norm': '0.03833', 'learning_rate': '5.596e-05', 'epoch': '26.54'}
{'loss': '0.002008', 'grad_norm': '0.05958', 'learning_rate': '5.573e-05', 'epoch': '26.57'}
{'loss': '0.001145', 'grad_norm': '0.02017', 'learning_rate': '5.55e-05', 'epoch': '26.6'}
{'loss': '0.001273', 'grad_norm': '0.03259', 'learning_rate': '5.527e-05', 'epoch': '26.63'}
{'loss': '0.001199', 'grad_norm': '0.02452', 'learning_rate': '5.504e-05', 'epoch': '26.66'}
{'loss': '0.002318', 'grad_norm': '0.03592', 'learning_rate': '5.481e-05', 'epoch': '26.69'}
{'loss': '0.001567', 'grad_norm': '0.03872', 'learning_rate': '5.458e-05', 'epoch': '26.72'}
{'loss': '0.001403', 'grad_norm': '0.02017', 'learning_rate': '5.435e-05', 'epoch': '26.76'}
{'loss': '0.0009621', 'grad_norm': '0.0208', 'learning_rate': '5.412e-05', 'epoch': '26.79'}
{'loss': '0.001792', 'grad_norm': '0.05053', 'learning_rate': '5.389e-05', 'epoch': '26.82'}
{'loss': '0.001077', 'grad_norm': '0.01742', 'learning_rate': '5.366e-05', 'epoch': '26.85'}
{'loss': '0.001516', 'grad_norm': '0.01799', 'learning_rate': '5.343e-05', 'epoch': '26.88'}
{'loss': '0.001553', 'grad_norm': '0.02825', 'learning_rate': '5.32e-05', 'epoch': '26.91'}
{'loss': '0.001129', 'grad_norm': '0.02439', 'learning_rate': '5.297e-05', 'epoch': '26.94'}
{'loss': '0.002066', 'grad_norm': '0.06932', 'learning_rate': '5.275e-05', 'epoch': '26.98'}
{'loss': '0.00181', 'grad_norm': '0.03011', 'learning_rate': '5.252e-05', 'epoch': '27'}
{'loss': '0.00158', 'grad_norm': '0.02553', 'learning_rate': '5.229e-05', 'epoch': '27.03'}
{'loss': '0.001646', 'grad_norm': '0.02827', 'learning_rate': '5.206e-05', 'epoch': '27.06'}
{'loss': '0.001564', 'grad_norm': '0.01418', 'learning_rate': '5.184e-05', 'epoch': '27.09'}
{'loss': '0.001676', 'grad_norm': '0.07914', 'learning_rate': '5.161e-05', 'epoch': '27.13'}
{'loss': '0.001334', 'grad_norm': '0.01316', 'learning_rate': '5.139e-05', 'epoch': '27.16'}
{'loss': '0.001754', 'grad_norm': '0.04223', 'learning_rate': '5.116e-05', 'epoch': '27.19'}
{'loss': '0.002429', 'grad_norm': '0.01678', 'learning_rate': '5.094e-05', 'epoch': '27.22'}
{'loss': '0.001762', 'grad_norm': '0.03194', 'learning_rate': '5.071e-05', 'epoch': '27.25'}
{'loss': '0.001192', 'grad_norm': '0.02766', 'learning_rate': '5.049e-05', 'epoch': '27.28'}
{'loss': '0.001191', 'grad_norm': '0.01292', 'learning_rate': '5.026e-05', 'epoch': '27.31'}
{'loss': '0.001413', 'grad_norm': '0.0196', 'learning_rate': '5.004e-05', 'epoch': '27.35'}
{'loss': '0.001721', 'grad_norm': '0.0453', 'learning_rate': '4.981e-05', 'epoch': '27.38'}
{'loss': '0.001636', 'grad_norm': '0.04799', 'learning_rate': '4.959e-05', 'epoch': '27.41'}
{'loss': '0.001812', 'grad_norm': '0.08627', 'learning_rate': '4.937e-05', 'epoch': '27.44'}
{'loss': '0.001333', 'grad_norm': '0.03596', 'learning_rate': '4.914e-05', 'epoch': '27.47'}
{'loss': '0.002053', 'grad_norm': '0.038', 'learning_rate': '4.892e-05', 'epoch': '27.5'}
{'loss': '0.001871', 'grad_norm': '0.0386', 'learning_rate': '4.87e-05', 'epoch': '27.54'}
{'loss': '0.001261', 'grad_norm': '0.01627', 'learning_rate': '4.848e-05', 'epoch': '27.57'}
{'loss': '0.001397', 'grad_norm': '0.02633', 'learning_rate': '4.826e-05', 'epoch': '27.6'}
{'loss': '0.001389', 'grad_norm': '0.04592', 'learning_rate': '4.804e-05', 'epoch': '27.63'}
{'loss': '0.001256', 'grad_norm': '0.01367', 'learning_rate': '4.782e-05', 'epoch': '27.66'}
{'loss': '0.00127', 'grad_norm': '0.01961', 'learning_rate': '4.76e-05', 'epoch': '27.69'}
{'loss': '0.002337', 'grad_norm': '0.08963', 'learning_rate': '4.738e-05', 'epoch': '27.72'}
{'loss': '0.001643', 'grad_norm': '0.0336', 'learning_rate': '4.716e-05', 'epoch': '27.76'}
{'loss': '0.001566', 'grad_norm': '0.04337', 'learning_rate': '4.694e-05', 'epoch': '27.79'}
{'loss': '0.001161', 'grad_norm': '0.03452', 'learning_rate': '4.672e-05', 'epoch': '27.82'}
{'loss': '0.002296', 'grad_norm': '0.03611', 'learning_rate': '4.65e-05', 'epoch': '27.85'}
{'loss': '0.001675', 'grad_norm': '0.03248', 'learning_rate': '4.628e-05', 'epoch': '27.88'}
{'loss': '0.00154', 'grad_norm': '0.03205', 'learning_rate': '4.606e-05', 'epoch': '27.91'}
{'loss': '0.001719', 'grad_norm': '0.07771', 'learning_rate': '4.585e-05', 'epoch': '27.94'}
{'loss': '0.001681', 'grad_norm': '0.02814', 'learning_rate': '4.563e-05', 'epoch': '27.98'}
{'loss': '0.001413', 'grad_norm': '0.02664', 'learning_rate': '4.541e-05', 'epoch': '28'}
{'loss': '0.001621', 'grad_norm': '0.04798', 'learning_rate': '4.52e-05', 'epoch': '28.03'}
{'loss': '0.00171', 'grad_norm': '0.02213', 'learning_rate': '4.498e-05', 'epoch': '28.06'}
 70%|███████   | 1796/2560 [08:31<03:24,  3.74it/s]
 70%|███████   | 1797/2560 [08:31<03:26,  3.69it/s]
 70%|███████   | 1798/2560 [08:32<03:27,  3.67it/s]
                                                   

 70%|███████   | 1798/2560 [08:32<03:27,  3.67it/s]
 70%|███████   | 1799/2560 [08:32<03:28,  3.64it/s]
 70%|███████   | 1800/2560 [08:32<03:27,  3.66it/s]
                                                   

 70%|███████   | 1800/2560 [08:32<03:27,  3.66it/s]
 70%|███████   | 1801/2560 [08:33<03:26,  3.67it/s]
 70%|███████   | 1802/2560 [08:33<03:27,  3.66it/s]
                                                   

 70%|███████   | 1802/2560 [08:33<03:27,  3.66it/s]
 70%|███████   | 1803/2560 [08:33<03:27,  3.65it/s]
 70%|███████   | 1804/2560 [08:33<03:26,  3.65it/s]
                                                   

 70%|███████   | 1804/2560 [08:33<03:26,  3.65it/s]
 71%|███████   | 1805/2560 [08:34<03:27,  3.63it/s]
 71%|███████   | 1806/2560 [08:34<03:28,  3.62it/s]
                                                   

 71%|███████   | 1806/2560 [08:34<03:28,  3.62it/s]
 71%|███████   | 1807/2560 [08:34<03:27,  3.63it/s]
 71%|███████   | 1808/2560 [08:35<03:27,  3.63it/s]
                                                   

 71%|███████   | 1808/2560 [08:35<03:27,  3.63it/s]
 71%|███████   | 1809/2560 [08:35<03:26,  3.64it/s]
 71%|███████   | 1810/2560 [08:35<03:28,  3.60it/s]
                                                   

 71%|███████   | 1810/2560 [08:35<03:28,  3.60it/s]
 71%|███████   | 1811/2560 [08:35<03:28,  3.60it/s]
 71%|███████   | 1812/2560 [08:36<05:08,  2.42it/s]
                                                   

 71%|███████   | 1812/2560 [08:36<05:08,  2.42it/s]
 71%|███████   | 1813/2560 [08:36<04:40,  2.66it/s]
 71%|███████   | 1814/2560 [08:37<04:18,  2.88it/s]
                                                   

 71%|███████   | 1814/2560 [08:37<04:18,  2.88it/s]
 71%|███████   | 1815/2560 [08:37<04:07,  3.01it/s]
 71%|███████   | 1816/2560 [08:37<03:52,  3.20it/s]
                                                   

 71%|███████   | 1816/2560 [08:37<03:52,  3.20it/s]
 71%|███████   | 1817/2560 [08:37<03:44,  3.31it/s]
 71%|███████   | 1818/2560 [08:38<03:37,  3.41it/s]
                                                   

 71%|███████   | 1818/2560 [08:38<03:37,  3.41it/s]
 71%|███████   | 1819/2560 [08:38<03:30,  3.53it/s]
 71%|███████   | 1820/2560 [08:38<03:24,  3.62it/s]
                                                   

 71%|███████   | 1820/2560 [08:38<03:24,  3.62it/s]
 71%|███████   | 1821/2560 [08:39<03:20,  3.69it/s]
 71%|███████   | 1822/2560 [08:39<03:17,  3.74it/s]
                                                   

 71%|███████   | 1822/2560 [08:39<03:17,  3.74it/s]
 71%|███████   | 1823/2560 [08:39<03:14,  3.78it/s]
 71%|███████▏  | 1824/2560 [08:39<03:14,  3.79it/s]
                                                   

 71%|███████▏  | 1824/2560 [08:39<03:14,  3.79it/s]
 71%|███████▏  | 1825/2560 [08:40<03:13,  3.79it/s]
 71%|███████▏  | 1826/2560 [08:40<03:12,  3.81it/s]
                                                   

 71%|███████▏  | 1826/2560 [08:40<03:12,  3.81it/s]
 71%|███████▏  | 1827/2560 [08:40<03:12,  3.81it/s]
 71%|███████▏  | 1828/2560 [08:40<03:10,  3.84it/s]
                                                   

 71%|███████▏  | 1828/2560 [08:40<03:10,  3.84it/s]
 71%|███████▏  | 1829/2560 [08:41<03:09,  3.85it/s]
 71%|███████▏  | 1830/2560 [08:41<03:08,  3.88it/s]
                                                   

 71%|███████▏  | 1830/2560 [08:41<03:08,  3.88it/s]
 72%|███████▏  | 1831/2560 [08:41<03:07,  3.89it/s]
 72%|███████▏  | 1832/2560 [08:41<03:06,  3.91it/s]
                                                   

 72%|███████▏  | 1832/2560 [08:41<03:06,  3.91it/s]
 72%|███████▏  | 1833/2560 [08:42<03:06,  3.90it/s]
 72%|███████▏  | 1834/2560 [08:42<03:05,  3.91it/s]
                                                   

 72%|███████▏  | 1834/2560 [08:42<03:05,  3.91it/s]
 72%|███████▏  | 1835/2560 [08:42<03:06,  3.88it/s]
 72%|███████▏  | 1836/2560 [08:42<03:05,  3.90it/s]
                                                   

 72%|███████▏  | 1836/2560 [08:42<03:05,  3.90it/s]
 72%|███████▏  | 1837/2560 [08:43<03:05,  3.91it/s]
 72%|███████▏  | 1838/2560 [08:43<03:04,  3.91it/s]
                                                   

 72%|███████▏  | 1838/2560 [08:43<03:04,  3.91it/s]
 72%|███████▏  | 1839/2560 [08:43<03:05,  3.89it/s]
 72%|███████▏  | 1840/2560 [08:43<03:05,  3.89it/s]
                                                   

 72%|███████▏  | 1840/2560 [08:43<03:05,  3.89it/s]
 72%|███████▏  | 1841/2560 [08:44<03:04,  3.89it/s]
 72%|███████▏  | 1842/2560 [08:44<03:06,  3.86it/s]
                                                   

 72%|███████▏  | 1842/2560 [08:44<03:06,  3.86it/s]
 72%|███████▏  | 1843/2560 [08:44<03:04,  3.88it/s]
 72%|███████▏  | 1844/2560 [08:44<03:08,  3.80it/s]
                                                   

 72%|███████▏  | 1844/2560 [08:44<03:08,  3.80it/s]
 72%|███████▏  | 1845/2560 [08:45<03:08,  3.79it/s]
 72%|███████▏  | 1846/2560 [08:45<03:07,  3.80it/s]
                                                   

 72%|███████▏  | 1846/2560 [08:45<03:07,  3.80it/s]
 72%|███████▏  | 1847/2560 [08:45<03:07,  3.80it/s]
 72%|███████▏  | 1848/2560 [08:46<03:08,  3.78it/s]
                                                   

 72%|███████▏  | 1848/2560 [08:46<03:08,  3.78it/s]
 72%|███████▏  | 1849/2560 [08:46<03:10,  3.73it/s]
 72%|███████▏  | 1850/2560 [08:46<03:08,  3.76it/s]
                                                   

 72%|███████▏  | 1850/2560 [08:46<03:08,  3.76it/s]
 72%|███████▏  | 1851/2560 [08:46<03:08,  3.77it/s]
 72%|███████▏  | 1852/2560 [08:47<03:07,  3.78it/s]
                                                   

 72%|███████▏  | 1852/2560 [08:47<03:07,  3.78it/s]
 72%|███████▏  | 1853/2560 [08:47<03:05,  3.81it/s]
 72%|███████▏  | 1854/2560 [08:47<03:03,  3.85it/s]
                                                   

 72%|███████▏  | 1854/2560 [08:47<03:03,  3.85it/s]
 72%|███████▏  | 1855/2560 [08:47<03:03,  3.85it/s]
 72%|███████▎  | 1856/2560 [08:47<02:34,  4.55it/s]
                                                   

 72%|███████▎  | 1856/2560 [08:47<02:34,  4.55it/s]
 73%|███████▎  | 1857/2560 [08:48<02:44,  4.27it/s]
 73%|███████▎  | 1858/2560 [08:48<02:49,  4.13it/s]
                                                   

 73%|███████▎  | 1858/2560 [08:48<02:49,  4.13it/s]
 73%|███████▎  | 1859/2560 [08:48<02:53,  4.05it/s]
 73%|███████▎  | 1860/2560 [08:49<02:53,  4.03it/s]
                                                   

 73%|███████▎  | 1860/2560 [08:49<02:53,  4.03it/s]
 73%|███████▎  | 1861/2560 [08:49<02:55,  3.97it/s]
 73%|███████▎  | 1862/2560 [08:49<02:59,  3.89it/s]
                                                   

 73%|███████▎  | 1862/2560 [08:49<02:59,  3.89it/s]
 73%|███████▎  | 1863/2560 [08:49<02:59,  3.88it/s]
 73%|███████▎  | 1864/2560 [08:50<02:59,  3.87it/s]
                                                   

 73%|███████▎  | 1864/2560 [08:50<02:59,  3.87it/s]
 73%|███████▎  | 1865/2560 [08:50<02:58,  3.90it/s]
 73%|███████▎  | 1866/2560 [08:50<02:57,  3.90it/s]
                                                   

 73%|███████▎  | 1866/2560 [08:50<02:57,  3.90it/s]
 73%|███████▎  | 1867/2560 [08:50<02:57,  3.91it/s]
 73%|███████▎  | 1868/2560 [08:51<02:57,  3.90it/s]
                                                   

 73%|███████▎  | 1868/2560 [08:51<02:57,  3.90it/s]
 73%|███████▎  | 1869/2560 [08:51<02:57,  3.90it/s]
 73%|███████▎  | 1870/2560 [08:51<02:57,  3.90it/s]
                                                   

 73%|███████▎  | 1870/2560 [08:51<02:57,  3.90it/s]
 73%|███████▎  | 1871/2560 [08:51<02:59,  3.83it/s]
 73%|███████▎  | 1872/2560 [08:52<02:59,  3.84it/s]
                                                   

 73%|███████▎  | 1872/2560 [08:52<02:59,  3.84it/s]
 73%|███████▎  | 1873/2560 [08:52<02:58,  3.85it/s]
 73%|███████▎  | 1874/2560 [08:52<02:57,  3.86it/s]
                                                   

 73%|███████▎  | 1874/2560 [08:52<02:57,  3.86it/s]
 73%|███████▎  | 1875/2560 [08:52<02:57,  3.86it/s]
 73%|███████▎  | 1876/2560 [08:53<02:57,  3.85it/s]
                                                   

 73%|███████▎  | 1876/2560 [08:53<02:57,  3.85it/s]
 73%|███████▎  | 1877/2560 [08:53<02:57,  3.85it/s]
 73%|███████▎  | 1878/2560 [08:53<02:56,  3.87it/s]
                                                   

 73%|███████▎  | 1878/2560 [08:53<02:56,  3.87it/s]
 73%|███████▎  | 1879/2560 [08:53<02:55,  3.87it/s]
 73%|███████▎  | 1880/2560 [08:54<02:55,  3.88it/s]
                                                   

 73%|███████▎  | 1880/2560 [08:54<02:55,  3.88it/s]
 73%|███████▎  | 1881/2560 [08:54<02:55,  3.87it/s]
 74%|███████▎  | 1882/2560 [08:54<02:55,  3.86it/s]
                                                   

 74%|███████▎  | 1882/2560 [08:54<02:55,  3.86it/s]
 74%|███████▎  | 1883/2560 [08:54<02:56,  3.84it/s]
 74%|███████▎  | 1884/2560 [08:55<02:57,  3.81it/s]
                                                   

 74%|███████▎  | 1884/2560 [08:55<02:57,  3.81it/s]
 74%|███████▎  | 1885/2560 [08:55<02:56,  3.82it/s]
 74%|███████▎  | 1886/2560 [08:55<02:56,  3.82it/s]
                                                   

 74%|███████▎  | 1886/2560 [08:55<02:56,  3.82it/s]
 74%|███████▎  | 1887/2560 [08:56<02:55,  3.84it/s]
 74%|███████▍  | 1888/2560 [08:56<02:59,  3.75it/s]
                                                   

 74%|███████▍  | 1888/2560 [08:56<02:59,  3.75it/s]
 74%|███████▍  | 1889/2560 [08:56<03:00,  3.72it/s]
 74%|███████▍  | 1890/2560 [08:56<03:01,  3.69it/s]
                                                   

 74%|███████▍  | 1890/2560 [08:56<03:01,  3.69it/s]
 74%|███████▍  | 1891/2560 [08:57<03:03,  3.65it/s]
 74%|███████▍  | 1892/2560 [08:57<03:04,  3.63it/s]
                                                   

 74%|███████▍  | 1892/2560 [08:57<03:04,  3.63it/s]
 74%|███████▍  | 1893/2560 [08:57<03:05,  3.60it/s]
 74%|███████▍  | 1894/2560 [08:58<03:10,  3.49it/s]
                                                   

 74%|███████▍  | 1894/2560 [08:58<03:10,  3.49it/s]
 74%|███████▍  | 1895/2560 [08:58<03:21,  3.30it/s]
 74%|███████▍  | 1896/2560 [08:58<03:16,  3.38it/s]
                                                   

 74%|███████▍  | 1896/2560 [08:58<03:16,  3.38it/s]
 74%|███████▍  | 1897/2560 [08:58<03:10,  3.47it/s]
 74%|███████▍  | 1898/2560 [08:59<03:07,  3.54it/s]
                                                   

 74%|███████▍  | 1898/2560 [08:59<03:07,  3.54it/s]
 74%|███████▍  | 1899/2560 [08:59<03:03,  3.60it/s]
 74%|███████▍  | 1900/2560 [08:59<03:03,  3.60it/s]
                                                   

 74%|███████▍  | 1900/2560 [08:59<03:03,  3.60it/s]
 74%|███████▍  | 1901/2560 [09:00<03:04,  3.58it/s]
 74%|███████▍  | 1902/2560 [09:00<03:02,  3.61it/s]
                                                   

 74%|███████▍  | 1902/2560 [09:00<03:02,  3.61it/s]
 74%|███████▍  | 1903/2560 [09:00<03:01,  3.62it/s]
 74%|███████▍  | 1904/2560 [09:00<02:59,  3.65it/s]
                                                   

 74%|███████▍  | 1904/2560 [09:00<02:59,  3.65it/s]
 74%|███████▍  | 1905/2560 [09:01<03:00,  3.64it/s]
 74%|███████▍  | 1906/2560 [09:01<02:59,  3.65it/s]
                                                   

 74%|███████▍  | 1906/2560 [09:01<02:59,  3.65it/s]
 74%|███████▍  | 1907/2560 [09:01<02:59,  3.63it/s]
 75%|███████▍  | 1908/2560 [09:01<02:59,  3.63it/s]
                                                   

 75%|███████▍  | 1908/2560 [09:01<02:59,  3.63it/s]
 75%|███████▍  | 1909/2560 [09:02<03:00,  3.62it/s]
 75%|███████▍  | 1910/2560 [09:02<02:59,  3.62it/s]
                                                   

 75%|███████▍  | 1910/2560 [09:02<02:59,  3.62it/s]
 75%|███████▍  | 1911/2560 [09:02<02:58,  3.63it/s]
 75%|███████▍  | 1912/2560 [09:03<02:58,  3.62it/s]
                                                   

 75%|███████▍  | 1912/2560 [09:03<02:58,  3.62it/s]
 75%|███████▍  | 1913/2560 [09:03<02:58,  3.63it/s]
 75%|███████▍  | 1914/2560 [09:03<02:57,  3.65it/s]
                                                   

 75%|███████▍  | 1914/2560 [09:03<02:57,  3.65it/s]
 75%|███████▍  | 1915/2560 [09:03<02:57,  3.63it/s]
 75%|███████▍  | 1916/2560 [09:04<02:56,  3.65it/s]
                                                   

 75%|███████▍  | 1916/2560 [09:04<02:56,  3.65it/s]
 75%|███████▍  | 1917/2560 [09:04<02:54,  3.68it/s]
 75%|███████▍  | 1918/2560 [09:04<02:54,  3.67it/s]
                                                   

 75%|███████▍  | 1918/2560 [09:04<02:54,  3.67it/s]
 75%|███████▍  | 1919/2560 [09:04<02:54,  3.67it/s]
 75%|███████▌  | 1920/2560 [09:05<02:26,  4.36it/s]
                                                   

 75%|███████▌  | 1920/2560 [09:05<02:26,  4.36it/s]
 75%|███████▌  | 1921/2560 [09:05<02:35,  4.10it/s]
 75%|███████▌  | 1922/2560 [09:05<02:41,  3.95it/s]
                                                   

 75%|███████▌  | 1922/2560 [09:05<02:41,  3.95it/s]
 75%|███████▌  | 1923/2560 [09:05<02:46,  3.84it/s]
 75%|███████▌  | 1924/2560 [09:06<02:46,  3.81it/s]
                                                   

 75%|███████▌  | 1924/2560 [09:06<02:46,  3.81it/s]
 75%|███████▌  | 1925/2560 [09:06<02:49,  3.76it/s]
 75%|███████▌  | 1926/2560 [09:06<02:49,  3.73it/s]
                                                   

 75%|███████▌  | 1926/2560 [09:06<02:49,  3.73it/s]
 75%|███████▌  | 1927/2560 [09:06<02:51,  3.70it/s]
 75%|███████▌  | 1928/2560 [09:07<02:54,  3.63it/s]
                                                   

 75%|███████▌  | 1928/2560 [09:07<02:54,  3.63it/s]
 75%|███████▌  | 1929/2560 [09:07<02:53,  3.63it/s]
 75%|███████▌  | 1930/2560 [09:07<02:54,  3.61it/s]
                                                   

 75%|███████▌  | 1930/2560 [09:07<02:54,  3.61it/s]
 75%|███████▌  | 1931/2560 [09:08<02:53,  3.62it/s]
 75%|███████▌  | 1932/2560 [09:08<02:56,  3.57it/s]
                                                   

 75%|███████▌  | 1932/2560 [09:08<02:56,  3.57it/s]
 76%|███████▌  | 1933/2560 [09:08<02:54,  3.60it/s]
 76%|███████▌  | 1934/2560 [09:08<02:53,  3.61it/s]
                                                   

 76%|███████▌  | 1934/2560 [09:08<02:53,  3.61it/s]
 76%|███████▌  | 1935/2560 [09:09<02:53,  3.61it/s]
 76%|███████▌  | 1936/2560 [09:09<02:51,  3.64it/s]
                                                   

 76%|███████▌  | 1936/2560 [09:09<02:51,  3.64it/s]
 76%|███████▌  | 1937/2560 [09:09<02:50,  3.65it/s]
 76%|███████▌  | 1938/2560 [09:10<02:49,  3.68it/s]
                                                   

 76%|███████▌  | 1938/2560 [09:10<02:49,  3.68it/s]
 76%|███████▌  | 1939/2560 [09:10<02:49,  3.67it/s]
 76%|███████▌  | 1940/2560 [09:10<02:48,  3.68it/s]
                                                   

 76%|███████▌  | 1940/2560 [09:10<02:48,  3.68it/s]
 76%|███████▌  | 1941/2560 [09:10<02:49,  3.66it/s]
 76%|███████▌  | 1942/2560 [09:11<02:49,  3.65it/s]
                                                   

 76%|███████▌  | 1942/2560 [09:11<02:49,  3.65it/s]
 76%|███████▌  | 1943/2560 [09:11<02:47,  3.69it/s]
 76%|███████▌  | 1944/2560 [09:11<02:45,  3.71it/s]
                                                   

 76%|███████▌  | 1944/2560 [09:11<02:45,  3.71it/s]
 76%|███████▌  | 1945/2560 [09:11<02:44,  3.74it/s]
 76%|███████▌  | 1946/2560 [09:12<02:42,  3.78it/s]
                                                   

 76%|███████▌  | 1946/2560 [09:12<02:42,  3.78it/s]
 76%|███████▌  | 1947/2560 [09:12<02:42,  3.78it/s]
 76%|███████▌  | 1948/2560 [09:12<02:40,  3.81it/s]
                                                   

 76%|███████▌  | 1948/2560 [09:12<02:40,  3.81it/s]
 76%|███████▌  | 1949/2560 [09:12<02:39,  3.82it/s]
 76%|███████▌  | 1950/2560 [09:13<02:39,  3.83it/s]
                                                   

 76%|███████▌  | 1950/2560 [09:13<02:39,  3.83it/s]
 76%|███████▌  | 1951/2560 [09:13<02:39,  3.82it/s]
 76%|███████▋  | 1952/2560 [09:13<02:38,  3.83it/s]
                                                   

 76%|███████▋  | 1952/2560 [09:13<02:38,  3.83it/s]
 76%|███████▋  | 1953/2560 [09:14<02:38,  3.82it/s]
 76%|███████▋  | 1954/2560 [09:14<02:38,  3.83it/s]
                                                   

 76%|███████▋  | 1954/2560 [09:14<02:38,  3.83it/s]
 76%|███████▋  | 1955/2560 [09:14<02:37,  3.83it/s]
 76%|███████▋  | 1956/2560 [09:14<02:39,  3.80it/s]
                                                   

 76%|███████▋  | 1956/2560 [09:14<02:39,  3.80it/s]
 76%|███████▋  | 1957/2560 [09:15<02:39,  3.78it/s]
 76%|███████▋  | 1958/2560 [09:15<02:40,  3.75it/s]
                                                   

 76%|███████▋  | 1958/2560 [09:15<02:40,  3.75it/s]
 77%|███████▋  | 1959/2560 [09:15<02:40,  3.74it/s]
 77%|███████▋  | 1960/2560 [09:15<02:40,  3.73it/s]
                                                   

 77%|███████▋  | 1960/2560 [09:15<02:40,  3.73it/s]
 77%|███████▋  | 1961/2560 [09:16<02:40,  3.72it/s]
 77%|███████▋  | 1962/2560 [09:16<02:39,  3.74it/s]
                                                   

 77%|███████▋  | 1962/2560 [09:16<02:39,  3.74it/s]
 77%|███████▋  | 1963/2560 [09:16<02:38,  3.76it/s]
 77%|███████▋  | 1964/2560 [09:16<02:37,  3.78it/s]
                                                   

 77%|███████▋  | 1964/2560 [09:16<02:37,  3.78it/s]
 77%|███████▋  | 1965/2560 [09:17<02:39,  3.72it/s]
 77%|███████▋  | 1966/2560 [09:17<02:38,  3.74it/s]
                                                   

 77%|███████▋  | 1966/2560 [09:17<02:38,  3.74it/s]
 77%|███████▋  | 1967/2560 [09:17<02:37,  3.77it/s]
 77%|███████▋  | 1968/2560 [09:17<02:35,  3.80it/s]
                                                   

 77%|███████▋  | 1968/2560 [09:17<02:35,  3.80it/s]
 77%|███████▋  | 1969/2560 [09:18<02:34,  3.83it/s]
 77%|███████▋  | 1970/2560 [09:18<02:33,  3.84it/s]
                                                   

 77%|███████▋  | 1970/2560 [09:18<02:33,  3.84it/s]
 77%|███████▋  | 1971/2560 [09:18<02:34,  3.81it/s]
 77%|███████▋  | 1972/2560 [09:19<02:35,  3.78it/s]
                                                   

 77%|███████▋  | 1972/2560 [09:19<02:35,  3.78it/s]
 77%|███████▋  | 1973/2560 [09:19<02:35,  3.78it/s]
 77%|███████▋  | 1974/2560 [09:19<02:36,  3.75it/s]
                                                   
{'loss': '0.001432', 'grad_norm': '0.0209', 'learning_rate': '4.477e-05', 'epoch': '28.09'}
{'loss': '0.001848', 'grad_norm': '0.04122', 'learning_rate': '4.455e-05', 'epoch': '28.13'}
{'loss': '0.001518', 'grad_norm': '0.01629', 'learning_rate': '4.434e-05', 'epoch': '28.16'}
{'loss': '0.001814', 'grad_norm': '0.01761', 'learning_rate': '4.412e-05', 'epoch': '28.19'}
{'loss': '0.00152', 'grad_norm': '0.0235', 'learning_rate': '4.391e-05', 'epoch': '28.22'}
{'loss': '0.001576', 'grad_norm': '0.04244', 'learning_rate': '4.369e-05', 'epoch': '28.25'}
{'loss': '0.001248', 'grad_norm': '0.0162', 'learning_rate': '4.348e-05', 'epoch': '28.28'}
{'loss': '0.001604', 'grad_norm': '0.01822', 'learning_rate': '4.327e-05', 'epoch': '28.31'}
{'loss': '0.001713', 'grad_norm': '0.02229', 'learning_rate': '4.305e-05', 'epoch': '28.35'}
{'loss': '0.001619', 'grad_norm': '0.03667', 'learning_rate': '4.284e-05', 'epoch': '28.38'}
{'loss': '0.001861', 'grad_norm': '0.04489', 'learning_rate': '4.263e-05', 'epoch': '28.41'}
{'loss': '0.001427', 'grad_norm': '0.02027', 'learning_rate': '4.242e-05', 'epoch': '28.44'}
{'loss': '0.001694', 'grad_norm': '0.05071', 'learning_rate': '4.221e-05', 'epoch': '28.47'}
{'loss': '0.00171', 'grad_norm': '0.03298', 'learning_rate': '4.2e-05', 'epoch': '28.5'}
{'loss': '0.001616', 'grad_norm': '0.03224', 'learning_rate': '4.179e-05', 'epoch': '28.54'}
{'loss': '0.001285', 'grad_norm': '0.02677', 'learning_rate': '4.158e-05', 'epoch': '28.57'}
{'loss': '0.0009232', 'grad_norm': '0.04154', 'learning_rate': '4.137e-05', 'epoch': '28.6'}
{'loss': '0.001229', 'grad_norm': '0.02009', 'learning_rate': '4.116e-05', 'epoch': '28.63'}
{'loss': '0.001568', 'grad_norm': '0.02934', 'learning_rate': '4.095e-05', 'epoch': '28.66'}
{'loss': '0.001326', 'grad_norm': '0.03353', 'learning_rate': '4.074e-05', 'epoch': '28.69'}
{'loss': '0.001808', 'grad_norm': '0.0292', 'learning_rate': '4.053e-05', 'epoch': '28.72'}
{'loss': '0.001663', 'grad_norm': '0.028', 'learning_rate': '4.033e-05', 'epoch': '28.76'}
{'loss': '0.001866', 'grad_norm': '0.04731', 'learning_rate': '4.012e-05', 'epoch': '28.79'}
{'loss': '0.001788', 'grad_norm': '0.06217', 'learning_rate': '3.991e-05', 'epoch': '28.82'}
{'loss': '0.001044', 'grad_norm': '0.02192', 'learning_rate': '3.971e-05', 'epoch': '28.85'}
{'loss': '0.00128', 'grad_norm': '0.03432', 'learning_rate': '3.95e-05', 'epoch': '28.88'}
{'loss': '0.001643', 'grad_norm': '0.03919', 'learning_rate': '3.929e-05', 'epoch': '28.91'}
{'loss': '0.001301', 'grad_norm': '0.04012', 'learning_rate': '3.909e-05', 'epoch': '28.94'}
{'loss': '0.001809', 'grad_norm': '0.02005', 'learning_rate': '3.889e-05', 'epoch': '28.98'}
{'loss': '0.001303', 'grad_norm': '0.02859', 'learning_rate': '3.868e-05', 'epoch': '29'}
{'loss': '0.00181', 'grad_norm': '0.04342', 'learning_rate': '3.848e-05', 'epoch': '29.03'}
{'loss': '0.001286', 'grad_norm': '0.01674', 'learning_rate': '3.827e-05', 'epoch': '29.06'}
{'loss': '0.001743', 'grad_norm': '0.04742', 'learning_rate': '3.807e-05', 'epoch': '29.09'}
{'loss': '0.001638', 'grad_norm': '0.03528', 'learning_rate': '3.787e-05', 'epoch': '29.13'}
{'loss': '0.001628', 'grad_norm': '0.02859', 'learning_rate': '3.767e-05', 'epoch': '29.16'}
{'loss': '0.001597', 'grad_norm': '0.03056', 'learning_rate': '3.746e-05', 'epoch': '29.19'}
{'loss': '0.00121', 'grad_norm': '0.01274', 'learning_rate': '3.726e-05', 'epoch': '29.22'}
{'loss': '0.001731', 'grad_norm': '0.02491', 'learning_rate': '3.706e-05', 'epoch': '29.25'}
{'loss': '0.00131', 'grad_norm': '0.02251', 'learning_rate': '3.686e-05', 'epoch': '29.28'}
{'loss': '0.001441', 'grad_norm': '0.02397', 'learning_rate': '3.666e-05', 'epoch': '29.31'}
{'loss': '0.0012', 'grad_norm': '0.01803', 'learning_rate': '3.646e-05', 'epoch': '29.35'}
{'loss': '0.002067', 'grad_norm': '0.04398', 'learning_rate': '3.626e-05', 'epoch': '29.38'}
{'loss': '0.002016', 'grad_norm': '0.05087', 'learning_rate': '3.606e-05', 'epoch': '29.41'}
{'loss': '0.001604', 'grad_norm': '0.05262', 'learning_rate': '3.586e-05', 'epoch': '29.44'}
{'loss': '0.001903', 'grad_norm': '0.03965', 'learning_rate': '3.567e-05', 'epoch': '29.47'}
{'loss': '0.001372', 'grad_norm': '0.02872', 'learning_rate': '3.547e-05', 'epoch': '29.5'}
{'loss': '0.001556', 'grad_norm': '0.02597', 'learning_rate': '3.527e-05', 'epoch': '29.54'}
{'loss': '0.001646', 'grad_norm': '0.04486', 'learning_rate': '3.507e-05', 'epoch': '29.57'}
{'loss': '0.0009458', 'grad_norm': '0.03639', 'learning_rate': '3.488e-05', 'epoch': '29.6'}
{'loss': '0.001323', 'grad_norm': '0.01315', 'learning_rate': '3.468e-05', 'epoch': '29.63'}
{'loss': '0.001306', 'grad_norm': '0.0209', 'learning_rate': '3.449e-05', 'epoch': '29.66'}
{'loss': '0.002135', 'grad_norm': '0.05489', 'learning_rate': '3.429e-05', 'epoch': '29.69'}
{'loss': '0.001579', 'grad_norm': '0.01735', 'learning_rate': '3.41e-05', 'epoch': '29.72'}
{'loss': '0.001657', 'grad_norm': '0.05165', 'learning_rate': '3.39e-05', 'epoch': '29.76'}
{'loss': '0.001518', 'grad_norm': '0.03981', 'learning_rate': '3.371e-05', 'epoch': '29.79'}
{'loss': '0.00172', 'grad_norm': '0.02183', 'learning_rate': '3.352e-05', 'epoch': '29.82'}
{'loss': '0.001317', 'grad_norm': '0.01886', 'learning_rate': '3.332e-05', 'epoch': '29.85'}
{'loss': '0.001557', 'grad_norm': '0.03441', 'learning_rate': '3.313e-05', 'epoch': '29.88'}
{'loss': '0.001208', 'grad_norm': '0.01523', 'learning_rate': '3.294e-05', 'epoch': '29.91'}
{'loss': '0.001382', 'grad_norm': '0.0209', 'learning_rate': '3.275e-05', 'epoch': '29.94'}
{'loss': '0.001756', 'grad_norm': '0.0254', 'learning_rate': '3.256e-05', 'epoch': '29.98'}
{'loss': '0.001292', 'grad_norm': '0.02202', 'learning_rate': '3.237e-05', 'epoch': '30'}
{'loss': '0.001332', 'grad_norm': '0.01424', 'learning_rate': '3.218e-05', 'epoch': '30.03'}
{'loss': '0.001745', 'grad_norm': '0.02247', 'learning_rate': '3.199e-05', 'epoch': '30.06'}
{'loss': '0.001496', 'grad_norm': '0.03041', 'learning_rate': '3.18e-05', 'epoch': '30.09'}
{'loss': '0.001288', 'grad_norm': '0.03558', 'learning_rate': '3.161e-05', 'epoch': '30.13'}
{'loss': '0.001798', 'grad_norm': '0.03032', 'learning_rate': '3.142e-05', 'epoch': '30.16'}
{'loss': '0.001697', 'grad_norm': '0.03488', 'learning_rate': '3.123e-05', 'epoch': '30.19'}
{'loss': '0.00128', 'grad_norm': '0.0412', 'learning_rate': '3.105e-05', 'epoch': '30.22'}
{'loss': '0.001477', 'grad_norm': '0.02227', 'learning_rate': '3.086e-05', 'epoch': '30.25'}
{'loss': '0.001692', 'grad_norm': '0.0337', 'learning_rate': '3.067e-05', 'epoch': '30.28'}
{'loss': '0.001365', 'grad_norm': '0.02216', 'learning_rate': '3.049e-05', 'epoch': '30.31'}
{'loss': '0.001486', 'grad_norm': '0.02778', 'learning_rate': '3.03e-05', 'epoch': '30.35'}
{'loss': '0.002153', 'grad_norm': '0.06045', 'learning_rate': '3.012e-05', 'epoch': '30.38'}
{'loss': '0.001657', 'grad_norm': '0.02319', 'learning_rate': '2.993e-05', 'epoch': '30.41'}
{'loss': '0.001729', 'grad_norm': '0.02632', 'learning_rate': '2.975e-05', 'epoch': '30.44'}
{'loss': '0.001243', 'grad_norm': '0.01825', 'learning_rate': '2.956e-05', 'epoch': '30.47'}
{'loss': '0.001557', 'grad_norm': '0.03848', 'learning_rate': '2.938e-05', 'epoch': '30.5'}
{'loss': '0.001384', 'grad_norm': '0.01991', 'learning_rate': '2.92e-05', 'epoch': '30.54'}
{'loss': '0.001256', 'grad_norm': '0.021', 'learning_rate': '2.902e-05', 'epoch': '30.57'}
{'loss': '0.001248', 'grad_norm': '0.0584', 'learning_rate': '2.883e-05', 'epoch': '30.6'}
{'loss': '0.002326', 'grad_norm': '0.05881', 'learning_rate': '2.865e-05', 'epoch': '30.63'}
{'loss': '0.001659', 'grad_norm': '0.02617', 'learning_rate': '2.847e-05', 'epoch': '30.66'}
{'loss': '0.001923', 'grad_norm': '0.03528', 'learning_rate': '2.829e-05', 'epoch': '30.69'}
{'loss': '0.001158', 'grad_norm': '0.05451', 'learning_rate': '2.811e-05', 'epoch': '30.72'}
{'loss': '0.001671', 'grad_norm': '0.04231', 'learning_rate': '2.793e-05', 'epoch': '30.76'}
{'loss': '0.001266', 'grad_norm': '0.02301', 'learning_rate': '2.775e-05', 'epoch': '30.79'}
{'loss': '0.001285', 'grad_norm': '0.02278', 'learning_rate': '2.758e-05', 'epoch': '30.82'}
{'loss': '0.001359', 'grad_norm': '0.01836', 'learning_rate': '2.74e-05', 'epoch': '30.85'}
 77%|███████▋  | 1974/2560 [09:19<02:36,  3.75it/s]
 77%|███████▋  | 1975/2560 [09:19<02:36,  3.74it/s]
 77%|███████▋  | 1976/2560 [09:20<02:36,  3.73it/s]
                                                   

 77%|███████▋  | 1976/2560 [09:20<02:36,  3.73it/s]
 77%|███████▋  | 1977/2560 [09:20<02:36,  3.72it/s]
 77%|███████▋  | 1978/2560 [09:20<02:35,  3.74it/s]
                                                   

 77%|███████▋  | 1978/2560 [09:20<02:35,  3.74it/s]
 77%|███████▋  | 1979/2560 [09:20<02:34,  3.77it/s]
 77%|███████▋  | 1980/2560 [09:21<02:32,  3.79it/s]
                                                   

 77%|███████▋  | 1980/2560 [09:21<02:32,  3.79it/s]
 77%|███████▋  | 1981/2560 [09:21<02:32,  3.80it/s]
 77%|███████▋  | 1982/2560 [09:21<02:32,  3.78it/s]
                                                   

 77%|███████▋  | 1982/2560 [09:21<02:32,  3.78it/s]
 77%|███████▋  | 1983/2560 [09:21<02:33,  3.76it/s]
 78%|███████▊  | 1984/2560 [09:22<02:10,  4.43it/s]
                                                   

 78%|███████▊  | 1984/2560 [09:22<02:10,  4.43it/s]
 78%|███████▊  | 1985/2560 [09:22<02:17,  4.18it/s]
 78%|███████▊  | 1986/2560 [09:22<02:22,  4.04it/s]
                                                   

 78%|███████▊  | 1986/2560 [09:22<02:22,  4.04it/s]
 78%|███████▊  | 1987/2560 [09:22<02:25,  3.95it/s]
 78%|███████▊  | 1988/2560 [09:23<02:27,  3.88it/s]
                                                   

 78%|███████▊  | 1988/2560 [09:23<02:27,  3.88it/s]
 78%|███████▊  | 1989/2560 [09:23<02:29,  3.83it/s]
 78%|███████▊  | 1990/2560 [09:23<02:30,  3.79it/s]
                                                   

 78%|███████▊  | 1990/2560 [09:23<02:30,  3.79it/s]
 78%|███████▊  | 1991/2560 [09:23<02:30,  3.77it/s]
 78%|███████▊  | 1992/2560 [09:24<02:31,  3.74it/s]
                                                   

 78%|███████▊  | 1992/2560 [09:24<02:31,  3.74it/s]
 78%|███████▊  | 1993/2560 [09:24<02:33,  3.70it/s]
 78%|███████▊  | 1994/2560 [09:24<02:33,  3.70it/s]
                                                   

 78%|███████▊  | 1994/2560 [09:24<02:33,  3.70it/s]
 78%|███████▊  | 1995/2560 [09:25<02:33,  3.68it/s]
 78%|███████▊  | 1996/2560 [09:25<02:33,  3.67it/s]
                                                   

 78%|███████▊  | 1996/2560 [09:25<02:33,  3.67it/s]
 78%|███████▊  | 1997/2560 [09:25<02:33,  3.68it/s]
 78%|███████▊  | 1998/2560 [09:25<02:32,  3.69it/s]
                                                   

 78%|███████▊  | 1998/2560 [09:25<02:32,  3.69it/s]
 78%|███████▊  | 1999/2560 [09:26<02:31,  3.71it/s]
 78%|███████▊  | 2000/2560 [09:26<02:31,  3.70it/s]
                                                   

 78%|███████▊  | 2000/2560 [09:26<02:31,  3.70it/s]
 78%|███████▊  | 2001/2560 [09:26<02:41,  3.47it/s]
 78%|███████▊  | 2002/2560 [09:27<02:37,  3.54it/s]
                                                   

 78%|███████▊  | 2002/2560 [09:27<02:37,  3.54it/s]
 78%|███████▊  | 2003/2560 [09:27<02:35,  3.59it/s]
 78%|███████▊  | 2004/2560 [09:27<02:33,  3.63it/s]
                                                   

 78%|███████▊  | 2004/2560 [09:27<02:33,  3.63it/s]
 78%|███████▊  | 2005/2560 [09:27<02:33,  3.62it/s]
 78%|███████▊  | 2006/2560 [09:28<02:32,  3.63it/s]
                                                   

 78%|███████▊  | 2006/2560 [09:28<02:32,  3.63it/s]
 78%|███████▊  | 2007/2560 [09:28<02:33,  3.61it/s]
 78%|███████▊  | 2008/2560 [09:28<02:33,  3.61it/s]
                                                   

 78%|███████▊  | 2008/2560 [09:28<02:33,  3.61it/s]
 78%|███████▊  | 2009/2560 [09:28<02:32,  3.62it/s]
 79%|███████▊  | 2010/2560 [09:29<02:31,  3.63it/s]
                                                   

 79%|███████▊  | 2010/2560 [09:29<02:31,  3.63it/s]
 79%|███████▊  | 2011/2560 [09:29<02:31,  3.63it/s]
 79%|███████▊  | 2012/2560 [09:29<02:30,  3.65it/s]
                                                   

 79%|███████▊  | 2012/2560 [09:29<02:30,  3.65it/s]
 79%|███████▊  | 2013/2560 [09:30<02:29,  3.67it/s]
 79%|███████▊  | 2014/2560 [09:30<02:30,  3.64it/s]
                                                   

 79%|███████▊  | 2014/2560 [09:30<02:30,  3.64it/s]
 79%|███████▊  | 2015/2560 [09:30<02:31,  3.61it/s]
 79%|███████▉  | 2016/2560 [09:30<02:30,  3.61it/s]
                                                   

 79%|███████▉  | 2016/2560 [09:30<02:30,  3.61it/s]
 79%|███████▉  | 2017/2560 [09:31<02:34,  3.52it/s]
 79%|███████▉  | 2018/2560 [09:31<02:36,  3.47it/s]
                                                   

 79%|███████▉  | 2018/2560 [09:31<02:36,  3.47it/s]
 79%|███████▉  | 2019/2560 [09:31<02:35,  3.49it/s]
 79%|███████▉  | 2020/2560 [09:32<02:33,  3.51it/s]
                                                   

 79%|███████▉  | 2020/2560 [09:32<02:33,  3.51it/s]
 79%|███████▉  | 2021/2560 [09:32<02:34,  3.49it/s]
 79%|███████▉  | 2022/2560 [09:32<02:35,  3.47it/s]
                                                   

 79%|███████▉  | 2022/2560 [09:32<02:35,  3.47it/s]
 79%|███████▉  | 2023/2560 [09:32<02:36,  3.44it/s]
 79%|███████▉  | 2024/2560 [09:33<02:35,  3.45it/s]
                                                   

 79%|███████▉  | 2024/2560 [09:33<02:35,  3.45it/s]
 79%|███████▉  | 2025/2560 [09:33<02:32,  3.51it/s]
 79%|███████▉  | 2026/2560 [09:33<02:30,  3.54it/s]
                                                   

 79%|███████▉  | 2026/2560 [09:33<02:30,  3.54it/s]
 79%|███████▉  | 2027/2560 [09:34<02:31,  3.53it/s]
 79%|███████▉  | 2028/2560 [09:34<02:30,  3.54it/s]
                                                   

 79%|███████▉  | 2028/2560 [09:34<02:30,  3.54it/s]
 79%|███████▉  | 2029/2560 [09:34<02:29,  3.56it/s]
 79%|███████▉  | 2030/2560 [09:34<02:27,  3.58it/s]
                                                   

 79%|███████▉  | 2030/2560 [09:34<02:27,  3.58it/s]
 79%|███████▉  | 2031/2560 [09:35<02:27,  3.58it/s]
 79%|███████▉  | 2032/2560 [09:35<02:25,  3.64it/s]
                                                   

 79%|███████▉  | 2032/2560 [09:35<02:25,  3.64it/s]
 79%|███████▉  | 2033/2560 [09:35<02:22,  3.70it/s]
 79%|███████▉  | 2034/2560 [09:35<02:20,  3.74it/s]
                                                   

 79%|███████▉  | 2034/2560 [09:35<02:20,  3.74it/s]
 79%|███████▉  | 2035/2560 [09:36<02:19,  3.77it/s]
 80%|███████▉  | 2036/2560 [09:36<02:19,  3.77it/s]
                                                   

 80%|███████▉  | 2036/2560 [09:36<02:19,  3.77it/s]
 80%|███████▉  | 2037/2560 [09:36<02:18,  3.78it/s]
 80%|███████▉  | 2038/2560 [09:36<02:17,  3.81it/s]
                                                   

 80%|███████▉  | 2038/2560 [09:36<02:17,  3.81it/s]
 80%|███████▉  | 2039/2560 [09:37<02:16,  3.82it/s]
 80%|███████▉  | 2040/2560 [09:37<02:16,  3.82it/s]
                                                   

 80%|███████▉  | 2040/2560 [09:37<02:16,  3.82it/s]
 80%|███████▉  | 2041/2560 [09:37<02:15,  3.83it/s]
 80%|███████▉  | 2042/2560 [09:38<02:15,  3.81it/s]
                                                   

 80%|███████▉  | 2042/2560 [09:38<02:15,  3.81it/s]
 80%|███████▉  | 2043/2560 [09:38<02:16,  3.78it/s]
 80%|███████▉  | 2044/2560 [09:38<02:15,  3.80it/s]
                                                   

 80%|███████▉  | 2044/2560 [09:38<02:15,  3.80it/s]
 80%|███████▉  | 2045/2560 [09:38<02:17,  3.75it/s]
 80%|███████▉  | 2046/2560 [09:39<02:16,  3.75it/s]
                                                   

 80%|███████▉  | 2046/2560 [09:39<02:16,  3.75it/s]
 80%|███████▉  | 2047/2560 [09:39<02:16,  3.77it/s]
 80%|████████  | 2048/2560 [09:39<01:55,  4.44it/s]
                                                   

 80%|████████  | 2048/2560 [09:39<01:55,  4.44it/s]
 80%|████████  | 2049/2560 [09:39<02:03,  4.13it/s]
 80%|████████  | 2050/2560 [09:40<02:07,  3.99it/s]
                                                   

 80%|████████  | 2050/2560 [09:40<02:07,  3.99it/s]
 80%|████████  | 2051/2560 [09:40<02:08,  3.95it/s]
 80%|████████  | 2052/2560 [09:40<02:10,  3.90it/s]
                                                   

 80%|████████  | 2052/2560 [09:40<02:10,  3.90it/s]
 80%|████████  | 2053/2560 [09:40<02:10,  3.88it/s]
 80%|████████  | 2054/2560 [09:41<02:10,  3.88it/s]
                                                   

 80%|████████  | 2054/2560 [09:41<02:10,  3.88it/s]
 80%|████████  | 2055/2560 [09:41<02:11,  3.84it/s]
 80%|████████  | 2056/2560 [09:41<02:11,  3.83it/s]
                                                   

 80%|████████  | 2056/2560 [09:41<02:11,  3.83it/s]
 80%|████████  | 2057/2560 [09:41<02:11,  3.83it/s]
 80%|████████  | 2058/2560 [09:42<02:12,  3.79it/s]
                                                   

 80%|████████  | 2058/2560 [09:42<02:12,  3.79it/s]
 80%|████████  | 2059/2560 [09:42<02:11,  3.80it/s]
 80%|████████  | 2060/2560 [09:42<02:11,  3.81it/s]
                                                   

 80%|████████  | 2060/2560 [09:42<02:11,  3.81it/s]
 81%|████████  | 2061/2560 [09:42<02:10,  3.81it/s]
 81%|████████  | 2062/2560 [09:43<02:11,  3.79it/s]
                                                   

 81%|████████  | 2062/2560 [09:43<02:11,  3.79it/s]
 81%|████████  | 2063/2560 [09:43<02:11,  3.79it/s]
 81%|████████  | 2064/2560 [09:43<02:10,  3.79it/s]
                                                   

 81%|████████  | 2064/2560 [09:43<02:10,  3.79it/s]
 81%|████████  | 2065/2560 [09:44<02:11,  3.76it/s]
 81%|████████  | 2066/2560 [09:44<02:10,  3.77it/s]
                                                   

 81%|████████  | 2066/2560 [09:44<02:10,  3.77it/s]
 81%|████████  | 2067/2560 [09:44<02:11,  3.76it/s]
 81%|████████  | 2068/2560 [09:44<02:11,  3.74it/s]
                                                   

 81%|████████  | 2068/2560 [09:44<02:11,  3.74it/s]
 81%|████████  | 2069/2560 [09:45<02:11,  3.74it/s]
 81%|████████  | 2070/2560 [09:45<02:10,  3.76it/s]
                                                   

 81%|████████  | 2070/2560 [09:45<02:10,  3.76it/s]
 81%|████████  | 2071/2560 [09:45<02:09,  3.77it/s]
 81%|████████  | 2072/2560 [09:45<02:09,  3.76it/s]
                                                   

 81%|████████  | 2072/2560 [09:45<02:09,  3.76it/s]
 81%|████████  | 2073/2560 [09:46<02:10,  3.75it/s]
 81%|████████  | 2074/2560 [09:46<02:09,  3.76it/s]
                                                   

 81%|████████  | 2074/2560 [09:46<02:09,  3.76it/s]
 81%|████████  | 2075/2560 [09:46<02:08,  3.78it/s]
 81%|████████  | 2076/2560 [09:46<02:09,  3.75it/s]
                                                   

 81%|████████  | 2076/2560 [09:46<02:09,  3.75it/s]
 81%|████████  | 2077/2560 [09:47<02:09,  3.73it/s]
 81%|████████  | 2078/2560 [09:47<02:09,  3.73it/s]
                                                   

 81%|████████  | 2078/2560 [09:47<02:09,  3.73it/s]
 81%|████████  | 2079/2560 [09:47<02:09,  3.70it/s]
 81%|████████▏ | 2080/2560 [09:48<02:10,  3.69it/s]
                                                   

 81%|████████▏ | 2080/2560 [09:48<02:10,  3.69it/s]
 81%|████████▏ | 2081/2560 [09:48<02:09,  3.70it/s]
 81%|████████▏ | 2082/2560 [09:48<02:12,  3.62it/s]
                                                   

 81%|████████▏ | 2082/2560 [09:48<02:12,  3.62it/s]
 81%|████████▏ | 2083/2560 [09:48<02:10,  3.65it/s]
 81%|████████▏ | 2084/2560 [09:49<02:09,  3.67it/s]
                                                   

 81%|████████▏ | 2084/2560 [09:49<02:09,  3.67it/s]
 81%|████████▏ | 2085/2560 [09:49<02:09,  3.68it/s]
 81%|████████▏ | 2086/2560 [09:49<02:08,  3.68it/s]
                                                   

 81%|████████▏ | 2086/2560 [09:49<02:08,  3.68it/s]
 82%|████████▏ | 2087/2560 [09:49<02:09,  3.66it/s]
 82%|████████▏ | 2088/2560 [09:50<02:08,  3.68it/s]
                                                   

 82%|████████▏ | 2088/2560 [09:50<02:08,  3.68it/s]
 82%|████████▏ | 2089/2560 [09:50<02:08,  3.67it/s]
 82%|████████▏ | 2090/2560 [09:50<02:06,  3.71it/s]
                                                   

 82%|████████▏ | 2090/2560 [09:50<02:06,  3.71it/s]
 82%|████████▏ | 2091/2560 [09:51<02:06,  3.71it/s]
 82%|████████▏ | 2092/2560 [09:51<02:04,  3.75it/s]
                                                   

 82%|████████▏ | 2092/2560 [09:51<02:04,  3.75it/s]
 82%|████████▏ | 2093/2560 [09:51<02:05,  3.73it/s]
 82%|████████▏ | 2094/2560 [09:51<02:06,  3.67it/s]
                                                   

 82%|████████▏ | 2094/2560 [09:51<02:06,  3.67it/s]
 82%|████████▏ | 2095/2560 [09:52<02:05,  3.70it/s]
 82%|████████▏ | 2096/2560 [09:52<02:05,  3.71it/s]
                                                   

 82%|████████▏ | 2096/2560 [09:52<02:05,  3.71it/s]
 82%|████████▏ | 2097/2560 [09:52<02:03,  3.74it/s]
 82%|████████▏ | 2098/2560 [09:52<02:02,  3.77it/s]
                                                   

 82%|████████▏ | 2098/2560 [09:52<02:02,  3.77it/s]
 82%|████████▏ | 2099/2560 [09:53<02:01,  3.80it/s]
 82%|████████▏ | 2100/2560 [09:53<02:01,  3.79it/s]
                                                   

 82%|████████▏ | 2100/2560 [09:53<02:01,  3.79it/s]
 82%|████████▏ | 2101/2560 [09:53<02:00,  3.80it/s]
 82%|████████▏ | 2102/2560 [09:53<01:59,  3.83it/s]
                                                   

 82%|████████▏ | 2102/2560 [09:53<01:59,  3.83it/s]
 82%|████████▏ | 2103/2560 [09:54<01:58,  3.84it/s]
 82%|████████▏ | 2104/2560 [09:54<01:58,  3.84it/s]
                                                   

 82%|████████▏ | 2104/2560 [09:54<01:58,  3.84it/s]
 82%|████████▏ | 2105/2560 [09:54<01:58,  3.84it/s]
 82%|████████▏ | 2106/2560 [09:54<01:58,  3.83it/s]
                                                   

 82%|████████▏ | 2106/2560 [09:54<01:58,  3.83it/s]
 82%|████████▏ | 2107/2560 [09:55<01:58,  3.83it/s]
 82%|████████▏ | 2108/2560 [09:55<01:57,  3.84it/s]
                                                   

 82%|████████▏ | 2108/2560 [09:55<01:57,  3.84it/s]
 82%|████████▏ | 2109/2560 [09:55<01:57,  3.82it/s]
 82%|████████▏ | 2110/2560 [09:56<01:57,  3.82it/s]
                                                   

 82%|████████▏ | 2110/2560 [09:56<01:57,  3.82it/s]
 82%|████████▏ | 2111/2560 [09:56<01:57,  3.82it/s]
 82%|████████▎ | 2112/2560 [09:56<01:39,  4.51it/s]
                                                   

 82%|████████▎ | 2112/2560 [09:56<01:39,  4.51it/s]
 83%|████████▎ | 2113/2560 [09:56<01:45,  4.23it/s]
 83%|████████▎ | 2114/2560 [09:56<01:51,  4.00it/s]
                                                   

 83%|████████▎ | 2114/2560 [09:56<01:51,  4.00it/s]
 83%|████████▎ | 2115/2560 [09:57<01:54,  3.87it/s]
 83%|████████▎ | 2116/2560 [09:57<01:56,  3.83it/s]
                                                   

 83%|████████▎ | 2116/2560 [09:57<01:56,  3.83it/s]
 83%|████████▎ | 2117/2560 [09:57<01:57,  3.77it/s]
 83%|████████▎ | 2118/2560 [09:58<01:57,  3.75it/s]
                                                   

 83%|████████▎ | 2118/2560 [09:58<01:57,  3.75it/s]
 83%|████████▎ | 2119/2560 [09:58<01:58,  3.73it/s]
 83%|████████▎ | 2120/2560 [09:58<01:58,  3.72it/s]
                                                   

 83%|████████▎ | 2120/2560 [09:58<01:58,  3.72it/s]
 83%|████████▎ | 2121/2560 [09:58<01:58,  3.71it/s]
 83%|████████▎ | 2122/2560 [09:59<01:57,  3.73it/s]
                                                   

 83%|████████▎ | 2122/2560 [09:59<01:57,  3.73it/s]
 83%|████████▎ | 2123/2560 [09:59<01:56,  3.76it/s]
 83%|████████▎ | 2124/2560 [09:59<01:54,  3.79it/s]
                                                   

 83%|████████▎ | 2124/2560 [09:59<01:54,  3.79it/s]
 83%|████████▎ | 2125/2560 [09:59<01:54,  3.80it/s]
 83%|████████▎ | 2126/2560 [10:00<01:53,  3.81it/s]
                                                   

 83%|████████▎ | 2126/2560 [10:00<01:53,  3.81it/s]
 83%|████████▎ | 2127/2560 [10:00<01:53,  3.81it/s]
 83%|████████▎ | 2128/2560 [10:00<01:54,  3.76it/s]
                                                   

 83%|████████▎ | 2128/2560 [10:00<01:54,  3.76it/s]
 83%|████████▎ | 2129/2560 [10:00<01:53,  3.78it/s]
 83%|████████▎ | 2130/2560 [10:01<01:53,  3.80it/s]
                                                   

 83%|████████▎ | 2130/2560 [10:01<01:53,  3.80it/s]
 83%|████████▎ | 2131/2560 [10:01<01:52,  3.80it/s]
 83%|████████▎ | 2132/2560 [10:01<01:52,  3.79it/s]
                                                   

 83%|████████▎ | 2132/2560 [10:01<01:52,  3.79it/s]
 83%|████████▎ | 2133/2560 [10:02<01:52,  3.79it/s]
 83%|████████▎ | 2134/2560 [10:02<01:52,  3.78it/s]
                                                   

 83%|████████▎ | 2134/2560 [10:02<01:52,  3.78it/s]
 83%|████████▎ | 2135/2560 [10:02<01:52,  3.78it/s]
 83%|████████▎ | 2136/2560 [10:02<01:51,  3.81it/s]
                                                   

 83%|████████▎ | 2136/2560 [10:02<01:51,  3.81it/s]
 83%|████████▎ | 2137/2560 [10:03<01:53,  3.73it/s]
 84%|████████▎ | 2138/2560 [10:03<01:53,  3.72it/s]
                                                   

 84%|████████▎ | 2138/2560 [10:03<01:53,  3.72it/s]
 84%|████████▎ | 2139/2560 [10:03<01:52,  3.73it/s]
 84%|████████▎ | 2140/2560 [10:03<01:52,  3.72it/s]
                                                   

 84%|████████▎ | 2140/2560 [10:03<01:52,  3.72it/s]
 84%|████████▎ | 2141/2560 [10:04<01:52,  3.72it/s]
 84%|████████▎ | 2142/2560 [10:04<01:52,  3.71it/s]
                                                   

 84%|████████▎ | 2142/2560 [10:04<01:52,  3.71it/s]
 84%|████████▎ | 2143/2560 [10:04<01:51,  3.74it/s]
 84%|████████▍ | 2144/2560 [10:04<01:50,  3.76it/s]
                                                   

 84%|████████▍ | 2144/2560 [10:04<01:50,  3.76it/s]
 84%|████████▍ | 2145/2560 [10:05<01:49,  3.78it/s]
 84%|████████▍ | 2146/2560 [10:05<01:50,  3.73it/s]
                                                   

 84%|████████▍ | 2146/2560 [10:05<01:50,  3.73it/s]
 84%|████████▍ | 2147/2560 [10:05<01:50,  3.73it/s]
 84%|████████▍ | 2148/2560 [10:06<01:51,  3.71it/s]
                                                   

 84%|████████▍ | 2148/2560 [10:06<01:51,  3.71it/s]
 84%|████████▍ | 2149/2560 [10:06<01:51,  3.69it/s]
 84%|████████▍ | 2150/2560 [10:06<01:50,  3.71it/s]
                                                   

 84%|████████▍ | 2150/2560 [10:06<01:50,  3.71it/s]
 84%|████████▍ | 2151/2560 [10:06<01:51,  3.68it/s]
 84%|████████▍ | 2152/2560 [10:07<01:52,  3.63it/s]
                                                   
{'loss': '0.001292', 'grad_norm': '0.02384', 'learning_rate': '2.722e-05', 'epoch': '30.88'}
{'loss': '0.0009777', 'grad_norm': '0.03525', 'learning_rate': '2.704e-05', 'epoch': '30.91'}
{'loss': '0.0007978', 'grad_norm': '0.01761', 'learning_rate': '2.687e-05', 'epoch': '30.94'}
{'loss': '0.001843', 'grad_norm': '0.03186', 'learning_rate': '2.669e-05', 'epoch': '30.98'}
{'loss': '0.00188', 'grad_norm': '0.04418', 'learning_rate': '2.652e-05', 'epoch': '31'}
{'loss': '0.001797', 'grad_norm': '0.04635', 'learning_rate': '2.634e-05', 'epoch': '31.03'}
{'loss': '0.001587', 'grad_norm': '0.04605', 'learning_rate': '2.617e-05', 'epoch': '31.06'}
{'loss': '0.001235', 'grad_norm': '0.01103', 'learning_rate': '2.599e-05', 'epoch': '31.09'}
{'loss': '0.001042', 'grad_norm': '0.02085', 'learning_rate': '2.582e-05', 'epoch': '31.13'}
{'loss': '0.001717', 'grad_norm': '0.02615', 'learning_rate': '2.565e-05', 'epoch': '31.16'}
{'loss': '0.002101', 'grad_norm': '0.04356', 'learning_rate': '2.547e-05', 'epoch': '31.19'}
{'loss': '0.001253', 'grad_norm': '0.01339', 'learning_rate': '2.53e-05', 'epoch': '31.22'}
{'loss': '0.001471', 'grad_norm': '0.0423', 'learning_rate': '2.513e-05', 'epoch': '31.25'}
{'loss': '0.001276', 'grad_norm': '0.04861', 'learning_rate': '2.496e-05', 'epoch': '31.28'}
{'loss': '0.001397', 'grad_norm': '0.03755', 'learning_rate': '2.479e-05', 'epoch': '31.31'}
{'loss': '0.001472', 'grad_norm': '0.02706', 'learning_rate': '2.462e-05', 'epoch': '31.35'}
{'loss': '0.001211', 'grad_norm': '0.0284', 'learning_rate': '2.445e-05', 'epoch': '31.38'}
{'loss': '0.001428', 'grad_norm': '0.02493', 'learning_rate': '2.428e-05', 'epoch': '31.41'}
{'loss': '0.001434', 'grad_norm': '0.04849', 'learning_rate': '2.411e-05', 'epoch': '31.44'}
{'loss': '0.001124', 'grad_norm': '0.02686', 'learning_rate': '2.394e-05', 'epoch': '31.47'}
{'loss': '0.001598', 'grad_norm': '0.03724', 'learning_rate': '2.378e-05', 'epoch': '31.5'}
{'loss': '0.001478', 'grad_norm': '0.008465', 'learning_rate': '2.361e-05', 'epoch': '31.54'}
{'loss': '0.001706', 'grad_norm': '0.05347', 'learning_rate': '2.344e-05', 'epoch': '31.57'}
{'loss': '0.001806', 'grad_norm': '0.03178', 'learning_rate': '2.328e-05', 'epoch': '31.6'}
{'loss': '0.001803', 'grad_norm': '0.03749', 'learning_rate': '2.311e-05', 'epoch': '31.63'}
{'loss': '0.001548', 'grad_norm': '0.02845', 'learning_rate': '2.295e-05', 'epoch': '31.66'}
{'loss': '0.001503', 'grad_norm': '0.03657', 'learning_rate': '2.278e-05', 'epoch': '31.69'}
{'loss': '0.001829', 'grad_norm': '0.01558', 'learning_rate': '2.262e-05', 'epoch': '31.72'}
{'loss': '0.001656', 'grad_norm': '0.02422', 'learning_rate': '2.245e-05', 'epoch': '31.76'}
{'loss': '0.001477', 'grad_norm': '0.02809', 'learning_rate': '2.229e-05', 'epoch': '31.79'}
{'loss': '0.001959', 'grad_norm': '0.03995', 'learning_rate': '2.213e-05', 'epoch': '31.82'}
{'loss': '0.001395', 'grad_norm': '0.04786', 'learning_rate': '2.197e-05', 'epoch': '31.85'}
{'loss': '0.001684', 'grad_norm': '0.02625', 'learning_rate': '2.181e-05', 'epoch': '31.88'}
{'loss': '0.001399', 'grad_norm': '0.03276', 'learning_rate': '2.164e-05', 'epoch': '31.91'}
{'loss': '0.00131', 'grad_norm': '0.01806', 'learning_rate': '2.148e-05', 'epoch': '31.94'}
{'loss': '0.001256', 'grad_norm': '0.03449', 'learning_rate': '2.132e-05', 'epoch': '31.98'}
{'loss': '0.0009475', 'grad_norm': '0.03775', 'learning_rate': '2.117e-05', 'epoch': '32'}
{'loss': '0.002101', 'grad_norm': '0.03004', 'learning_rate': '2.101e-05', 'epoch': '32.03'}
{'loss': '0.001541', 'grad_norm': '0.03439', 'learning_rate': '2.085e-05', 'epoch': '32.06'}
{'loss': '0.001806', 'grad_norm': '0.04017', 'learning_rate': '2.069e-05', 'epoch': '32.09'}
{'loss': '0.001587', 'grad_norm': '0.01987', 'learning_rate': '2.053e-05', 'epoch': '32.13'}
{'loss': '0.001262', 'grad_norm': '0.02823', 'learning_rate': '2.038e-05', 'epoch': '32.16'}
{'loss': '0.001119', 'grad_norm': '0.01699', 'learning_rate': '2.022e-05', 'epoch': '32.19'}
{'loss': '0.001381', 'grad_norm': '0.05639', 'learning_rate': '2.007e-05', 'epoch': '32.22'}
{'loss': '0.0009474', 'grad_norm': '0.01704', 'learning_rate': '1.991e-05', 'epoch': '32.25'}
{'loss': '0.001148', 'grad_norm': '0.01629', 'learning_rate': '1.976e-05', 'epoch': '32.28'}
{'loss': '0.001796', 'grad_norm': '0.02753', 'learning_rate': '1.96e-05', 'epoch': '32.31'}
{'loss': '0.00148', 'grad_norm': '0.03312', 'learning_rate': '1.945e-05', 'epoch': '32.35'}
{'loss': '0.001415', 'grad_norm': '0.02698', 'learning_rate': '1.93e-05', 'epoch': '32.38'}
{'loss': '0.001268', 'grad_norm': '0.03094', 'learning_rate': '1.914e-05', 'epoch': '32.41'}
{'loss': '0.001643', 'grad_norm': '0.03265', 'learning_rate': '1.899e-05', 'epoch': '32.44'}
{'loss': '0.001447', 'grad_norm': '0.01952', 'learning_rate': '1.884e-05', 'epoch': '32.47'}
{'loss': '0.001124', 'grad_norm': '0.01382', 'learning_rate': '1.869e-05', 'epoch': '32.5'}
{'loss': '0.001338', 'grad_norm': '0.02829', 'learning_rate': '1.854e-05', 'epoch': '32.54'}
{'loss': '0.001401', 'grad_norm': '0.02967', 'learning_rate': '1.839e-05', 'epoch': '32.57'}
{'loss': '0.001698', 'grad_norm': '0.04048', 'learning_rate': '1.824e-05', 'epoch': '32.6'}
{'loss': '0.002136', 'grad_norm': '0.03965', 'learning_rate': '1.809e-05', 'epoch': '32.63'}
{'loss': '0.001389', 'grad_norm': '0.02659', 'learning_rate': '1.795e-05', 'epoch': '32.66'}
{'loss': '0.001546', 'grad_norm': '0.06802', 'learning_rate': '1.78e-05', 'epoch': '32.69'}
{'loss': '0.002114', 'grad_norm': '0.03453', 'learning_rate': '1.765e-05', 'epoch': '32.72'}
{'loss': '0.00128', 'grad_norm': '0.03377', 'learning_rate': '1.75e-05', 'epoch': '32.76'}
{'loss': '0.001303', 'grad_norm': '0.03044', 'learning_rate': '1.736e-05', 'epoch': '32.79'}
{'loss': '0.001008', 'grad_norm': '0.05809', 'learning_rate': '1.721e-05', 'epoch': '32.82'}
{'loss': '0.001278', 'grad_norm': '0.03098', 'learning_rate': '1.707e-05', 'epoch': '32.85'}
{'loss': '0.001509', 'grad_norm': '0.056', 'learning_rate': '1.692e-05', 'epoch': '32.88'}
{'loss': '0.001767', 'grad_norm': '0.02037', 'learning_rate': '1.678e-05', 'epoch': '32.91'}
{'loss': '0.001563', 'grad_norm': '0.02547', 'learning_rate': '1.664e-05', 'epoch': '32.94'}
{'loss': '0.001561', 'grad_norm': '0.05012', 'learning_rate': '1.65e-05', 'epoch': '32.98'}
{'loss': '0.001634', 'grad_norm': '0.04367', 'learning_rate': '1.635e-05', 'epoch': '33'}
{'loss': '0.0008421', 'grad_norm': '0.01691', 'learning_rate': '1.621e-05', 'epoch': '33.03'}
{'loss': '0.001052', 'grad_norm': '0.02309', 'learning_rate': '1.607e-05', 'epoch': '33.06'}
{'loss': '0.001987', 'grad_norm': '0.05471', 'learning_rate': '1.593e-05', 'epoch': '33.09'}
{'loss': '0.001316', 'grad_norm': '0.02062', 'learning_rate': '1.579e-05', 'epoch': '33.13'}
{'loss': '0.001495', 'grad_norm': '0.03569', 'learning_rate': '1.565e-05', 'epoch': '33.16'}
{'loss': '0.001198', 'grad_norm': '0.0253', 'learning_rate': '1.551e-05', 'epoch': '33.19'}
{'loss': '0.001365', 'grad_norm': '0.02113', 'learning_rate': '1.538e-05', 'epoch': '33.22'}
{'loss': '0.0009284', 'grad_norm': '0.01591', 'learning_rate': '1.524e-05', 'epoch': '33.25'}
{'loss': '0.001257', 'grad_norm': '0.04713', 'learning_rate': '1.51e-05', 'epoch': '33.28'}
{'loss': '0.001786', 'grad_norm': '0.02227', 'learning_rate': '1.497e-05', 'epoch': '33.31'}
{'loss': '0.001976', 'grad_norm': '0.04778', 'learning_rate': '1.483e-05', 'epoch': '33.35'}
{'loss': '0.00177', 'grad_norm': '0.02811', 'learning_rate': '1.47e-05', 'epoch': '33.38'}
{'loss': '0.001228', 'grad_norm': '0.01051', 'learning_rate': '1.456e-05', 'epoch': '33.41'}
{'loss': '0.001707', 'grad_norm': '0.02969', 'learning_rate': '1.443e-05', 'epoch': '33.44'}
{'loss': '0.001444', 'grad_norm': '0.04159', 'learning_rate': '1.429e-05', 'epoch': '33.47'}
{'loss': '0.001462', 'grad_norm': '0.04012', 'learning_rate': '1.416e-05', 'epoch': '33.5'}
{'loss': '0.001612', 'grad_norm': '0.0137', 'learning_rate': '1.403e-05', 'epoch': '33.54'}
{'loss': '0.001231', 'grad_norm': '0.02682', 'learning_rate': '1.39e-05', 'epoch': '33.57'}
{'loss': '0.001137', 'grad_norm': '0.01705', 'learning_rate': '1.377e-05', 'epoch': '33.6'}
{'loss': '0.001415', 'grad_norm': '0.04211', 'learning_rate': '1.364e-05', 'epoch': '33.63'}
 84%|████████▍ | 2152/2560 [10:07<01:52,  3.63it/s]
 84%|████████▍ | 2153/2560 [10:07<01:52,  3.62it/s]
 84%|████████▍ | 2154/2560 [10:07<01:52,  3.59it/s]
                                                   

 84%|████████▍ | 2154/2560 [10:07<01:52,  3.59it/s]
 84%|████████▍ | 2155/2560 [10:07<01:52,  3.59it/s]
 84%|████████▍ | 2156/2560 [10:08<01:50,  3.66it/s]
                                                   

 84%|████████▍ | 2156/2560 [10:08<01:50,  3.66it/s]
 84%|████████▍ | 2157/2560 [10:08<01:48,  3.71it/s]
 84%|████████▍ | 2158/2560 [10:08<01:47,  3.74it/s]
                                                   

 84%|████████▍ | 2158/2560 [10:08<01:47,  3.74it/s]
 84%|████████▍ | 2159/2560 [10:09<01:46,  3.77it/s]
 84%|████████▍ | 2160/2560 [10:09<01:45,  3.78it/s]
                                                   

 84%|████████▍ | 2160/2560 [10:09<01:45,  3.78it/s]
 84%|████████▍ | 2161/2560 [10:09<01:45,  3.80it/s]
 84%|████████▍ | 2162/2560 [10:09<01:44,  3.80it/s]
                                                   

 84%|████████▍ | 2162/2560 [10:09<01:44,  3.80it/s]
 84%|████████▍ | 2163/2560 [10:10<01:44,  3.81it/s]
 85%|████████▍ | 2164/2560 [10:10<01:44,  3.80it/s]
                                                   

 85%|████████▍ | 2164/2560 [10:10<01:44,  3.80it/s]
 85%|████████▍ | 2165/2560 [10:10<01:43,  3.81it/s]
 85%|████████▍ | 2166/2560 [10:10<01:43,  3.81it/s]
                                                   

 85%|████████▍ | 2166/2560 [10:10<01:43,  3.81it/s]
 85%|████████▍ | 2167/2560 [10:11<01:43,  3.81it/s]
 85%|████████▍ | 2168/2560 [10:11<01:42,  3.83it/s]
                                                   

 85%|████████▍ | 2168/2560 [10:11<01:42,  3.83it/s]
 85%|████████▍ | 2169/2560 [10:11<01:42,  3.83it/s]
 85%|████████▍ | 2170/2560 [10:11<01:41,  3.83it/s]
                                                   

 85%|████████▍ | 2170/2560 [10:11<01:41,  3.83it/s]
 85%|████████▍ | 2171/2560 [10:12<01:41,  3.82it/s]
 85%|████████▍ | 2172/2560 [10:12<01:41,  3.83it/s]
                                                   

 85%|████████▍ | 2172/2560 [10:12<01:41,  3.83it/s]
 85%|████████▍ | 2173/2560 [10:12<01:41,  3.79it/s]
 85%|████████▍ | 2174/2560 [10:12<01:42,  3.78it/s]
                                                   

 85%|████████▍ | 2174/2560 [10:12<01:42,  3.78it/s]
 85%|████████▍ | 2175/2560 [10:13<01:41,  3.78it/s]
 85%|████████▌ | 2176/2560 [10:13<01:25,  4.47it/s]
                                                   

 85%|████████▌ | 2176/2560 [10:13<01:25,  4.47it/s]
 85%|████████▌ | 2177/2560 [10:13<01:30,  4.23it/s]
 85%|████████▌ | 2178/2560 [10:13<01:33,  4.07it/s]
                                                   

 85%|████████▌ | 2178/2560 [10:13<01:33,  4.07it/s]
 85%|████████▌ | 2179/2560 [10:14<01:36,  3.96it/s]
 85%|████████▌ | 2180/2560 [10:14<01:37,  3.90it/s]
                                                   

 85%|████████▌ | 2180/2560 [10:14<01:37,  3.90it/s]
 85%|████████▌ | 2181/2560 [10:14<01:38,  3.84it/s]
 85%|████████▌ | 2182/2560 [10:14<01:39,  3.81it/s]
                                                   

 85%|████████▌ | 2182/2560 [10:14<01:39,  3.81it/s]
 85%|████████▌ | 2183/2560 [10:15<01:41,  3.72it/s]
 85%|████████▌ | 2184/2560 [10:15<01:41,  3.70it/s]
                                                   

 85%|████████▌ | 2184/2560 [10:15<01:41,  3.70it/s]
 85%|████████▌ | 2185/2560 [10:15<01:44,  3.60it/s]
 85%|████████▌ | 2186/2560 [10:16<01:43,  3.62it/s]
                                                   

 85%|████████▌ | 2186/2560 [10:16<01:43,  3.62it/s]
 85%|████████▌ | 2187/2560 [10:16<01:43,  3.61it/s]
 85%|████████▌ | 2188/2560 [10:16<01:42,  3.65it/s]
                                                   

 85%|████████▌ | 2188/2560 [10:16<01:42,  3.65it/s]
 86%|████████▌ | 2189/2560 [10:16<01:43,  3.58it/s]
 86%|████████▌ | 2190/2560 [10:17<01:42,  3.60it/s]
                                                   

 86%|████████▌ | 2190/2560 [10:17<01:42,  3.60it/s]
 86%|████████▌ | 2191/2560 [10:17<01:43,  3.58it/s]
 86%|████████▌ | 2192/2560 [10:17<01:42,  3.60it/s]
                                                   

 86%|████████▌ | 2192/2560 [10:17<01:42,  3.60it/s]
 86%|████████▌ | 2193/2560 [10:18<01:41,  3.62it/s]
 86%|████████▌ | 2194/2560 [10:18<01:40,  3.65it/s]
                                                   

 86%|████████▌ | 2194/2560 [10:18<01:40,  3.65it/s]
 86%|████████▌ | 2195/2560 [10:18<01:39,  3.66it/s]
 86%|████████▌ | 2196/2560 [10:18<01:39,  3.67it/s]
                                                   

 86%|████████▌ | 2196/2560 [10:18<01:39,  3.67it/s]
 86%|████████▌ | 2197/2560 [10:19<01:39,  3.66it/s]
 86%|████████▌ | 2198/2560 [10:19<01:39,  3.63it/s]
                                                   

 86%|████████▌ | 2198/2560 [10:19<01:39,  3.63it/s]
 86%|████████▌ | 2199/2560 [10:19<01:38,  3.67it/s]
 86%|████████▌ | 2200/2560 [10:19<01:37,  3.69it/s]
                                                   

 86%|████████▌ | 2200/2560 [10:19<01:37,  3.69it/s]
 86%|████████▌ | 2201/2560 [10:20<01:36,  3.70it/s]
 86%|████████▌ | 2202/2560 [10:20<01:36,  3.71it/s]
                                                   

 86%|████████▌ | 2202/2560 [10:20<01:36,  3.71it/s]
 86%|████████▌ | 2203/2560 [10:20<01:36,  3.68it/s]
 86%|████████▌ | 2204/2560 [10:21<01:36,  3.69it/s]
                                                   

 86%|████████▌ | 2204/2560 [10:21<01:36,  3.69it/s]
 86%|████████▌ | 2205/2560 [10:21<01:35,  3.70it/s]
 86%|████████▌ | 2206/2560 [10:21<01:36,  3.67it/s]
                                                   

 86%|████████▌ | 2206/2560 [10:21<01:36,  3.67it/s]
 86%|████████▌ | 2207/2560 [10:21<01:36,  3.66it/s]
 86%|████████▋ | 2208/2560 [10:22<01:36,  3.65it/s]
                                                   

 86%|████████▋ | 2208/2560 [10:22<01:36,  3.65it/s]
 86%|████████▋ | 2209/2560 [10:22<01:36,  3.64it/s]
 86%|████████▋ | 2210/2560 [10:22<01:35,  3.66it/s]
                                                   

 86%|████████▋ | 2210/2560 [10:22<01:35,  3.66it/s]
 86%|████████▋ | 2211/2560 [10:22<01:35,  3.65it/s]
 86%|████████▋ | 2212/2560 [10:23<01:34,  3.67it/s]
                                                   

 86%|████████▋ | 2212/2560 [10:23<01:34,  3.67it/s]
 86%|████████▋ | 2213/2560 [10:23<01:34,  3.67it/s]
 86%|████████▋ | 2214/2560 [10:23<01:34,  3.68it/s]
                                                   

 86%|████████▋ | 2214/2560 [10:23<01:34,  3.68it/s]
 87%|████████▋ | 2215/2560 [10:24<01:32,  3.72it/s]
 87%|████████▋ | 2216/2560 [10:24<01:32,  3.74it/s]
                                                   

 87%|████████▋ | 2216/2560 [10:24<01:32,  3.74it/s]
 87%|████████▋ | 2217/2560 [10:24<01:31,  3.74it/s]
 87%|████████▋ | 2218/2560 [10:24<01:31,  3.74it/s]
                                                   

 87%|████████▋ | 2218/2560 [10:24<01:31,  3.74it/s]
 87%|████████▋ | 2219/2560 [10:25<01:30,  3.77it/s]
 87%|████████▋ | 2220/2560 [10:25<01:29,  3.78it/s]
                                                   

 87%|████████▋ | 2220/2560 [10:25<01:29,  3.78it/s]
 87%|████████▋ | 2221/2560 [10:25<01:29,  3.78it/s]
 87%|████████▋ | 2222/2560 [10:25<01:29,  3.78it/s]
                                                   

 87%|████████▋ | 2222/2560 [10:25<01:29,  3.78it/s]
 87%|████████▋ | 2223/2560 [10:26<01:29,  3.76it/s]
 87%|████████▋ | 2224/2560 [10:26<01:29,  3.74it/s]
                                                   

 87%|████████▋ | 2224/2560 [10:26<01:29,  3.74it/s]
 87%|████████▋ | 2225/2560 [10:26<01:30,  3.71it/s]
 87%|████████▋ | 2226/2560 [10:26<01:29,  3.72it/s]
                                                   

 87%|████████▋ | 2226/2560 [10:26<01:29,  3.72it/s]
 87%|████████▋ | 2227/2560 [10:27<01:30,  3.69it/s]
 87%|████████▋ | 2228/2560 [10:27<01:29,  3.72it/s]
                                                   

 87%|████████▋ | 2228/2560 [10:27<01:29,  3.72it/s]
 87%|████████▋ | 2229/2560 [10:27<01:30,  3.67it/s]
 87%|████████▋ | 2230/2560 [10:28<01:30,  3.64it/s]
                                                   

 87%|████████▋ | 2230/2560 [10:28<01:30,  3.64it/s]
 87%|████████▋ | 2231/2560 [10:28<01:30,  3.64it/s]
 87%|████████▋ | 2232/2560 [10:28<01:29,  3.65it/s]
                                                   

 87%|████████▋ | 2232/2560 [10:28<01:29,  3.65it/s]
 87%|████████▋ | 2233/2560 [10:28<01:29,  3.65it/s]
 87%|████████▋ | 2234/2560 [10:29<01:29,  3.66it/s]
                                                   

 87%|████████▋ | 2234/2560 [10:29<01:29,  3.66it/s]
 87%|████████▋ | 2235/2560 [10:29<01:28,  3.66it/s]
 87%|████████▋ | 2236/2560 [10:29<01:28,  3.67it/s]
                                                   

 87%|████████▋ | 2236/2560 [10:29<01:28,  3.67it/s]
 87%|████████▋ | 2237/2560 [10:29<01:27,  3.68it/s]
 87%|████████▋ | 2238/2560 [10:30<01:27,  3.67it/s]
                                                   

 87%|████████▋ | 2238/2560 [10:30<01:27,  3.67it/s]
 87%|████████▋ | 2239/2560 [10:30<01:27,  3.68it/s]
 88%|████████▊ | 2240/2560 [10:30<01:13,  4.35it/s]
                                                   

 88%|████████▊ | 2240/2560 [10:30<01:13,  4.35it/s]
 88%|████████▊ | 2241/2560 [10:30<01:17,  4.12it/s]
 88%|████████▊ | 2242/2560 [10:31<01:19,  4.01it/s]
                                                   

 88%|████████▊ | 2242/2560 [10:31<01:19,  4.01it/s]
 88%|████████▊ | 2243/2560 [10:31<01:22,  3.86it/s]
 88%|████████▊ | 2244/2560 [10:31<01:23,  3.78it/s]
                                                   

 88%|████████▊ | 2244/2560 [10:31<01:23,  3.78it/s]
 88%|████████▊ | 2245/2560 [10:31<01:24,  3.75it/s]
 88%|████████▊ | 2246/2560 [10:32<01:24,  3.73it/s]
                                                   

 88%|████████▊ | 2246/2560 [10:32<01:24,  3.73it/s]
 88%|████████▊ | 2247/2560 [10:32<01:24,  3.70it/s]
 88%|████████▊ | 2248/2560 [10:32<01:24,  3.69it/s]
                                                   

 88%|████████▊ | 2248/2560 [10:32<01:24,  3.69it/s]
 88%|████████▊ | 2249/2560 [10:33<01:24,  3.69it/s]
 88%|████████▊ | 2250/2560 [10:33<01:23,  3.69it/s]
                                                   

 88%|████████▊ | 2250/2560 [10:33<01:23,  3.69it/s]
 88%|████████▊ | 2251/2560 [10:33<01:28,  3.50it/s]
 88%|████████▊ | 2252/2560 [10:33<01:27,  3.54it/s]
                                                   

 88%|████████▊ | 2252/2560 [10:33<01:27,  3.54it/s]
 88%|████████▊ | 2253/2560 [10:34<01:26,  3.53it/s]
 88%|████████▊ | 2254/2560 [10:34<01:25,  3.57it/s]
                                                   

 88%|████████▊ | 2254/2560 [10:34<01:25,  3.57it/s]
 88%|████████▊ | 2255/2560 [10:34<01:24,  3.60it/s]
 88%|████████▊ | 2256/2560 [10:35<01:24,  3.61it/s]
                                                   

 88%|████████▊ | 2256/2560 [10:35<01:24,  3.61it/s]
 88%|████████▊ | 2257/2560 [10:35<01:23,  3.62it/s]
 88%|████████▊ | 2258/2560 [10:35<01:23,  3.62it/s]
                                                   

 88%|████████▊ | 2258/2560 [10:35<01:23,  3.62it/s]
 88%|████████▊ | 2259/2560 [10:35<01:23,  3.61it/s]
 88%|████████▊ | 2260/2560 [10:36<01:23,  3.60it/s]
                                                   

 88%|████████▊ | 2260/2560 [10:36<01:23,  3.60it/s]
 88%|████████▊ | 2261/2560 [10:36<01:23,  3.60it/s]
 88%|████████▊ | 2262/2560 [10:36<01:22,  3.63it/s]
                                                   

 88%|████████▊ | 2262/2560 [10:36<01:22,  3.63it/s]
 88%|████████▊ | 2263/2560 [10:36<01:21,  3.66it/s]
 88%|████████▊ | 2264/2560 [10:37<01:20,  3.68it/s]
                                                   

 88%|████████▊ | 2264/2560 [10:37<01:20,  3.68it/s]
 88%|████████▊ | 2265/2560 [10:37<01:20,  3.69it/s]
 89%|████████▊ | 2266/2560 [10:37<01:19,  3.71it/s]
                                                   

 89%|████████▊ | 2266/2560 [10:37<01:19,  3.71it/s]
 89%|████████▊ | 2267/2560 [10:38<01:18,  3.72it/s]
 89%|████████▊ | 2268/2560 [10:38<01:18,  3.71it/s]
                                                   

 89%|████████▊ | 2268/2560 [10:38<01:18,  3.71it/s]
 89%|████████▊ | 2269/2560 [10:38<01:18,  3.69it/s]
 89%|████████▊ | 2270/2560 [10:38<01:18,  3.68it/s]
                                                   

 89%|████████▊ | 2270/2560 [10:38<01:18,  3.68it/s]
 89%|████████▊ | 2271/2560 [10:39<01:18,  3.68it/s]
 89%|████████▉ | 2272/2560 [10:39<01:17,  3.70it/s]
                                                   

 89%|████████▉ | 2272/2560 [10:39<01:17,  3.70it/s]
 89%|████████▉ | 2273/2560 [10:39<01:17,  3.69it/s]
 89%|████████▉ | 2274/2560 [10:39<01:17,  3.69it/s]
                                                   

 89%|████████▉ | 2274/2560 [10:39<01:17,  3.69it/s]
 89%|████████▉ | 2275/2560 [10:40<01:16,  3.71it/s]
 89%|████████▉ | 2276/2560 [10:40<01:16,  3.70it/s]
                                                   

 89%|████████▉ | 2276/2560 [10:40<01:16,  3.70it/s]
 89%|████████▉ | 2277/2560 [10:40<01:17,  3.68it/s]
 89%|████████▉ | 2278/2560 [10:41<01:17,  3.65it/s]
                                                   

 89%|████████▉ | 2278/2560 [10:41<01:17,  3.65it/s]
 89%|████████▉ | 2279/2560 [10:41<01:16,  3.65it/s]
 89%|████████▉ | 2280/2560 [10:41<01:16,  3.67it/s]
                                                   

 89%|████████▉ | 2280/2560 [10:41<01:16,  3.67it/s]
 89%|████████▉ | 2281/2560 [10:41<01:16,  3.66it/s]
 89%|████████▉ | 2282/2560 [10:42<01:16,  3.64it/s]
                                                   

 89%|████████▉ | 2282/2560 [10:42<01:16,  3.64it/s]
 89%|████████▉ | 2283/2560 [10:42<01:19,  3.50it/s]
 89%|████████▉ | 2284/2560 [10:42<01:20,  3.44it/s]
                                                   

 89%|████████▉ | 2284/2560 [10:42<01:20,  3.44it/s]
 89%|████████▉ | 2285/2560 [10:43<01:18,  3.50it/s]
 89%|████████▉ | 2286/2560 [10:43<01:16,  3.57it/s]
                                                   

 89%|████████▉ | 2286/2560 [10:43<01:16,  3.57it/s]
 89%|████████▉ | 2287/2560 [10:43<01:15,  3.63it/s]
 89%|████████▉ | 2288/2560 [10:43<01:14,  3.65it/s]
                                                   

 89%|████████▉ | 2288/2560 [10:43<01:14,  3.65it/s]
 89%|████████▉ | 2289/2560 [10:44<01:14,  3.64it/s]
 89%|████████▉ | 2290/2560 [10:44<01:13,  3.68it/s]
                                                   

 89%|████████▉ | 2290/2560 [10:44<01:13,  3.68it/s]
 89%|████████▉ | 2291/2560 [10:44<01:12,  3.69it/s]
 90%|████████▉ | 2292/2560 [10:44<01:12,  3.69it/s]
                                                   

 90%|████████▉ | 2292/2560 [10:44<01:12,  3.69it/s]
 90%|████████▉ | 2293/2560 [10:45<01:12,  3.69it/s]
 90%|████████▉ | 2294/2560 [10:45<01:11,  3.71it/s]
                                                   

 90%|████████▉ | 2294/2560 [10:45<01:11,  3.71it/s]
 90%|████████▉ | 2295/2560 [10:45<01:11,  3.70it/s]
 90%|████████▉ | 2296/2560 [10:45<01:11,  3.70it/s]
                                                   

 90%|████████▉ | 2296/2560 [10:45<01:11,  3.70it/s]
 90%|████████▉ | 2297/2560 [10:46<01:10,  3.72it/s]
 90%|████████▉ | 2298/2560 [10:46<01:11,  3.69it/s]
                                                   

 90%|████████▉ | 2298/2560 [10:46<01:11,  3.69it/s]
 90%|████████▉ | 2299/2560 [10:46<01:10,  3.70it/s]
 90%|████████▉ | 2300/2560 [10:47<01:10,  3.67it/s]
                                                   

 90%|████████▉ | 2300/2560 [10:47<01:10,  3.67it/s]
 90%|████████▉ | 2301/2560 [10:47<01:10,  3.67it/s]
 90%|████████▉ | 2302/2560 [10:47<01:10,  3.65it/s]
                                                   

 90%|████████▉ | 2302/2560 [10:47<01:10,  3.65it/s]
 90%|████████▉ | 2303/2560 [10:47<01:10,  3.66it/s]
 90%|█████████ | 2304/2560 [10:48<00:58,  4.34it/s]
                                                   

 90%|█████████ | 2304/2560 [10:48<00:58,  4.34it/s]
 90%|█████████ | 2305/2560 [10:48<01:02,  4.09it/s]
 90%|█████████ | 2306/2560 [10:48<01:03,  3.98it/s]
                                                   

 90%|█████████ | 2306/2560 [10:48<01:03,  3.98it/s]
 90%|█████████ | 2307/2560 [10:48<01:05,  3.88it/s]
 90%|█████████ | 2308/2560 [10:49<01:05,  3.84it/s]
                                                   

 90%|█████████ | 2308/2560 [10:49<01:05,  3.84it/s]
 90%|█████████ | 2309/2560 [10:49<01:06,  3.77it/s]
 90%|█████████ | 2310/2560 [10:49<01:06,  3.78it/s]
                                                   

 90%|█████████ | 2310/2560 [10:49<01:06,  3.78it/s]
 90%|█████████ | 2311/2560 [10:49<01:05,  3.79it/s]
 90%|█████████ | 2312/2560 [10:50<01:05,  3.79it/s]
                                                   

 90%|█████████ | 2312/2560 [10:50<01:05,  3.79it/s]
 90%|█████████ | 2313/2560 [10:50<01:04,  3.82it/s]
 90%|█████████ | 2314/2560 [10:50<01:04,  3.81it/s]
                                                   

 90%|█████████ | 2314/2560 [10:50<01:04,  3.81it/s]
 90%|█████████ | 2315/2560 [10:50<01:04,  3.80it/s]
 90%|█████████ | 2316/2560 [10:51<01:05,  3.74it/s]
                                                   

 90%|█████████ | 2316/2560 [10:51<01:05,  3.74it/s]
 91%|█████████ | 2317/2560 [10:51<01:04,  3.75it/s]
 91%|█████████ | 2318/2560 [10:51<01:04,  3.74it/s]
                                                   

 91%|█████████ | 2318/2560 [10:51<01:04,  3.74it/s]
 91%|█████████ | 2319/2560 [10:52<01:04,  3.73it/s]
 91%|█████████ | 2320/2560 [10:52<01:05,  3.65it/s]
                                                   

 91%|█████████ | 2320/2560 [10:52<01:05,  3.65it/s]
 91%|█████████ | 2321/2560 [10:52<01:05,  3.68it/s]
 91%|█████████ | 2322/2560 [10:52<01:04,  3.71it/s]
                                                   

 91%|█████████ | 2322/2560 [10:52<01:04,  3.71it/s]
 91%|█████████ | 2323/2560 [10:53<01:03,  3.73it/s]
 91%|█████████ | 2324/2560 [10:53<01:02,  3.77it/s]
                                                   

 91%|█████████ | 2324/2560 [10:53<01:02,  3.77it/s]
 91%|█████████ | 2325/2560 [10:53<01:02,  3.78it/s]
 91%|█████████ | 2326/2560 [10:53<01:01,  3.79it/s]
                                                   

 91%|█████████ | 2326/2560 [10:53<01:01,  3.79it/s]
 91%|█████████ | 2327/2560 [10:54<01:01,  3.79it/s]
 91%|█████████ | 2328/2560 [10:54<01:01,  3.78it/s]
                                                   

 91%|█████████ | 2328/2560 [10:54<01:01,  3.78it/s]
 91%|█████████ | 2329/2560 [10:54<01:00,  3.80it/s]
 91%|█████████ | 2330/2560 [10:54<01:00,  3.79it/s]
                                                   
{'loss': '0.00137', 'grad_norm': '0.01434', 'learning_rate': '1.351e-05', 'epoch': '33.66'}
{'loss': '0.001456', 'grad_norm': '0.01664', 'learning_rate': '1.338e-05', 'epoch': '33.69'}
{'loss': '0.001768', 'grad_norm': '0.05968', 'learning_rate': '1.325e-05', 'epoch': '33.72'}
{'loss': '0.001603', 'grad_norm': '0.0332', 'learning_rate': '1.312e-05', 'epoch': '33.76'}
{'loss': '0.001924', 'grad_norm': '0.04989', 'learning_rate': '1.299e-05', 'epoch': '33.79'}
{'loss': '0.00132', 'grad_norm': '0.04158', 'learning_rate': '1.286e-05', 'epoch': '33.82'}
{'loss': '0.002044', 'grad_norm': '0.03845', 'learning_rate': '1.274e-05', 'epoch': '33.85'}
{'loss': '0.001469', 'grad_norm': '0.04765', 'learning_rate': '1.261e-05', 'epoch': '33.88'}
{'loss': '0.001891', 'grad_norm': '0.02782', 'learning_rate': '1.249e-05', 'epoch': '33.91'}
{'loss': '0.001566', 'grad_norm': '0.03577', 'learning_rate': '1.236e-05', 'epoch': '33.94'}
{'loss': '0.001319', 'grad_norm': '0.024', 'learning_rate': '1.224e-05', 'epoch': '33.98'}
{'loss': '0.001335', 'grad_norm': '0.02974', 'learning_rate': '1.211e-05', 'epoch': '34'}
{'loss': '0.00119', 'grad_norm': '0.02532', 'learning_rate': '1.199e-05', 'epoch': '34.03'}
{'loss': '0.001252', 'grad_norm': '0.02495', 'learning_rate': '1.187e-05', 'epoch': '34.06'}
{'loss': '0.00162', 'grad_norm': '0.02992', 'learning_rate': '1.175e-05', 'epoch': '34.09'}
{'loss': '0.001222', 'grad_norm': '0.02946', 'learning_rate': '1.163e-05', 'epoch': '34.13'}
{'loss': '0.001444', 'grad_norm': '0.03699', 'learning_rate': '1.151e-05', 'epoch': '34.16'}
{'loss': '0.001527', 'grad_norm': '0.01484', 'learning_rate': '1.139e-05', 'epoch': '34.19'}
{'loss': '0.001561', 'grad_norm': '0.03959', 'learning_rate': '1.127e-05', 'epoch': '34.22'}
{'loss': '0.001515', 'grad_norm': '0.03035', 'learning_rate': '1.115e-05', 'epoch': '34.25'}
{'loss': '0.001135', 'grad_norm': '0.03793', 'learning_rate': '1.103e-05', 'epoch': '34.28'}
{'loss': '0.001834', 'grad_norm': '0.04302', 'learning_rate': '1.091e-05', 'epoch': '34.31'}
{'loss': '0.001138', 'grad_norm': '0.0587', 'learning_rate': '1.079e-05', 'epoch': '34.35'}
{'loss': '0.001601', 'grad_norm': '0.02008', 'learning_rate': '1.068e-05', 'epoch': '34.38'}
{'loss': '0.001481', 'grad_norm': '0.01604', 'learning_rate': '1.056e-05', 'epoch': '34.41'}
{'loss': '0.001417', 'grad_norm': '0.07431', 'learning_rate': '1.045e-05', 'epoch': '34.44'}
{'loss': '0.001269', 'grad_norm': '0.02581', 'learning_rate': '1.033e-05', 'epoch': '34.47'}
{'loss': '0.001858', 'grad_norm': '0.04106', 'learning_rate': '1.022e-05', 'epoch': '34.5'}
{'loss': '0.001564', 'grad_norm': '0.03411', 'learning_rate': '1.01e-05', 'epoch': '34.54'}
{'loss': '0.001169', 'grad_norm': '0.02056', 'learning_rate': '9.991e-06', 'epoch': '34.57'}
{'loss': '0.001283', 'grad_norm': '0.02108', 'learning_rate': '9.879e-06', 'epoch': '34.6'}
{'loss': '0.001337', 'grad_norm': '0.02862', 'learning_rate': '9.767e-06', 'epoch': '34.63'}
{'loss': '0.001298', 'grad_norm': '0.03345', 'learning_rate': '9.656e-06', 'epoch': '34.66'}
{'loss': '0.00126', 'grad_norm': '0.01748', 'learning_rate': '9.546e-06', 'epoch': '34.69'}
{'loss': '0.001825', 'grad_norm': '0.05678', 'learning_rate': '9.436e-06', 'epoch': '34.72'}
{'loss': '0.002153', 'grad_norm': '0.03444', 'learning_rate': '9.327e-06', 'epoch': '34.76'}
{'loss': '0.001483', 'grad_norm': '0.02487', 'learning_rate': '9.218e-06', 'epoch': '34.79'}
{'loss': '0.001716', 'grad_norm': '0.02027', 'learning_rate': '9.11e-06', 'epoch': '34.82'}
{'loss': '0.001222', 'grad_norm': '0.03833', 'learning_rate': '9.003e-06', 'epoch': '34.85'}
{'loss': '0.001313', 'grad_norm': '0.02722', 'learning_rate': '8.896e-06', 'epoch': '34.88'}
{'loss': '0.001962', 'grad_norm': '0.03201', 'learning_rate': '8.79e-06', 'epoch': '34.91'}
{'loss': '0.001239', 'grad_norm': '0.0191', 'learning_rate': '8.684e-06', 'epoch': '34.94'}
{'loss': '0.001487', 'grad_norm': '0.02299', 'learning_rate': '8.579e-06', 'epoch': '34.98'}
{'loss': '0.002221', 'grad_norm': '0.09423', 'learning_rate': '8.475e-06', 'epoch': '35'}
{'loss': '0.001167', 'grad_norm': '0.04693', 'learning_rate': '8.371e-06', 'epoch': '35.03'}
{'loss': '0.001411', 'grad_norm': '0.03447', 'learning_rate': '8.268e-06', 'epoch': '35.06'}
{'loss': '0.001201', 'grad_norm': '0.01332', 'learning_rate': '8.165e-06', 'epoch': '35.09'}
{'loss': '0.001404', 'grad_norm': '0.02792', 'learning_rate': '8.063e-06', 'epoch': '35.13'}
{'loss': '0.001378', 'grad_norm': '0.02558', 'learning_rate': '7.962e-06', 'epoch': '35.16'}
{'loss': '0.001169', 'grad_norm': '0.04231', 'learning_rate': '7.861e-06', 'epoch': '35.19'}
{'loss': '0.002099', 'grad_norm': '0.04166', 'learning_rate': '7.761e-06', 'epoch': '35.22'}
{'loss': '0.001166', 'grad_norm': '0.01502', 'learning_rate': '7.662e-06', 'epoch': '35.25'}
{'loss': '0.001574', 'grad_norm': '0.04486', 'learning_rate': '7.563e-06', 'epoch': '35.28'}
{'loss': '0.001116', 'grad_norm': '0.05235', 'learning_rate': '7.464e-06', 'epoch': '35.31'}
{'loss': '0.001649', 'grad_norm': '0.02805', 'learning_rate': '7.367e-06', 'epoch': '35.35'}
{'loss': '0.001293', 'grad_norm': '0.04613', 'learning_rate': '7.27e-06', 'epoch': '35.38'}
{'loss': '0.001663', 'grad_norm': '0.03556', 'learning_rate': '7.173e-06', 'epoch': '35.41'}
{'loss': '0.001911', 'grad_norm': '0.03358', 'learning_rate': '7.078e-06', 'epoch': '35.44'}
{'loss': '0.001071', 'grad_norm': '0.02015', 'learning_rate': '6.982e-06', 'epoch': '35.47'}
{'loss': '0.001592', 'grad_norm': '0.0187', 'learning_rate': '6.888e-06', 'epoch': '35.5'}
{'loss': '0.001106', 'grad_norm': '0.02425', 'learning_rate': '6.794e-06', 'epoch': '35.54'}
{'loss': '0.001799', 'grad_norm': '0.05244', 'learning_rate': '6.701e-06', 'epoch': '35.57'}
{'loss': '0.001695', 'grad_norm': '0.0282', 'learning_rate': '6.608e-06', 'epoch': '35.6'}
{'loss': '0.001333', 'grad_norm': '0.04601', 'learning_rate': '6.516e-06', 'epoch': '35.63'}
{'loss': '0.001141', 'grad_norm': '0.0199', 'learning_rate': '6.425e-06', 'epoch': '35.66'}
{'loss': '0.001096', 'grad_norm': '0.01474', 'learning_rate': '6.334e-06', 'epoch': '35.69'}
{'loss': '0.001655', 'grad_norm': '0.04781', 'learning_rate': '6.244e-06', 'epoch': '35.72'}
{'loss': '0.00179', 'grad_norm': '0.05043', 'learning_rate': '6.154e-06', 'epoch': '35.76'}
{'loss': '0.001324', 'grad_norm': '0.01898', 'learning_rate': '6.065e-06', 'epoch': '35.79'}
{'loss': '0.00145', 'grad_norm': '0.02571', 'learning_rate': '5.977e-06', 'epoch': '35.82'}
{'loss': '0.001561', 'grad_norm': '0.02232', 'learning_rate': '5.889e-06', 'epoch': '35.85'}
{'loss': '0.001343', 'grad_norm': '0.01798', 'learning_rate': '5.802e-06', 'epoch': '35.88'}
{'loss': '0.001693', 'grad_norm': '0.03824', 'learning_rate': '5.716e-06', 'epoch': '35.91'}
{'loss': '0.001878', 'grad_norm': '0.04358', 'learning_rate': '5.63e-06', 'epoch': '35.94'}
{'loss': '0.001685', 'grad_norm': '0.04407', 'learning_rate': '5.545e-06', 'epoch': '35.98'}
{'loss': '0.001566', 'grad_norm': '0.05304', 'learning_rate': '5.46e-06', 'epoch': '36'}
{'loss': '0.00138', 'grad_norm': '0.05608', 'learning_rate': '5.376e-06', 'epoch': '36.03'}
{'loss': '0.001394', 'grad_norm': '0.01882', 'learning_rate': '5.293e-06', 'epoch': '36.06'}
{'loss': '0.001352', 'grad_norm': '0.02455', 'learning_rate': '5.211e-06', 'epoch': '36.09'}
{'loss': '0.001182', 'grad_norm': '0.008405', 'learning_rate': '5.129e-06', 'epoch': '36.13'}
{'loss': '0.00115', 'grad_norm': '0.02101', 'learning_rate': '5.047e-06', 'epoch': '36.16'}
{'loss': '0.001042', 'grad_norm': '0.01746', 'learning_rate': '4.966e-06', 'epoch': '36.19'}
{'loss': '0.001194', 'grad_norm': '0.02428', 'learning_rate': '4.886e-06', 'epoch': '36.22'}
{'loss': '0.001228', 'grad_norm': '0.05508', 'learning_rate': '4.807e-06', 'epoch': '36.25'}
{'loss': '0.001866', 'grad_norm': '0.0654', 'learning_rate': '4.728e-06', 'epoch': '36.28'}
{'loss': '0.001577', 'grad_norm': '0.01737', 'learning_rate': '4.65e-06', 'epoch': '36.31'}
{'loss': '0.001817', 'grad_norm': '0.02297', 'learning_rate': '4.572e-06', 'epoch': '36.35'}
{'loss': '0.001078', 'grad_norm': '0.01861', 'learning_rate': '4.495e-06', 'epoch': '36.38'}
{'loss': '0.001183', 'grad_norm': '0.02488', 'learning_rate': '4.419e-06', 'epoch': '36.41'}
 91%|█████████ | 2330/2560 [10:54<01:00,  3.79it/s]
 91%|█████████ | 2331/2560 [10:55<01:00,  3.80it/s]
 91%|█████████ | 2332/2560 [10:55<01:00,  3.78it/s]
                                                   

 91%|█████████ | 2332/2560 [10:55<01:00,  3.78it/s]
 91%|█████████ | 2333/2560 [10:55<01:00,  3.77it/s]
 91%|█████████ | 2334/2560 [10:56<00:59,  3.79it/s]
                                                   

 91%|█████████ | 2334/2560 [10:56<00:59,  3.79it/s]
 91%|█████████ | 2335/2560 [10:56<00:59,  3.80it/s]
 91%|█████████▏| 2336/2560 [10:56<00:59,  3.79it/s]
                                                   

 91%|█████████▏| 2336/2560 [10:56<00:59,  3.79it/s]
 91%|█████████▏| 2337/2560 [10:56<00:59,  3.76it/s]
 91%|█████████▏| 2338/2560 [10:57<00:59,  3.70it/s]
                                                   

 91%|█████████▏| 2338/2560 [10:57<00:59,  3.70it/s]
 91%|█████████▏| 2339/2560 [10:57<00:59,  3.69it/s]
 91%|█████████▏| 2340/2560 [10:57<00:59,  3.69it/s]
                                                   

 91%|█████████▏| 2340/2560 [10:57<00:59,  3.69it/s]
 91%|█████████▏| 2341/2560 [10:57<00:59,  3.69it/s]
 91%|█████████▏| 2342/2560 [10:58<00:59,  3.68it/s]
                                                   

 91%|█████████▏| 2342/2560 [10:58<00:59,  3.68it/s]
 92%|█████████▏| 2343/2560 [10:58<00:59,  3.65it/s]
 92%|█████████▏| 2344/2560 [10:58<00:59,  3.65it/s]
                                                   

 92%|█████████▏| 2344/2560 [10:58<00:59,  3.65it/s]
 92%|█████████▏| 2345/2560 [10:59<00:58,  3.65it/s]
 92%|█████████▏| 2346/2560 [10:59<00:58,  3.67it/s]
                                                   

 92%|█████████▏| 2346/2560 [10:59<00:58,  3.67it/s]
 92%|█████████▏| 2347/2560 [10:59<00:58,  3.65it/s]
 92%|█████████▏| 2348/2560 [10:59<00:58,  3.63it/s]
                                                   

 92%|█████████▏| 2348/2560 [10:59<00:58,  3.63it/s]
 92%|█████████▏| 2349/2560 [11:00<00:58,  3.63it/s]
 92%|█████████▏| 2350/2560 [11:00<00:57,  3.64it/s]
                                                   

 92%|█████████▏| 2350/2560 [11:00<00:57,  3.64it/s]
 92%|█████████▏| 2351/2560 [11:00<00:57,  3.62it/s]
 92%|█████████▏| 2352/2560 [11:00<00:57,  3.64it/s]
                                                   

 92%|█████████▏| 2352/2560 [11:00<00:57,  3.64it/s]
 92%|█████████▏| 2353/2560 [11:01<00:56,  3.63it/s]
 92%|█████████▏| 2354/2560 [11:01<00:56,  3.64it/s]
                                                   

 92%|█████████▏| 2354/2560 [11:01<00:56,  3.64it/s]
 92%|█████████▏| 2355/2560 [11:01<00:56,  3.66it/s]
 92%|█████████▏| 2356/2560 [11:02<00:55,  3.65it/s]
                                                   

 92%|█████████▏| 2356/2560 [11:02<00:55,  3.65it/s]
 92%|█████████▏| 2357/2560 [11:02<00:55,  3.66it/s]
 92%|█████████▏| 2358/2560 [11:02<00:55,  3.66it/s]
                                                   

 92%|█████████▏| 2358/2560 [11:02<00:55,  3.66it/s]
 92%|█████████▏| 2359/2560 [11:02<00:54,  3.65it/s]
 92%|█████████▏| 2360/2560 [11:03<00:54,  3.64it/s]
                                                   

 92%|█████████▏| 2360/2560 [11:03<00:54,  3.64it/s]
 92%|█████████▏| 2361/2560 [11:03<00:54,  3.65it/s]
 92%|█████████▏| 2362/2560 [11:03<00:53,  3.68it/s]
                                                   

 92%|█████████▏| 2362/2560 [11:03<00:53,  3.68it/s]
 92%|█████████▏| 2363/2560 [11:03<00:54,  3.64it/s]
 92%|█████████▏| 2364/2560 [11:04<00:53,  3.65it/s]
                                                   

 92%|█████████▏| 2364/2560 [11:04<00:53,  3.65it/s]
 92%|█████████▏| 2365/2560 [11:04<00:53,  3.64it/s]
 92%|█████████▏| 2366/2560 [11:04<00:53,  3.63it/s]
                                                   

 92%|█████████▏| 2366/2560 [11:04<00:53,  3.63it/s]
 92%|█████████▏| 2367/2560 [11:05<00:53,  3.63it/s]
 92%|█████████▎| 2368/2560 [11:05<00:44,  4.31it/s]
                                                   

 92%|█████████▎| 2368/2560 [11:05<00:44,  4.31it/s]
 93%|█████████▎| 2369/2560 [11:05<00:46,  4.09it/s]
 93%|█████████▎| 2370/2560 [11:05<00:48,  3.94it/s]
                                                   

 93%|█████████▎| 2370/2560 [11:05<00:48,  3.94it/s]
 93%|█████████▎| 2371/2560 [11:06<00:49,  3.85it/s]
 93%|█████████▎| 2372/2560 [11:06<00:49,  3.77it/s]
                                                   

 93%|█████████▎| 2372/2560 [11:06<00:49,  3.77it/s]
 93%|█████████▎| 2373/2560 [11:06<00:50,  3.73it/s]
 93%|█████████▎| 2374/2560 [11:06<00:50,  3.69it/s]
                                                   

 93%|█████████▎| 2374/2560 [11:06<00:50,  3.69it/s]
 93%|█████████▎| 2375/2560 [11:07<00:50,  3.65it/s]
 93%|█████████▎| 2376/2560 [11:07<00:50,  3.64it/s]
                                                   

 93%|█████████▎| 2376/2560 [11:07<00:50,  3.64it/s]
 93%|█████████▎| 2377/2560 [11:07<00:51,  3.57it/s]
 93%|█████████▎| 2378/2560 [11:07<00:50,  3.60it/s]
                                                   

 93%|█████████▎| 2378/2560 [11:07<00:50,  3.60it/s]
 93%|█████████▎| 2379/2560 [11:08<00:50,  3.59it/s]
 93%|█████████▎| 2380/2560 [11:08<00:49,  3.61it/s]
                                                   

 93%|█████████▎| 2380/2560 [11:08<00:49,  3.61it/s]
 93%|█████████▎| 2381/2560 [11:08<00:49,  3.61it/s]
 93%|█████████▎| 2382/2560 [11:09<00:49,  3.61it/s]
                                                   

 93%|█████████▎| 2382/2560 [11:09<00:49,  3.61it/s]
 93%|█████████▎| 2383/2560 [11:09<00:48,  3.62it/s]
 93%|█████████▎| 2384/2560 [11:09<00:48,  3.65it/s]
                                                   

 93%|█████████▎| 2384/2560 [11:09<00:48,  3.65it/s]
 93%|█████████▎| 2385/2560 [11:09<00:47,  3.70it/s]
 93%|█████████▎| 2386/2560 [11:10<00:46,  3.72it/s]
                                                   

 93%|█████████▎| 2386/2560 [11:10<00:46,  3.72it/s]
 93%|█████████▎| 2387/2560 [11:10<00:46,  3.72it/s]
 93%|█████████▎| 2388/2560 [11:10<00:46,  3.70it/s]
                                                   

 93%|█████████▎| 2388/2560 [11:10<00:46,  3.70it/s]
 93%|█████████▎| 2389/2560 [11:10<00:46,  3.71it/s]
 93%|█████████▎| 2390/2560 [11:11<00:45,  3.70it/s]
                                                   

 93%|█████████▎| 2390/2560 [11:11<00:45,  3.70it/s]
 93%|█████████▎| 2391/2560 [11:11<00:45,  3.72it/s]
 93%|█████████▎| 2392/2560 [11:11<00:45,  3.71it/s]
                                                   

 93%|█████████▎| 2392/2560 [11:11<00:45,  3.71it/s]
 93%|█████████▎| 2393/2560 [11:12<00:45,  3.71it/s]
 94%|█████████▎| 2394/2560 [11:12<00:44,  3.72it/s]
                                                   

 94%|█████████▎| 2394/2560 [11:12<00:44,  3.72it/s]
 94%|█████████▎| 2395/2560 [11:12<00:45,  3.66it/s]
 94%|█████████▎| 2396/2560 [11:12<00:44,  3.68it/s]
                                                   

 94%|█████████▎| 2396/2560 [11:12<00:44,  3.68it/s]
 94%|█████████▎| 2397/2560 [11:13<00:44,  3.68it/s]
 94%|█████████▎| 2398/2560 [11:13<00:43,  3.69it/s]
                                                   

 94%|█████████▎| 2398/2560 [11:13<00:43,  3.69it/s]
 94%|█████████▎| 2399/2560 [11:13<00:43,  3.68it/s]
 94%|█████████▍| 2400/2560 [11:13<00:43,  3.69it/s]
                                                   

 94%|█████████▍| 2400/2560 [11:13<00:43,  3.69it/s]
 94%|█████████▍| 2401/2560 [11:14<00:42,  3.70it/s]
 94%|█████████▍| 2402/2560 [11:14<00:43,  3.66it/s]
                                                   

 94%|█████████▍| 2402/2560 [11:14<00:43,  3.66it/s]
 94%|█████████▍| 2403/2560 [11:14<00:43,  3.64it/s]
 94%|█████████▍| 2404/2560 [11:15<00:43,  3.61it/s]
                                                   

 94%|█████████▍| 2404/2560 [11:15<00:43,  3.61it/s]
 94%|█████████▍| 2405/2560 [11:15<00:42,  3.62it/s]
 94%|█████████▍| 2406/2560 [11:15<00:43,  3.54it/s]
                                                   

 94%|█████████▍| 2406/2560 [11:15<00:43,  3.54it/s]
 94%|█████████▍| 2407/2560 [11:15<00:43,  3.51it/s]
 94%|█████████▍| 2408/2560 [11:16<00:43,  3.48it/s]
                                                   

 94%|█████████▍| 2408/2560 [11:16<00:43,  3.48it/s]
 94%|█████████▍| 2409/2560 [11:16<00:43,  3.47it/s]
 94%|█████████▍| 2410/2560 [11:16<00:43,  3.45it/s]
                                                   

 94%|█████████▍| 2410/2560 [11:16<00:43,  3.45it/s]
 94%|█████████▍| 2411/2560 [11:17<00:43,  3.40it/s]
 94%|█████████▍| 2412/2560 [11:17<00:44,  3.34it/s]
                                                   

 94%|█████████▍| 2412/2560 [11:17<00:44,  3.34it/s]
 94%|█████████▍| 2413/2560 [11:17<00:43,  3.38it/s]
 94%|█████████▍| 2414/2560 [11:17<00:42,  3.43it/s]
                                                   

 94%|█████████▍| 2414/2560 [11:17<00:42,  3.43it/s]
 94%|█████████▍| 2415/2560 [11:18<00:41,  3.47it/s]
 94%|█████████▍| 2416/2560 [11:18<00:41,  3.50it/s]
                                                   

 94%|█████████▍| 2416/2560 [11:18<00:41,  3.50it/s]
 94%|█████████▍| 2417/2560 [11:18<00:40,  3.55it/s]
 94%|█████████▍| 2418/2560 [11:19<00:39,  3.55it/s]
                                                   

 94%|█████████▍| 2418/2560 [11:19<00:39,  3.55it/s]
 94%|█████████▍| 2419/2560 [11:19<00:39,  3.55it/s]
 95%|█████████▍| 2420/2560 [11:19<00:39,  3.56it/s]
                                                   

 95%|█████████▍| 2420/2560 [11:19<00:39,  3.56it/s]
 95%|█████████▍| 2421/2560 [11:19<00:38,  3.58it/s]
 95%|█████████▍| 2422/2560 [11:20<00:38,  3.59it/s]
                                                   

 95%|█████████▍| 2422/2560 [11:20<00:38,  3.59it/s]
 95%|█████████▍| 2423/2560 [11:20<00:38,  3.60it/s]
 95%|█████████▍| 2424/2560 [11:20<00:37,  3.62it/s]
                                                   

 95%|█████████▍| 2424/2560 [11:20<00:37,  3.62it/s]
 95%|█████████▍| 2425/2560 [11:21<00:37,  3.62it/s]
 95%|█████████▍| 2426/2560 [11:21<00:36,  3.63it/s]
                                                   

 95%|█████████▍| 2426/2560 [11:21<00:36,  3.63it/s]
 95%|█████████▍| 2427/2560 [11:21<00:36,  3.63it/s]
 95%|█████████▍| 2428/2560 [11:21<00:36,  3.63it/s]
                                                   

 95%|█████████▍| 2428/2560 [11:21<00:36,  3.63it/s]
 95%|█████████▍| 2429/2560 [11:22<00:36,  3.63it/s]
 95%|█████████▍| 2430/2560 [11:22<00:35,  3.63it/s]
                                                   

 95%|█████████▍| 2430/2560 [11:22<00:35,  3.63it/s]
 95%|█████████▍| 2431/2560 [11:22<00:35,  3.63it/s]
 95%|█████████▌| 2432/2560 [11:22<00:29,  4.28it/s]
                                                   

 95%|█████████▌| 2432/2560 [11:22<00:29,  4.28it/s]
 95%|█████████▌| 2433/2560 [11:23<00:31,  4.06it/s]
 95%|█████████▌| 2434/2560 [11:23<00:32,  3.90it/s]
                                                   

 95%|█████████▌| 2434/2560 [11:23<00:32,  3.90it/s]
 95%|█████████▌| 2435/2560 [11:23<00:32,  3.83it/s]
 95%|█████████▌| 2436/2560 [11:23<00:33,  3.75it/s]
                                                   

 95%|█████████▌| 2436/2560 [11:23<00:33,  3.75it/s]
 95%|█████████▌| 2437/2560 [11:24<00:33,  3.71it/s]
 95%|█████████▌| 2438/2560 [11:24<00:33,  3.67it/s]
                                                   

 95%|█████████▌| 2438/2560 [11:24<00:33,  3.67it/s]
 95%|█████████▌| 2439/2560 [11:24<00:33,  3.67it/s]
 95%|█████████▌| 2440/2560 [11:25<00:33,  3.61it/s]
                                                   

 95%|█████████▌| 2440/2560 [11:25<00:33,  3.61it/s]
 95%|█████████▌| 2441/2560 [11:25<00:32,  3.62it/s]
 95%|█████████▌| 2442/2560 [11:25<00:32,  3.61it/s]
                                                   

 95%|█████████▌| 2442/2560 [11:25<00:32,  3.61it/s]
 95%|█████████▌| 2443/2560 [11:25<00:32,  3.61it/s]
 95%|█████████▌| 2444/2560 [11:26<00:32,  3.60it/s]
                                                   

 95%|█████████▌| 2444/2560 [11:26<00:32,  3.60it/s]
 96%|█████████▌| 2445/2560 [11:26<00:32,  3.59it/s]
 96%|█████████▌| 2446/2560 [11:26<00:31,  3.59it/s]
                                                   

 96%|█████████▌| 2446/2560 [11:26<00:31,  3.59it/s]
 96%|█████████▌| 2447/2560 [11:26<00:31,  3.57it/s]
 96%|█████████▌| 2448/2560 [11:27<00:31,  3.58it/s]
                                                   

 96%|█████████▌| 2448/2560 [11:27<00:31,  3.58it/s]
 96%|█████████▌| 2449/2560 [11:27<00:31,  3.57it/s]
 96%|█████████▌| 2450/2560 [11:27<00:30,  3.59it/s]
                                                   

 96%|█████████▌| 2450/2560 [11:27<00:30,  3.59it/s]
 96%|█████████▌| 2451/2560 [11:28<00:30,  3.54it/s]
 96%|█████████▌| 2452/2560 [11:28<00:30,  3.58it/s]
                                                   

 96%|█████████▌| 2452/2560 [11:28<00:30,  3.58it/s]
 96%|█████████▌| 2453/2560 [11:28<00:29,  3.62it/s]
 96%|█████████▌| 2454/2560 [11:28<00:29,  3.61it/s]
                                                   

 96%|█████████▌| 2454/2560 [11:28<00:29,  3.61it/s]
 96%|█████████▌| 2455/2560 [11:29<00:28,  3.62it/s]
 96%|█████████▌| 2456/2560 [11:29<00:28,  3.60it/s]
                                                   

 96%|█████████▌| 2456/2560 [11:29<00:28,  3.60it/s]
 96%|█████████▌| 2457/2560 [11:29<00:28,  3.64it/s]
 96%|█████████▌| 2458/2560 [11:30<00:28,  3.61it/s]
                                                   

 96%|█████████▌| 2458/2560 [11:30<00:28,  3.61it/s]
 96%|█████████▌| 2459/2560 [11:30<00:27,  3.64it/s]
 96%|█████████▌| 2460/2560 [11:30<00:27,  3.64it/s]
                                                   

 96%|█████████▌| 2460/2560 [11:30<00:27,  3.64it/s]
 96%|█████████▌| 2461/2560 [11:30<00:27,  3.65it/s]
 96%|█████████▌| 2462/2560 [11:31<00:26,  3.66it/s]
                                                   

 96%|█████████▌| 2462/2560 [11:31<00:26,  3.66it/s]
 96%|█████████▌| 2463/2560 [11:31<00:26,  3.66it/s]
 96%|█████████▋| 2464/2560 [11:31<00:25,  3.69it/s]
                                                   

 96%|█████████▋| 2464/2560 [11:31<00:25,  3.69it/s]
 96%|█████████▋| 2465/2560 [11:31<00:25,  3.72it/s]
 96%|█████████▋| 2466/2560 [11:32<00:25,  3.72it/s]
                                                   

 96%|█████████▋| 2466/2560 [11:32<00:25,  3.72it/s]
 96%|█████████▋| 2467/2560 [11:32<00:25,  3.70it/s]
 96%|█████████▋| 2468/2560 [11:32<00:24,  3.71it/s]
                                                   

 96%|█████████▋| 2468/2560 [11:32<00:24,  3.71it/s]
 96%|█████████▋| 2469/2560 [11:33<00:24,  3.70it/s]
 96%|█████████▋| 2470/2560 [11:33<00:24,  3.70it/s]
                                                   

 96%|█████████▋| 2470/2560 [11:33<00:24,  3.70it/s]
 97%|█████████▋| 2471/2560 [11:33<00:24,  3.70it/s]
 97%|█████████▋| 2472/2560 [11:33<00:23,  3.74it/s]
                                                   

 97%|█████████▋| 2472/2560 [11:33<00:23,  3.74it/s]
 97%|█████████▋| 2473/2560 [11:34<00:23,  3.76it/s]
 97%|█████████▋| 2474/2560 [11:34<00:22,  3.80it/s]
                                                   

 97%|█████████▋| 2474/2560 [11:34<00:22,  3.80it/s]
 97%|█████████▋| 2475/2560 [11:34<00:22,  3.83it/s]
 97%|█████████▋| 2476/2560 [11:34<00:21,  3.83it/s]
                                                   

 97%|█████████▋| 2476/2560 [11:34<00:21,  3.83it/s]
 97%|█████████▋| 2477/2560 [11:35<00:21,  3.83it/s]
 97%|█████████▋| 2478/2560 [11:35<00:21,  3.83it/s]
                                                   

 97%|█████████▋| 2478/2560 [11:35<00:21,  3.83it/s]
 97%|█████████▋| 2479/2560 [11:35<00:21,  3.83it/s]
 97%|█████████▋| 2480/2560 [11:35<00:20,  3.81it/s]
                                                   

 97%|█████████▋| 2480/2560 [11:35<00:20,  3.81it/s]
 97%|█████████▋| 2481/2560 [11:36<00:20,  3.82it/s]
 97%|█████████▋| 2482/2560 [11:36<00:20,  3.84it/s]
                                                   

 97%|█████████▋| 2482/2560 [11:36<00:20,  3.84it/s]
 97%|█████████▋| 2483/2560 [11:36<00:20,  3.78it/s]
 97%|█████████▋| 2484/2560 [11:36<00:20,  3.76it/s]
                                                   

 97%|█████████▋| 2484/2560 [11:36<00:20,  3.76it/s]
 97%|█████████▋| 2485/2560 [11:37<00:19,  3.75it/s]
 97%|█████████▋| 2486/2560 [11:37<00:19,  3.78it/s]
                                                   

 97%|█████████▋| 2486/2560 [11:37<00:19,  3.78it/s]
 97%|█████████▋| 2487/2560 [11:37<00:19,  3.78it/s]
 97%|█████████▋| 2488/2560 [11:38<00:18,  3.79it/s]
                                                   

 97%|█████████▋| 2488/2560 [11:38<00:18,  3.79it/s]
 97%|█████████▋| 2489/2560 [11:38<00:18,  3.76it/s]
 97%|█████████▋| 2490/2560 [11:38<00:18,  3.79it/s]
                                                   

 97%|█████████▋| 2490/2560 [11:38<00:18,  3.79it/s]
 97%|█████████▋| 2491/2560 [11:38<00:18,  3.79it/s]
 97%|█████████▋| 2492/2560 [11:39<00:17,  3.79it/s]
                                                   

 97%|█████████▋| 2492/2560 [11:39<00:17,  3.79it/s]
 97%|█████████▋| 2493/2560 [11:39<00:17,  3.78it/s]
 97%|█████████▋| 2494/2560 [11:39<00:17,  3.77it/s]
                                                   

 97%|█████████▋| 2494/2560 [11:39<00:17,  3.77it/s]
 97%|█████████▋| 2495/2560 [11:39<00:17,  3.78it/s]
 98%|█████████▊| 2496/2560 [11:39<00:14,  4.46it/s]
                                                   

 98%|█████████▊| 2496/2560 [11:39<00:14,  4.46it/s]
 98%|█████████▊| 2497/2560 [11:40<00:14,  4.20it/s]
 98%|█████████▊| 2498/2560 [11:40<00:15,  4.06it/s]
                                                   

 98%|█████████▊| 2498/2560 [11:40<00:15,  4.06it/s]
 98%|█████████▊| 2499/2560 [11:40<00:15,  3.97it/s]
 98%|█████████▊| 2500/2560 [11:41<00:15,  3.95it/s]
                                                   

 98%|█████████▊| 2500/2560 [11:41<00:15,  3.95it/s]
 98%|█████████▊| 2501/2560 [11:41<00:15,  3.75it/s]
 98%|█████████▊| 2502/2560 [11:41<00:15,  3.75it/s]
                                                   

 98%|█████████▊| 2502/2560 [11:41<00:15,  3.75it/s]
 98%|█████████▊| 2503/2560 [11:41<00:15,  3.79it/s]
 98%|█████████▊| 2504/2560 [11:42<00:14,  3.80it/s]
                                                   

 98%|█████████▊| 2504/2560 [11:42<00:14,  3.80it/s]
 98%|█████████▊| 2505/2560 [11:42<00:14,  3.84it/s]
 98%|█████████▊| 2506/2560 [11:42<00:14,  3.83it/s]
                                                   

 98%|█████████▊| 2506/2560 [11:42<00:14,  3.83it/s]
 98%|█████████▊| 2507/2560 [11:42<00:13,  3.84it/s]
 98%|█████████▊| 2508/2560 [11:43<00:13,  3.84it/s]
                                                   
{'loss': '0.001725', 'grad_norm': '0.01381', 'learning_rate': '4.344e-06', 'epoch': '36.44'}
{'loss': '0.001544', 'grad_norm': '0.01285', 'learning_rate': '4.269e-06', 'epoch': '36.47'}
{'loss': '0.002187', 'grad_norm': '0.04481', 'learning_rate': '4.194e-06', 'epoch': '36.5'}
{'loss': '0.001972', 'grad_norm': '0.0367', 'learning_rate': '4.12e-06', 'epoch': '36.54'}
{'loss': '0.00154', 'grad_norm': '0.02376', 'learning_rate': '4.047e-06', 'epoch': '36.57'}
{'loss': '0.001213', 'grad_norm': '0.05779', 'learning_rate': '3.975e-06', 'epoch': '36.6'}
{'loss': '0.001318', 'grad_norm': '0.02593', 'learning_rate': '3.903e-06', 'epoch': '36.63'}
{'loss': '0.001089', 'grad_norm': '0.02548', 'learning_rate': '3.832e-06', 'epoch': '36.66'}
{'loss': '0.001625', 'grad_norm': '0.02053', 'learning_rate': '3.761e-06', 'epoch': '36.69'}
{'loss': '0.001433', 'grad_norm': '0.04288', 'learning_rate': '3.692e-06', 'epoch': '36.72'}
{'loss': '0.001488', 'grad_norm': '0.04617', 'learning_rate': '3.622e-06', 'epoch': '36.76'}
{'loss': '0.001397', 'grad_norm': '0.04167', 'learning_rate': '3.554e-06', 'epoch': '36.79'}
{'loss': '0.001629', 'grad_norm': '0.02544', 'learning_rate': '3.486e-06', 'epoch': '36.82'}
{'loss': '0.001367', 'grad_norm': '0.01902', 'learning_rate': '3.419e-06', 'epoch': '36.85'}
{'loss': '0.001385', 'grad_norm': '0.02555', 'learning_rate': '3.352e-06', 'epoch': '36.88'}
{'loss': '0.002072', 'grad_norm': '0.04534', 'learning_rate': '3.286e-06', 'epoch': '36.91'}
{'loss': '0.001535', 'grad_norm': '0.01759', 'learning_rate': '3.221e-06', 'epoch': '36.94'}
{'loss': '0.001198', 'grad_norm': '0.02483', 'learning_rate': '3.156e-06', 'epoch': '36.98'}
{'loss': '0.001186', 'grad_norm': '0.04864', 'learning_rate': '3.092e-06', 'epoch': '37'}
{'loss': '0.001358', 'grad_norm': '0.03532', 'learning_rate': '3.028e-06', 'epoch': '37.03'}
{'loss': '0.001234', 'grad_norm': '0.01818', 'learning_rate': '2.966e-06', 'epoch': '37.06'}
{'loss': '0.001502', 'grad_norm': '0.01546', 'learning_rate': '2.903e-06', 'epoch': '37.09'}
{'loss': '0.001446', 'grad_norm': '0.02837', 'learning_rate': '2.842e-06', 'epoch': '37.13'}
{'loss': '0.001407', 'grad_norm': '0.01859', 'learning_rate': '2.781e-06', 'epoch': '37.16'}
{'loss': '0.001399', 'grad_norm': '0.03508', 'learning_rate': '2.721e-06', 'epoch': '37.19'}
{'loss': '0.001624', 'grad_norm': '0.04119', 'learning_rate': '2.661e-06', 'epoch': '37.22'}
{'loss': '0.001571', 'grad_norm': '0.02885', 'learning_rate': '2.603e-06', 'epoch': '37.25'}
{'loss': '0.001505', 'grad_norm': '0.03606', 'learning_rate': '2.544e-06', 'epoch': '37.28'}
{'loss': '0.0009345', 'grad_norm': '0.02637', 'learning_rate': '2.487e-06', 'epoch': '37.31'}
{'loss': '0.001334', 'grad_norm': '0.01702', 'learning_rate': '2.43e-06', 'epoch': '37.35'}
{'loss': '0.002159', 'grad_norm': '0.03723', 'learning_rate': '2.374e-06', 'epoch': '37.38'}
{'loss': '0.001441', 'grad_norm': '0.03523', 'learning_rate': '2.318e-06', 'epoch': '37.41'}
{'loss': '0.001236', 'grad_norm': '0.02292', 'learning_rate': '2.263e-06', 'epoch': '37.44'}
{'loss': '0.001649', 'grad_norm': '0.0487', 'learning_rate': '2.209e-06', 'epoch': '37.47'}
{'loss': '0.001931', 'grad_norm': '0.03023', 'learning_rate': '2.155e-06', 'epoch': '37.5'}
{'loss': '0.001538', 'grad_norm': '0.01962', 'learning_rate': '2.102e-06', 'epoch': '37.54'}
{'loss': '0.001355', 'grad_norm': '0.01985', 'learning_rate': '2.05e-06', 'epoch': '37.57'}
{'loss': '0.0012', 'grad_norm': '0.01513', 'learning_rate': '1.998e-06', 'epoch': '37.6'}
{'loss': '0.001203', 'grad_norm': '0.01318', 'learning_rate': '1.947e-06', 'epoch': '37.63'}
{'loss': '0.001425', 'grad_norm': '0.03846', 'learning_rate': '1.896e-06', 'epoch': '37.66'}
{'loss': '0.001614', 'grad_norm': '0.03288', 'learning_rate': '1.847e-06', 'epoch': '37.69'}
{'loss': '0.001214', 'grad_norm': '0.01989', 'learning_rate': '1.798e-06', 'epoch': '37.72'}
{'loss': '0.001594', 'grad_norm': '0.04421', 'learning_rate': '1.749e-06', 'epoch': '37.76'}
{'loss': '0.001777', 'grad_norm': '0.02007', 'learning_rate': '1.701e-06', 'epoch': '37.79'}
{'loss': '0.001608', 'grad_norm': '0.02525', 'learning_rate': '1.654e-06', 'epoch': '37.82'}
{'loss': '0.001364', 'grad_norm': '0.02617', 'learning_rate': '1.608e-06', 'epoch': '37.85'}
{'loss': '0.001474', 'grad_norm': '0.0288', 'learning_rate': '1.562e-06', 'epoch': '37.88'}
{'loss': '0.001609', 'grad_norm': '0.02496', 'learning_rate': '1.517e-06', 'epoch': '37.91'}
{'loss': '0.001051', 'grad_norm': '0.02497', 'learning_rate': '1.472e-06', 'epoch': '37.94'}
{'loss': '0.001456', 'grad_norm': '0.03694', 'learning_rate': '1.428e-06', 'epoch': '37.98'}
{'loss': '0.001657', 'grad_norm': '0.06834', 'learning_rate': '1.385e-06', 'epoch': '38'}
{'loss': '0.002016', 'grad_norm': '0.03817', 'learning_rate': '1.343e-06', 'epoch': '38.03'}
{'loss': '0.001296', 'grad_norm': '0.0257', 'learning_rate': '1.301e-06', 'epoch': '38.06'}
{'loss': '0.001387', 'grad_norm': '0.02728', 'learning_rate': '1.26e-06', 'epoch': '38.09'}
{'loss': '0.0009352', 'grad_norm': '0.02501', 'learning_rate': '1.219e-06', 'epoch': '38.13'}
{'loss': '0.001625', 'grad_norm': '0.01811', 'learning_rate': '1.179e-06', 'epoch': '38.16'}
{'loss': '0.001913', 'grad_norm': '0.05341', 'learning_rate': '1.14e-06', 'epoch': '38.19'}
{'loss': '0.00136', 'grad_norm': '0.02679', 'learning_rate': '1.101e-06', 'epoch': '38.22'}
{'loss': '0.001618', 'grad_norm': '0.03461', 'learning_rate': '1.063e-06', 'epoch': '38.25'}
{'loss': '0.001218', 'grad_norm': '0.02988', 'learning_rate': '1.026e-06', 'epoch': '38.28'}
{'loss': '0.001505', 'grad_norm': '0.04633', 'learning_rate': '9.896e-07', 'epoch': '38.31'}
{'loss': '0.001349', 'grad_norm': '0.02158', 'learning_rate': '9.537e-07', 'epoch': '38.35'}
{'loss': '0.001449', 'grad_norm': '0.02663', 'learning_rate': '9.184e-07', 'epoch': '38.38'}
{'loss': '0.001149', 'grad_norm': '0.06364', 'learning_rate': '8.838e-07', 'epoch': '38.41'}
{'loss': '0.001783', 'grad_norm': '0.03885', 'learning_rate': '8.499e-07', 'epoch': '38.44'}
{'loss': '0.001072', 'grad_norm': '0.01245', 'learning_rate': '8.166e-07', 'epoch': '38.47'}
{'loss': '0.001148', 'grad_norm': '0.0383', 'learning_rate': '7.84e-07', 'epoch': '38.5'}
{'loss': '0.001162', 'grad_norm': '0.03404', 'learning_rate': '7.52e-07', 'epoch': '38.54'}
{'loss': '0.001237', 'grad_norm': '0.0147', 'learning_rate': '7.208e-07', 'epoch': '38.57'}
{'loss': '0.001784', 'grad_norm': '0.06208', 'learning_rate': '6.901e-07', 'epoch': '38.6'}
{'loss': '0.001423', 'grad_norm': '0.05152', 'learning_rate': '6.602e-07', 'epoch': '38.63'}
{'loss': '0.001487', 'grad_norm': '0.03913', 'learning_rate': '6.308e-07', 'epoch': '38.66'}
{'loss': '0.001147', 'grad_norm': '0.01829', 'learning_rate': '6.022e-07', 'epoch': '38.69'}
{'loss': '0.001814', 'grad_norm': '0.03273', 'learning_rate': '5.742e-07', 'epoch': '38.72'}
{'loss': '0.001857', 'grad_norm': '0.01969', 'learning_rate': '5.469e-07', 'epoch': '38.76'}
{'loss': '0.00163', 'grad_norm': '0.02078', 'learning_rate': '5.203e-07', 'epoch': '38.79'}
{'loss': '0.001426', 'grad_norm': '0.0373', 'learning_rate': '4.943e-07', 'epoch': '38.82'}
{'loss': '0.001289', 'grad_norm': '0.02346', 'learning_rate': '4.689e-07', 'epoch': '38.85'}
{'loss': '0.002013', 'grad_norm': '0.04289', 'learning_rate': '4.443e-07', 'epoch': '38.88'}
{'loss': '0.001449', 'grad_norm': '0.03293', 'learning_rate': '4.203e-07', 'epoch': '38.91'}
{'loss': '0.001606', 'grad_norm': '0.02764', 'learning_rate': '3.97e-07', 'epoch': '38.94'}
{'loss': '0.001139', 'grad_norm': '0.02007', 'learning_rate': '3.743e-07', 'epoch': '38.98'}
{'loss': '0.001191', 'grad_norm': '0.05194', 'learning_rate': '3.523e-07', 'epoch': '39'}
{'loss': '0.001275', 'grad_norm': '0.01776', 'learning_rate': '3.31e-07', 'epoch': '39.03'}
{'loss': '0.001581', 'grad_norm': '0.0426', 'learning_rate': '3.103e-07', 'epoch': '39.06'}
{'loss': '0.0009167', 'grad_norm': '0.0195', 'learning_rate': '2.903e-07', 'epoch': '39.09'}
{'loss': '0.001639', 'grad_norm': '0.01646', 'learning_rate': '2.71e-07', 'epoch': '39.13'}
{'loss': '0.001317', 'grad_norm': '0.02512', 'learning_rate': '2.523e-07', 'epoch': '39.16'}
{'loss': '0.001372', 'grad_norm': '0.02578', 'learning_rate': '2.343e-07', 'epoch': '39.19'}
 98%|█████████▊| 2508/2560 [11:43<00:13,  3.84it/s]
 98%|█████████▊| 2509/2560 [11:43<00:13,  3.85it/s]
 98%|█████████▊| 2510/2560 [11:43<00:12,  3.85it/s]
                                                   

 98%|█████████▊| 2510/2560 [11:43<00:12,  3.85it/s]
 98%|█████████▊| 2511/2560 [11:43<00:12,  3.85it/s]
 98%|█████████▊| 2512/2560 [11:44<00:12,  3.87it/s]
                                                   

 98%|█████████▊| 2512/2560 [11:44<00:12,  3.87it/s]
 98%|█████████▊| 2513/2560 [11:44<00:12,  3.87it/s]
 98%|█████████▊| 2514/2560 [11:44<00:11,  3.89it/s]
                                                   

 98%|█████████▊| 2514/2560 [11:44<00:11,  3.89it/s]
 98%|█████████▊| 2515/2560 [11:44<00:11,  3.89it/s]
 98%|█████████▊| 2516/2560 [11:45<00:11,  3.89it/s]
                                                   

 98%|█████████▊| 2516/2560 [11:45<00:11,  3.89it/s]
 98%|█████████▊| 2517/2560 [11:45<00:11,  3.89it/s]
 98%|█████████▊| 2518/2560 [11:45<00:10,  3.89it/s]
                                                   

 98%|█████████▊| 2518/2560 [11:45<00:10,  3.89it/s]
 98%|█████████▊| 2519/2560 [11:45<00:10,  3.88it/s]
 98%|█████████▊| 2520/2560 [11:46<00:10,  3.86it/s]
                                                   

 98%|█████████▊| 2520/2560 [11:46<00:10,  3.86it/s]
 98%|█████████▊| 2521/2560 [11:46<00:10,  3.88it/s]
 99%|█████████▊| 2522/2560 [11:46<00:09,  3.88it/s]
                                                   

 99%|█████████▊| 2522/2560 [11:46<00:09,  3.88it/s]
 99%|█████████▊| 2523/2560 [11:47<00:09,  3.87it/s]
 99%|█████████▊| 2524/2560 [11:47<00:09,  3.87it/s]
                                                   

 99%|█████████▊| 2524/2560 [11:47<00:09,  3.87it/s]
 99%|█████████▊| 2525/2560 [11:47<00:09,  3.86it/s]
 99%|█████████▊| 2526/2560 [11:47<00:08,  3.88it/s]
                                                   

 99%|█████████▊| 2526/2560 [11:47<00:08,  3.88it/s]
 99%|█████████▊| 2527/2560 [11:48<00:08,  3.88it/s]
 99%|█████████▉| 2528/2560 [11:48<00:08,  3.88it/s]
                                                   

 99%|█████████▉| 2528/2560 [11:48<00:08,  3.88it/s]
 99%|█████████▉| 2529/2560 [11:48<00:07,  3.88it/s]
 99%|█████████▉| 2530/2560 [11:48<00:07,  3.87it/s]
                                                   

 99%|█████████▉| 2530/2560 [11:48<00:07,  3.87it/s]
 99%|█████████▉| 2531/2560 [11:49<00:07,  3.88it/s]
 99%|█████████▉| 2532/2560 [11:49<00:07,  3.87it/s]
                                                   

 99%|█████████▉| 2532/2560 [11:49<00:07,  3.87it/s]
 99%|█████████▉| 2533/2560 [11:49<00:07,  3.86it/s]
 99%|█████████▉| 2534/2560 [11:49<00:06,  3.85it/s]
                                                   

 99%|█████████▉| 2534/2560 [11:49<00:06,  3.85it/s]
 99%|█████████▉| 2535/2560 [11:50<00:06,  3.82it/s]
 99%|█████████▉| 2536/2560 [11:50<00:06,  3.76it/s]
                                                   

 99%|█████████▉| 2536/2560 [11:50<00:06,  3.76it/s]
 99%|█████████▉| 2537/2560 [11:50<00:06,  3.72it/s]
 99%|█████████▉| 2538/2560 [11:50<00:06,  3.62it/s]
                                                   

 99%|█████████▉| 2538/2560 [11:50<00:06,  3.62it/s]
 99%|█████████▉| 2539/2560 [11:51<00:05,  3.60it/s]
 99%|█████████▉| 2540/2560 [11:51<00:05,  3.52it/s]
                                                   

 99%|█████████▉| 2540/2560 [11:51<00:05,  3.52it/s]
 99%|█████████▉| 2541/2560 [11:51<00:05,  3.45it/s]
 99%|█████████▉| 2542/2560 [11:52<00:05,  3.41it/s]
                                                   

 99%|█████████▉| 2542/2560 [11:52<00:05,  3.41it/s]
 99%|█████████▉| 2543/2560 [11:52<00:05,  3.39it/s]
 99%|█████████▉| 2544/2560 [11:52<00:04,  3.42it/s]
                                                   

 99%|█████████▉| 2544/2560 [11:52<00:04,  3.42it/s]
 99%|█████████▉| 2545/2560 [11:53<00:04,  3.48it/s]
 99%|█████████▉| 2546/2560 [11:53<00:03,  3.53it/s]
                                                   

 99%|█████████▉| 2546/2560 [11:53<00:03,  3.53it/s]
 99%|█████████▉| 2547/2560 [11:53<00:03,  3.59it/s]
100%|█████████▉| 2548/2560 [11:53<00:03,  3.62it/s]
                                                   

100%|█████████▉| 2548/2560 [11:53<00:03,  3.62it/s]
100%|█████████▉| 2549/2560 [11:54<00:03,  3.66it/s]
100%|█████████▉| 2550/2560 [11:54<00:02,  3.70it/s]
                                                   

100%|█████████▉| 2550/2560 [11:54<00:02,  3.70it/s]
100%|█████████▉| 2551/2560 [11:54<00:02,  3.71it/s]
100%|█████████▉| 2552/2560 [11:54<00:02,  3.72it/s]
                                                   

100%|█████████▉| 2552/2560 [11:54<00:02,  3.72it/s]
100%|█████████▉| 2553/2560 [11:55<00:01,  3.75it/s]
100%|█████████▉| 2554/2560 [11:55<00:01,  3.72it/s]
                                                   

100%|█████████▉| 2554/2560 [11:55<00:01,  3.72it/s]
100%|█████████▉| 2555/2560 [11:55<00:01,  3.75it/s]
100%|█████████▉| 2556/2560 [11:55<00:01,  3.75it/s]
                                                   

100%|█████████▉| 2556/2560 [11:55<00:01,  3.75it/s]
100%|█████████▉| 2557/2560 [11:56<00:00,  3.75it/s]
100%|█████████▉| 2558/2560 [11:56<00:00,  3.70it/s]
                                                   

100%|█████████▉| 2558/2560 [11:56<00:00,  3.70it/s]
100%|█████████▉| 2559/2560 [11:56<00:00,  3.72it/s]
100%|██████████| 2560/2560 [11:56<00:00,  4.37it/s]
                                                   

100%|██████████| 2560/2560 [11:56<00:00,  4.37it/s]
                                                   

100%|██████████| 2560/2560 [11:56<00:00,  4.37it/s]
100%|██████████| 2560/2560 [11:56<00:00,  3.57it/s]

{'loss': '0.001541', 'grad_norm': '0.02468', 'learning_rate': '2.169e-07', 'epoch': '39.22'}
{'loss': '0.001296', 'grad_norm': '0.02509', 'learning_rate': '2.003e-07', 'epoch': '39.25'}
{'loss': '0.001649', 'grad_norm': '0.06117', 'learning_rate': '1.842e-07', 'epoch': '39.28'}
{'loss': '0.001109', 'grad_norm': '0.04072', 'learning_rate': '1.689e-07', 'epoch': '39.31'}
{'loss': '0.001157', 'grad_norm': '0.0288', 'learning_rate': '1.542e-07', 'epoch': '39.35'}
{'loss': '0.001781', 'grad_norm': '0.02883', 'learning_rate': '1.402e-07', 'epoch': '39.38'}
{'loss': '0.001371', 'grad_norm': '0.02568', 'learning_rate': '1.269e-07', 'epoch': '39.41'}
{'loss': '0.001522', 'grad_norm': '0.03333', 'learning_rate': '1.142e-07', 'epoch': '39.44'}
{'loss': '0.001768', 'grad_norm': '0.01818', 'learning_rate': '1.022e-07', 'epoch': '39.47'}
{'loss': '0.002008', 'grad_norm': '0.04948', 'learning_rate': '9.085e-08', 'epoch': '39.5'}
{'loss': '0.001759', 'grad_norm': '0.02312', 'learning_rate': '8.017e-08', 'epoch': '39.54'}
{'loss': '0.001473', 'grad_norm': '0.01943', 'learning_rate': '7.016e-08', 'epoch': '39.57'}
{'loss': '0.001282', 'grad_norm': '0.02912', 'learning_rate': '6.082e-08', 'epoch': '39.6'}
{'loss': '0.001245', 'grad_norm': '0.05375', 'learning_rate': '5.214e-08', 'epoch': '39.63'}
{'loss': '0.001477', 'grad_norm': '0.0324', 'learning_rate': '4.413e-08', 'epoch': '39.66'}
{'loss': '0.001644', 'grad_norm': '0.03436', 'learning_rate': '3.679e-08', 'epoch': '39.69'}
{'loss': '0.001172', 'grad_norm': '0.02185', 'learning_rate': '3.012e-08', 'epoch': '39.72'}
{'loss': '0.001682', 'grad_norm': '0.02014', 'learning_rate': '2.411e-08', 'epoch': '39.76'}
{'loss': '0.001191', 'grad_norm': '0.02827', 'learning_rate': '1.877e-08', 'epoch': '39.79'}
{'loss': '0.001468', 'grad_norm': '0.02136', 'learning_rate': '1.41e-08', 'epoch': '39.82'}
{'loss': '0.001442', 'grad_norm': '0.02254', 'learning_rate': '1.01e-08', 'epoch': '39.85'}
{'loss': '0.001717', 'grad_norm': '0.02532', 'learning_rate': '6.758e-09', 'epoch': '39.88'}
{'loss': '0.001591', 'grad_norm': '0.01641', 'learning_rate': '4.088e-09', 'epoch': '39.91'}
{'loss': '0.001323', 'grad_norm': '0.0197', 'learning_rate': '2.086e-09', 'epoch': '39.94'}
{'loss': '0.001325', 'grad_norm': '0.02043', 'learning_rate': '7.509e-10', 'epoch': '39.98'}
{'loss': '0.001289', 'grad_norm': '0.04457', 'learning_rate': '8.343e-11', 'epoch': '40'}
{'train_runtime': '716.9', 'train_samples_per_second': '28.29', 'train_steps_per_second': '3.571', 'train_loss': '0.03738', 'epoch': '40'}
[09:23:11] === done ===
The attention mask is not set and cannot be inferred from input because pad token is same as eos token. As a consequence, you may observe unexpected behavior. Please pass your input's `attention_mask` to obtain reliable results.
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:23:19]    stage1 blocks: 3
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:23:23]    stage2 components
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:23:26]    stage3 connections: 12
[09:23:26]    verify round 1 issues: ["2 unconnected component(s) ['c3', 'c1']: wire each into the flow", 'under-connected: 12 connections for 15 components (expect >= 14)', "duplicate service(s) ['SAP Destination service']: wire the existing one, do NOT add duplicate services"]
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:23:35]    verify round 2 issues: ["2 unconnected component(s) ['c3', 'c1']: wire each into the flow", 'under-connected: 13 connections for 15 components (expect >= 14)', "duplicate component id(s) ['c12', 'c13']: each component must appear once"]
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:23:44]    final issues: ["2 unconnected component(s) ['c3', 'c1']: wire each into the flow", 'under-connected: 13 connections for 15 components (expect >= 14)', "duplicate component id(s) ['c12', 'c13']: each component must appear once", "duplicate service(s) ['SAP Destination service']: wire the existing one, do NOT add duplicate services", 'Cloud Connector present but no SAP Connectivity service (incomplete on-prem tunnel).']
[09:23:44] EVAL {'arch': 'Procurement copilot (novel)', 'ok': True, 'blocks': 6, 'components': 17, 'connections': 13, 'verify_rounds': 2, 'remaining_issues': ["2 unconnected component(s) ['c3', 'c1']: wire each into the flow", 'under-connected: 13 connections for 15 components (expect >= 14)', "duplicate component id(s) ['c12', 'c13']: each component must appear once", "duplicate service(s) ['SAP Destination service']: wire the existing one, do NOT add duplicate services", 'Cloud Connector present but no SAP Connectivity service (incomplete on-prem tunnel).'], 'info': '24 nodes, 13 edges'}
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:23:46]    stage1 blocks: 3
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:23:48]    stage2 components
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:23:50]    stage3 connections: 9
[09:23:50]    final issues: []
[09:23:50] EVAL {'arch': 'Predictive maintenance (novel)', 'ok': True, 'blocks': 5, 'components': 10, 'connections': 9, 'verify_rounds': 0, 'remaining_issues': [], 'info': '16 nodes, 9 edges'}
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:23:50]    stage1 blocks: 0
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:23:52]    stage2 components
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:23:52]    stage3 connections: 2
[09:23:52]    verify round 1 issues: ['fewer than 2 components placed', 'connection c0->c1 references missing component', 'connection c1->c0 references missing component']
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:23:58]    verify round 2 issues: ['fewer than 2 components placed', 'connection c0->c1 references missing component', 'connection c1->c0 references missing component']
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:04]    final issues: ['fewer than 2 components placed', 'connection c0->c1 references missing component', 'connection c1->c0 references missing component', 'does not render: 1 nodes, 0 edges']
[09:24:04] EVAL {'arch': 'Claims handling RAG (held-out domain)', 'ok': False, 'blocks': 0, 'components': 0, 'connections': 2, 'verify_rounds': 2, 'remaining_issues': ['fewer than 2 components placed', 'connection c0->c1 references missing component', 'connection c1->c0 references missing component', 'does not render: 1 nodes, 0 edges'], 'info': '1 nodes, 0 edges'}
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:06]    stage1 blocks: 3
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:09]    stage2 components
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:10]    stage3 connections: 7
[09:24:10]    final issues: []
[09:24:10] EVAL {'arch': 'Asset management events (held-out domain)', 'ok': True, 'blocks': 5, 'components': 8, 'connections': 7, 'verify_rounds': 0, 'remaining_issues': [], 'info': '14 nodes, 7 edges'}
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:12]    stage1 blocks: 3
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:16]    stage2 components
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:18]    stage3 connections: 10
[09:24:18]    verify round 1 issues: ["6 unconnected component(s) ['c4', 'c2', 'c9', 'c10', 'c3', 'c1']: wire each into the flow", 'under-connected: 10 connections for 12 components (expect >= 11)', "duplicate service(s) ['SAP HANA Cloud']: wire the existing one, do NOT add duplicate services"]
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:26]    verify round 2 issues: ["6 unconnected component(s) ['c4', 'c2', 'c9', 'c10', 'c3', 'c1']: wire each into the flow", 'under-connected: 10 connections for 12 components (expect >= 11)', "duplicate service(s) ['SAP HANA Cloud']: wire the existing one, do NOT add duplicate services"]
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:34]    final issues: ["6 unconnected component(s) ['c4', 'c2', 'c9', 'c10', 'c3', 'c1']: wire each into the flow", 'under-connected: 10 connections for 12 components (expect >= 11)', "duplicate service(s) ['SAP HANA Cloud']: wire the existing one, do NOT add duplicate services", 'Cloud Connector present but no SAP Connectivity service (incomplete on-prem tunnel).']
[09:24:34] EVAL {'arch': 'AI document agent (head-to-head)', 'ok': True, 'blocks': 6, 'components': 12, 'connections': 10, 'verify_rounds': 2, 'remaining_issues': ["6 unconnected component(s) ['c4', 'c2', 'c9', 'c10', 'c3', 'c1']: wire each into the flow", 'under-connected: 10 connections for 12 components (expect >= 11)', "duplicate service(s) ['SAP HANA Cloud']: wire the existing one, do NOT add duplicate services", 'Cloud Connector present but no SAP Connectivity service (incomplete on-prem tunnel).'], 'info': '19 nodes, 10 edges'}
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:35]    stage1 blocks: 2
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:37]    stage2 components
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:39]    stage3 connections: 8
[09:24:39]    verify round 1 issues: ["duplicate component id(s) ['c0', 'c1', 'c2', 'c3', 'c4', 'c5', 'c6', 'c7', 'c8']: each component must appear once", "duplicate service(s) ['SAP Application Logan service', 'SAP Build Work Zone, standard', 'SAP Cloud Identity Services', 'SAP Connectivity service', 'SAP Destination service', 'SAP Document Management hub', 'SAP Private Link service', 'SAP Task Center']: wire the existing one, do NOT add duplicate services"]
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:48]    verify round 2 issues: ["duplicate component id(s) ['c0', 'c1', 'c2', 'c3', 'c4', 'c5', 'c6', 'c7', 'c8']: each component must appear once", "duplicate service(s) ['SAP Application Logan service', 'SAP Build Work Zone, standard', 'SAP Cloud Identity Services', 'SAP Connectivity service', 'SAP Destination service', 'SAP Document Management hub', 'SAP Private Link service', 'SAP Task Center']: wire the existing one, do NOT add duplicate services"]
Both `max_new_tokens` (=1600) and `max_length`(=128000) seem to have been set. `max_new_tokens` will take precedence. Please refer to the documentation for more information. (https://huggingface.co/docs/transformers/main/en/main_classes/text_generation)
[09:24:57]    final issues: ["duplicate component id(s) ['c0', 'c1', 'c2', 'c3', 'c4', 'c5', 'c6', 'c7', 'c8']: each component must appear once", "duplicate service(s) ['SAP Application Logan service', 'SAP Build Work Zone, standard', 'SAP Cloud Identity Services', 'SAP Connectivity service', 'SAP Destination service', 'SAP Document Management hub', 'SAP Private Link service', 'SAP Task Center']: wire the existing one, do NOT add duplicate services"]
[09:24:57] EVAL {'arch': 'Task Center (known reference)', 'ok': True, 'blocks': 2, 'components': 18, 'connections': 8, 'verify_rounds': 2, 'remaining_issues': ["duplicate component id(s) ['c0', 'c1', 'c2', 'c3', 'c4', 'c5', 'c6', 'c7', 'c8']: each component must appear once", "duplicate service(s) ['SAP Application Logan service', 'SAP Build Work Zone, standard', 'SAP Cloud Identity Services', 'SAP Connectivity service', 'SAP Destination service', 'SAP Document Management hub', 'SAP Private Link service', 'SAP Task Center']: wire the existing one, do NOT add duplicate services"], 'info': '21 nodes, 8 edges'}
[09:24:57] QUALITY 5/6
[09:24:57] merging + pushing smjain/sap-archgen-lfm2-230M
Unsloth: Restored added_tokens_decoder metadata in merged16/tokenizer_config.json.
Found HuggingFace hub cache directory: /root/.cache/huggingface/hub
Checking cache directory for required files...

Unsloth: Copying 1 files from cache to `merged16`:   0%|          | 0/1 [00:00<?, ?it/s]
Unsloth: Copying 1 files from cache to `merged16`: 100%|██████████| 1/1 [00:00<00:00, 12.61it/s]
Successfully copied all 1 files from cache to `merged16`
Checking cache directory for required files...
Cache check failed: tokenizer.model not found in local cache.
Not all required files found in cache. Will proceed with downloading.

Unsloth: Preparing safetensor model files:   0%|          | 0/1 [00:00<?, ?it/s]
Unsloth: Preparing safetensor model files: 100%|██████████| 1/1 [00:00<00:00, 32017.59it/s]

Unsloth: Merging weights into 16bit:   0%|          | 0/1 [00:00<?, ?it/s]
Unsloth: Merging weights into 16bit: 100%|██████████| 1/1 [00:00<00:00,  1.66it/s]
Unsloth: Merging weights into 16bit: 100%|██████████| 1/1 [00:00<00:00,  1.66it/s]
Unsloth: Restored added_tokens_decoder metadata in smjain/sap-archgen-lfm2-230M/tokenizer_config.json.
Unsloth: Merge process complete. Saved to `/work/merged16`
Found HuggingFace hub cache directory: /root/.cache/huggingface/hub
Checking cache directory for required files...

Unsloth: Copying 1 files from cache to `smjain/sap-archgen-lfm2-230M`:   0%|          | 0/1 [00:00<?, ?it/s]
Unsloth: Copying 1 files from cache to `smjain/sap-archgen-lfm2-230M`: 100%|██████████| 1/1 [00:00<00:00, 11.51it/s]
Successfully copied all 1 files from cache to `smjain/sap-archgen-lfm2-230M`
Checking cache directory for required files...
Cache check failed: tokenizer.model not found in local cache.
Not all required files found in cache. Will proceed with downloading.

Unsloth: Preparing safetensor model files:   0%|          | 0/1 [00:00<?, ?it/s]
Unsloth: Preparing safetensor model files: 100%|██████████| 1/1 [00:00<00:00, 42799.02it/s]

Unsloth: Merging weights into 16bit:   0%|          | 0/1 [00:00<?, ?it/s]
Processing Files (0 / 0)      : |          |  0.00B /  0.00B            

New Data Upload               : |          |  0.00B /  0.00B            


  ...m2-230M/model.safetensors:  10%|█         | 48.0MB /  459MB            


  ...m2-230M/model.safetensors:  10%|█         | 48.0MB /  459MB            
Processing Files (0 / 1)      :  10%|█         | 48.0MB /  459MB, 4.65MB/s  


  ...m2-230M/model.safetensors:  17%|█▋        | 80.0MB /  459MB            
Processing Files (0 / 1)      :  17%|█▋        | 80.0MB /  459MB, 7.69MB/s  


  ...m2-230M/model.safetensors:  24%|██▍       |  112MB /  459MB            
Processing Files (0 / 1)      :  24%|██▍       |  112MB /  459MB, 10.7MB/s  


  ...m2-230M/model.safetensors:  33%|███▎      |  152MB /  459MB            
Processing Files (0 / 1)      :  33%|███▎      |  152MB /  459MB, 14.4MB/s  


  ...m2-230M/model.safetensors:  40%|████      |  184MB /  459MB            
Processing Files (0 / 1)      :  40%|████      |  184MB /  459MB, 17.4MB/s  


  ...m2-230M/model.safetensors:  46%|████▌     |  212MB /  459MB            
Processing Files (0 / 1)      :  46%|████▌     |  212MB /  459MB, 19.8MB/s  


  ...m2-230M/model.safetensors:  53%|█████▎    |  242MB /  459MB            
Processing Files (0 / 1)      :  53%|█████▎    |  242MB /  459MB, 22.5MB/s  


  ...m2-230M/model.safetensors:  61%|██████    |  279MB /  459MB            
Processing Files (0 / 1)      :  61%|██████    |  279MB /  459MB, 25.9MB/s  


  ...m2-230M/model.safetensors:  67%|██████▋   |  307MB /  459MB            
Processing Files (0 / 1)      :  67%|██████▋   |  307MB /  459MB, 28.2MB/s  


  ...m2-230M/model.safetensors:  73%|███████▎  |  334MB /  459MB            
Processing Files (0 / 1)      :  73%|███████▎  |  334MB /  459MB, 30.5MB/s  


  ...m2-230M/model.safetensors:  79%|███████▉  |  365MB /  459MB            
Processing Files (0 / 1)      :  79%|███████▉  |  365MB /  459MB, 33.2MB/s  


  ...m2-230M/model.safetensors:  84%|████████▍ |  386MB /  459MB            
Processing Files (0 / 1)      :  84%|████████▍ |  386MB /  459MB, 34.8MB/s  


  ...m2-230M/model.safetensors:  84%|████████▍ |  386MB /  459MB            


  ...m2-230M/model.safetensors:  84%|████████▍ |  386MB /  459MB            


  ...m2-230M/model.safetensors:  84%|████████▍ |  386MB /  459MB            


  ...m2-230M/model.safetensors:  90%|████████▉ |  413MB /  459MB            
Processing Files (0 / 1)      :  90%|████████▉ |  413MB /  459MB, 36.1MB/s  


  ...m2-230M/model.safetensors:  94%|█████████▍|  433MB /  459MB            
Processing Files (0 / 1)      :  94%|█████████▍|  433MB /  459MB, 37.5MB/s  


  ...m2-230M/model.safetensors:  94%|█████████▍|  433MB /  459MB            
Processing Files (0 / 1)      :  94%|█████████▍|  433MB /  459MB, 37.2MB/s  

New Data Upload               :   2%|▏         |  600kB / 26.6MB, 55.6kB/s  


  ...m2-230M/model.safetensors:  94%|█████████▍|  433MB /  459MB            


  ...m2-230M/model.safetensors:  94%|█████████▍|  433MB /  459MB            


  ...m2-230M/model.safetensors:  94%|█████████▍|  433MB /  459MB            


  ...m2-230M/model.safetensors:  94%|█████████▍|  433MB /  459MB            


  ...m2-230M/model.safetensors:  94%|█████████▍|  434MB /  459MB            
Processing Files (0 / 1)      :  94%|█████████▍|  434MB /  459MB, 35.6MB/s  

New Data Upload               :   5%|▍         | 1.20MB / 26.6MB,  108kB/s  


  ...m2-230M/model.safetensors:  95%|█████████▍|  436MB /  459MB            
Processing Files (0 / 1)      :  95%|█████████▍|  436MB /  459MB, 35.5MB/s  

New Data Upload               :  14%|█▎        | 3.60MB / 26.6MB,  326kB/s  


  ...m2-230M/model.safetensors:  95%|█████████▌|  438MB /  459MB            
Processing Files (0 / 1)      :  95%|█████████▌|  438MB /  459MB, 35.3MB/s  

New Data Upload               :  18%|█▊        | 4.80MB / 26.6MB,  432kB/s  


  ...m2-230M/model.safetensors:  97%|█████████▋|  444MB /  459MB            
Processing Files (0 / 1)      :  97%|█████████▋|  444MB /  459MB, 35.5MB/s  

New Data Upload               :  41%|████      | 10.8MB / 26.6MB,  974kB/s  


  ...m2-230M/model.safetensors:  99%|█████████▉|  456MB /  459MB            
Processing Files (0 / 1)      :  99%|█████████▉|  456MB /  459MB, 36.3MB/s  

New Data Upload               :  86%|████████▌ | 22.8MB / 26.6MB, 2.05MB/s  


  ...m2-230M/model.safetensors: 100%|█████████▉|  459MB /  459MB            
Processing Files (0 / 1)      : 100%|█████████▉|  459MB /  459MB, 36.3MB/s  

New Data Upload               :  99%|█████████▉| 26.4MB / 26.6MB, 2.36MB/s  


  ...m2-230M/model.safetensors: 100%|█████████▉|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|█████████▉|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|█████████▉|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|█████████▉|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|█████████▉|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|█████████▉|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|█████████▉|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|█████████▉|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|██████████|  459MB /  459MB            
Processing Files (1 / 1)      : 100%|██████████|  459MB /  459MB, 33.5MB/s  

New Data Upload               : 100%|██████████| 26.6MB / 26.6MB, 2.20MB/s  


  ...m2-230M/model.safetensors: 100%|██████████|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|██████████|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|██████████|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|██████████|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|██████████|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|██████████|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|██████████|  459MB /  459MB            


  ...m2-230M/model.safetensors: 100%|██████████|  459MB /  459MB            
Processing Files (1 / 1)      : 100%|██████████|  459MB /  459MB, 31.2MB/s  

New Data Upload               : 100%|██████████| 26.6MB / 26.6MB, 2.05MB/s  

  ...m2-230M/model.safetensors: 100%|██████████|  459MB /  459MB            

Unsloth: Merging weights into 16bit: 100%|██████████| 1/1 [00:07<00:00,  7.98s/it]
Unsloth: Merging weights into 16bit: 100%|██████████| 1/1 [00:07<00:00,  7.98s/it]
Unsloth: Merge process complete. Saved to `/work/smjain/sap-archgen-lfm2-230M`
[09:25:36] GGUF via unsloth save_pretrained_gguf q4_0
Unsloth: Restored added_tokens_decoder metadata in gguf_out/tokenizer_config.json.
Unsloth: Merging model weights to 16-bit format...
Found HuggingFace hub cache directory: /root/.cache/huggingface/hub
Checking cache directory for required files...

Unsloth: Copying 1 files from cache to `gguf_out`:   0%|          | 0/1 [00:00<?, ?it/s]
Unsloth: Copying 1 files from cache to `gguf_out`: 100%|██████████| 1/1 [00:00<00:00, 12.80it/s]
Successfully copied all 1 files from cache to `gguf_out`
Checking cache directory for required files...
Cache check failed: tokenizer.model not found in local cache.
Not all required files found in cache. Will proceed with downloading.

Unsloth: Preparing safetensor model files:   0%|          | 0/1 [00:00<?, ?it/s]
Unsloth: Preparing safetensor model files: 100%|██████████| 1/1 [00:00<00:00, 41527.76it/s]

Unsloth: Merging weights into 16bit:   0%|          | 0/1 [00:00<?, ?it/s]
Unsloth: Merging weights into 16bit: 100%|██████████| 1/1 [00:00<00:00,  1.72it/s]
Unsloth: Merging weights into 16bit: 100%|██████████| 1/1 [00:00<00:00,  1.72it/s]
Unsloth: Merge process complete. Saved to `/work/gguf_out`
Unsloth: Converting to GGUF format...
==((====))==  Unsloth: Conversion from HF to GGUF information
   \\   /|    [0] Installing llama.cpp might take 3 minutes.
O^O/ \_/ \    [1] Converting HF to GGUF bf16 might take 3 minutes.
\        /    [2] Converting GGUF bf16 to ['q4_0'] might take 10 minutes each.
 "-____-"     In total, you will have to wait at least 16 minutes.

Unsloth: Installing llama.cpp. This might take 3 minutes...
Unsloth: Installing prebuilt llama.cpp b9789-mix-1f1aaa4 (app-b9789-mix-1f1aaa4-linux-x64-cpu.tar.gz) - skipping compilation.
Unsloth: Preparing converter script...
Unsloth: [1] Converting model into bf16 GGUF format.
This might take 3 minutes...
Unsloth: Initial conversion completed! Files: ['gguf_out_gguf/LFM2.5-230M.BF16.gguf']
Unsloth: [2] Converting GGUF bf16 into q4_0. This might take 10 minutes...
Unsloth: Model files cleanup...
Unsloth: All GGUF conversions completed successfully!
Generated files: ['gguf_out_gguf/LFM2.5-230M.Q4_0.gguf']
Unsloth: No Ollama template mapping found for model 'unsloth/LFM2.5-230M'. Skipping Ollama Modelfile
Unsloth: example usage for text only LLMs: /root/.unsloth/llama.cpp/llama-cli --model gguf_out_gguf/LFM2.5-230M.Q4_0.gguf -p "why is the sky blue?"
[09:25:59] GGUF via llama.cpp convert_hf_to_gguf + quantize
Cloning into 'llama.cpp'...
ERROR: pip's dependency resolver does not currently take into account all the packages that are installed. This behaviour is the source of the following dependency conflicts.
torchvision 0.25.0 requires torch==2.10.0, but you have torch 2.11.0+cpu which is incompatible.
unsloth 2026.6.9 requires torch<2.11.0,>=2.4.0, but you have torch 2.11.0+cpu which is incompatible.
torchaudio 2.4.1+cu124 requires torch==2.4.1, but you have torch 2.11.0+cpu which is incompatible.
WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: https://pip.pypa.io/warnings/venv. Use the --root-user-action option if you know what you are doing and want to suppress this warning.

[notice] A new release of pip is available: 24.2 -> 26.1.2
[notice] To update, run: python -m pip install --upgrade pip
[09:26:57] llama.cpp gguf failed FileNotFoundError(2, 'No such file or directory')
[09:26:57] GGUF EXPORT FAILED — merged16 is on smjain/sap-archgen-lfm2-230M ; convert locally
[09:26:57] ALL DONE 5 / 6