[2026-01-04 14:18:26,717] - Setting up model... compile=True... [2026-01-04 14:18:41,883] - Replacing MTP head with MultiTokenHead( (_sum_weights_heads): ModuleList( (0-2): 3 x ExpanderHead( (head): LinearHead() ) ) (_categorical_log_probs_heads): ModuleList( (0): ExpanderHead( (head): LinearHead() ) ) ) from outputs/models/llama/no-lora/llama-lr-3e-4-no-lora-btree-n-8-r-32-s-1/model@900.pt... [2026-01-04 14:18:46,105] - Saving config and checkpoints to /disk/scratch/agrivas/nanoGPT/logs/2026-01-04/14-18-10... [2026-01-04 14:18:46,106] - Save model: True... [2026-01-04 14:18:46,106] - Save optimizer: True... [2026-01-04 14:18:46,114] - Training on agrv/tulu-v3-sft-llama3-packed-seq-len-8192... [2026-01-04 14:19:12,758] - Setting num_proc from 20 back to 1 for the valid split to disable multiprocessing as it only contains one shard. [2026-01-04 14:19:16,217] - step:0/900 Saving model to /disk/scratch/agrivas/nanoGPT/logs/2026-01-04/14-18-10/model@0.pt... [2026-01-04 14:22:58,683] - step:1/900 train_loss:0.9213 lr:0.0003000000 time/step:221.92s [2026-01-04 14:26:00,993] - step:2/900 train_loss:0.9337 lr:0.0003000000 time/step:182.31s [2026-01-04 14:29:02,831] - step:3/900 train_loss:0.9457 lr:0.0003000000 time/step:181.83s [2026-01-04 14:32:05,250] - step:4/900 train_loss:0.9294 lr:0.0003000000 time/step:182.41s [2026-01-04 14:35:07,167] - step:5/900 train_loss:0.9278 lr:0.0003000000 time/step:181.90s [2026-01-04 14:38:08,966] - step:6/900 train_loss:0.9520 lr:0.0003000000 time/step:181.79s [2026-01-04 14:41:12,085] - step:7/900 train_loss:0.9381 lr:0.0003000000 time/step:183.11s [2026-01-04 14:44:14,928] - step:8/900 train_loss:0.9323 lr:0.0003000000 time/step:182.82s [2026-01-04 14:47:16,012] - step:9/900 train_loss:0.9375 lr:0.0003000000 time/step:181.08s [2026-01-04 14:50:18,421] - step:10/900 train_loss:0.9322 lr:0.0003000000 time/step:182.41s [2026-01-04 14:53:19,274] - step:11/900 train_loss:0.9210 lr:0.0003000000 time/step:180.84s [2026-01-04 14:56:19,700] - step:12/900 train_loss:0.9390 lr:0.0003000000 time/step:180.42s [2026-01-04 14:59:20,972] - step:13/900 train_loss:0.9612 lr:0.0003000000 time/step:181.27s [2026-01-04 15:02:23,098] - step:14/900 train_loss:0.9348 lr:0.0003000000 time/step:182.12s [2026-01-04 15:05:24,977] - step:15/900 train_loss:0.9382 lr:0.0003000000 time/step:181.80s [2026-01-04 15:08:25,587] - step:16/900 train_loss:0.9396 lr:0.0003000000 time/step:180.60s [2026-01-04 15:11:26,714] - step:17/900 train_loss:0.9301 lr:0.0003000000 time/step:181.12s [2026-01-04 15:14:27,887] - step:18/900 train_loss:0.9093 lr:0.0003000000 time/step:181.16s [2026-01-04 15:17:28,786] - step:19/900 train_loss:0.9478 lr:0.0003000000 time/step:180.89s [2026-01-04 15:20:30,561] - step:20/900 train_loss:0.9643 lr:0.0003000000 time/step:181.77s [2026-01-04 15:23:32,690] - step:21/900 train_loss:0.9450 lr:0.0003000000 time/step:182.04s [2026-01-04 15:26:33,489] - step:22/900 train_loss:0.9138 lr:0.0003000000 time/step:180.79s [2026-01-04 15:29:33,650] - step:23/900 train_loss:0.9345 lr:0.0003000000 time/step:180.16s [2026-01-04 15:32:35,945] - step:24/900 train_loss:0.9305 lr:0.0003000000 time/step:182.29s [2026-01-04 15:35:39,783] - step:25/900 train_loss:0.9519 lr:0.0003000000 time/step:183.82s [2026-01-04 15:38:42,886] - step:26/900 train_loss:0.9290 lr:0.0003000000 time/step:183.09s [2026-01-04 15:41:45,359] - step:27/900 train_loss:0.9526 lr:0.0003000000 time/step:182.47s [2026-01-04 15:44:46,814] - step:28/900 train_loss:0.9168 lr:0.0003000000 time/step:181.44s [2026-01-04 15:47:47,913] - step:29/900 train_loss:0.9268 lr:0.0003000000 time/step:181.09s [2026-01-04 15:50:49,508] - step:30/900 train_loss:0.9171 lr:0.0003000000 time/step:181.59s [2026-01-04 15:53:53,333] - step:31/900 train_loss:0.9295 lr:0.0003000000 time/step:183.81s [2026-01-04 15:56:55,983] - step:32/900 train_loss:0.9521 lr:0.0003000000 time/step:182.65s [2026-01-04 15:59:57,623] - step:33/900 train_loss:0.9088 lr:0.0003000000 time/step:181.63s [2026-01-04 16:03:00,233] - step:34/900 train_loss:0.9386 lr:0.0003000000 time/step:182.61s [2026-01-04 16:06:03,056] - step:35/900 train_loss:0.9306 lr:0.0003000000 time/step:182.81s [2026-01-04 16:09:04,902] - step:36/900 train_loss:0.9494 lr:0.0003000000 time/step:181.84s [2026-01-04 16:12:06,840] - step:37/900 train_loss:0.9202 lr:0.0003000000 time/step:181.94s [2026-01-04 16:15:07,927] - step:38/900 train_loss:0.9474 lr:0.0003000000 time/step:181.07s [2026-01-04 16:18:08,594] - step:39/900 train_loss:0.9052 lr:0.0003000000 time/step:180.66s [2026-01-04 16:21:09,755] - step:40/900 train_loss:0.9366 lr:0.0003000000 time/step:181.16s [2026-01-04 16:24:10,905] - step:41/900 train_loss:0.9144 lr:0.0003000000 time/step:181.14s [2026-01-04 16:27:11,488] - step:42/900 train_loss:0.9315 lr:0.0003000000 time/step:180.58s [2026-01-04 16:30:12,005] - step:43/900 train_loss:0.9178 lr:0.0003000000 time/step:180.51s [2026-01-04 16:33:13,228] - step:44/900 train_loss:0.9202 lr:0.0003000000 time/step:181.22s [2026-01-04 16:36:15,060] - step:45/900 train_loss:0.9259 lr:0.0003000000 time/step:181.81s [2026-01-04 16:39:17,603] - step:46/900 train_loss:0.9349 lr:0.0003000000 time/step:182.54s [2026-01-04 16:42:18,342] - step:47/900 train_loss:0.9185 lr:0.0003000000 time/step:180.74s [2026-01-04 16:45:20,503] - step:48/900 train_loss:0.9460 lr:0.0003000000 time/step:182.16s [2026-01-04 16:48:22,250] - step:49/900 train_loss:0.9244 lr:0.0003000000 time/step:181.75s [2026-01-04 16:51:23,852] - step:50/900 train_loss:0.9298 lr:0.0003000000 time/step:181.60s [2026-01-04 16:54:26,865] - step:51/900 train_loss:0.9241 lr:0.0003000000 time/step:183.01s [2026-01-04 16:57:28,831] - step:52/900 train_loss:0.9135 lr:0.0003000000 time/step:181.95s [2026-01-04 17:00:31,045] - step:53/900 train_loss:0.9306 lr:0.0003000000 time/step:182.21s [2026-01-04 17:03:32,736] - step:54/900 train_loss:0.9264 lr:0.0003000000 time/step:181.69s [2026-01-04 17:06:35,345] - step:55/900 train_loss:0.9462 lr:0.0003000000 time/step:182.61s [2026-01-04 17:09:37,258] - step:56/900 train_loss:0.9503 lr:0.0003000000 time/step:181.91s [2026-01-04 17:12:39,001] - step:57/900 train_loss:0.9441 lr:0.0003000000 time/step:181.74s [2026-01-04 17:15:41,135] - step:58/900 train_loss:0.9311 lr:0.0003000000 time/step:182.13s [2026-01-04 17:18:43,413] - step:59/900 train_loss:0.9364 lr:0.0003000000 time/step:182.27s [2026-01-04 17:21:45,148] - step:60/900 train_loss:0.9412 lr:0.0003000000 time/step:181.73s [2026-01-04 17:24:47,243] - step:61/900 train_loss:0.9294 lr:0.0003000000 time/step:182.09s [2026-01-04 17:27:49,151] - step:62/900 train_loss:0.9323 lr:0.0003000000 time/step:181.89s [2026-01-04 17:30:51,496] - step:63/900 train_loss:0.9560 lr:0.0003000000 time/step:182.24s [2026-01-04 17:33:53,448] - step:64/900 train_loss:0.9253 lr:0.0003000000 time/step:181.95s [2026-01-04 17:36:55,865] - step:65/900 train_loss:0.9137 lr:0.0003000000 time/step:182.42s [2026-01-04 17:39:57,937] - step:66/900 train_loss:0.9478 lr:0.0003000000 time/step:182.07s [2026-01-04 17:42:59,754] - step:67/900 train_loss:0.9376 lr:0.0003000000 time/step:181.81s [2026-01-04 17:46:01,960] - step:68/900 train_loss:0.9556 lr:0.0003000000 time/step:182.18s [2026-01-04 17:49:04,406] - step:69/900 train_loss:0.9201 lr:0.0003000000 time/step:182.41s [2026-01-04 17:52:06,097] - step:70/900 train_loss:0.9248 lr:0.0003000000 time/step:181.68s [2026-01-04 17:55:07,942] - step:71/900 train_loss:0.9377 lr:0.0003000000 time/step:181.84s [2026-01-04 17:58:10,418] - step:72/900 train_loss:0.9139 lr:0.0003000000 time/step:182.46s [2026-01-04 18:01:12,249] - step:73/900 train_loss:0.9262 lr:0.0003000000 time/step:181.82s [2026-01-04 18:04:13,913] - step:74/900 train_loss:0.9206 lr:0.0003000000 time/step:181.66s [2026-01-04 18:07:15,992] - step:75/900 train_loss:0.9311 lr:0.0003000000 time/step:182.08s [2026-01-04 18:10:17,988] - step:76/900 train_loss:0.9440 lr:0.0003000000 time/step:181.99s [2026-01-04 18:13:19,880] - step:77/900 train_loss:0.9477 lr:0.0003000000 time/step:181.88s [2026-01-04 18:16:21,931] - step:78/900 train_loss:0.9121 lr:0.0003000000 time/step:182.05s [2026-01-04 18:19:24,273] - step:79/900 train_loss:0.9276 lr:0.0003000000 time/step:182.32s [2026-01-04 18:22:26,007] - step:80/900 train_loss:0.9106 lr:0.0003000000 time/step:181.73s [2026-01-04 18:25:28,028] - step:81/900 train_loss:0.9263 lr:0.0003000000 time/step:182.02s [2026-01-04 18:28:30,722] - step:82/900 train_loss:0.9166 lr:0.0003000000 time/step:182.66s [2026-01-04 18:31:32,656] - step:83/900 train_loss:0.9173 lr:0.0003000000 time/step:181.93s [2026-01-04 18:34:34,419] - step:84/900 train_loss:0.9099 lr:0.0003000000 time/step:181.76s [2026-01-04 18:37:36,991] - step:85/900 train_loss:0.9387 lr:0.0003000000 time/step:182.57s [2026-01-04 18:40:39,112] - step:86/900 train_loss:0.9511 lr:0.0003000000 time/step:182.10s [2026-01-04 18:43:40,911] - step:87/900 train_loss:0.9465 lr:0.0003000000 time/step:181.79s [2026-01-04 18:46:43,091] - step:88/900 train_loss:0.9358 lr:0.0003000000 time/step:182.18s [2026-01-04 18:49:45,090] - step:89/900 train_loss:0.9381 lr:0.0003000000 time/step:181.98s [2026-01-04 18:52:46,709] - step:90/900 train_loss:0.9305 lr:0.0003000000 time/step:181.61s [2026-01-04 18:55:49,078] - step:91/900 train_loss:0.9449 lr:0.0003000000 time/step:182.37s [2026-01-04 18:58:51,431] - step:92/900 train_loss:0.9229 lr:0.0003000000 time/step:182.32s [2026-01-04 19:01:53,445] - step:93/900 train_loss:0.9343 lr:0.0003000000 time/step:182.01s [2026-01-04 19:04:55,209] - step:94/900 train_loss:0.9282 lr:0.0003000000 time/step:181.76s [2026-01-04 19:07:57,509] - step:95/900 train_loss:0.9433 lr:0.0003000000 time/step:182.30s [2026-01-04 19:10:59,374] - step:96/900 train_loss:0.9167 lr:0.0003000000 time/step:181.86s [2026-01-04 19:14:01,273] - step:97/900 train_loss:0.9222 lr:0.0003000000 time/step:181.89s [2026-01-04 19:17:03,668] - step:98/900 train_loss:0.9161 lr:0.0003000000 time/step:182.39s [2026-01-04 19:20:06,070] - step:99/900 train_loss:0.9055 lr:0.0003000000 time/step:182.39s [2026-01-04 19:23:09,388] - step:100/900 Saved model to /disk/scratch/agrivas/nanoGPT/logs/2026-01-04/14-18-10/model@100.pt... [2026-01-04 19:23:09,389] - step:100/900 train_loss:0.9498 lr:0.0003000000 time/step:181.75s [2026-01-04 19:26:11,646] - step:101/900 train_loss:0.9501 lr:0.0003000000 time/step:182.25s [2026-01-04 19:29:14,107] - step:102/900 train_loss:0.9278 lr:0.0003000000 time/step:182.45s [2026-01-04 19:32:15,942] - step:103/900 train_loss:0.9265 lr:0.0003000000 time/step:181.83s [2026-01-04 19:35:17,615] - step:104/900 train_loss:0.9472 lr:0.0003000000 time/step:181.67s [2026-01-04 19:38:19,606] - step:105/900 train_loss:0.9364 lr:0.0003000000 time/step:181.99s [2026-01-04 19:41:21,988] - step:106/900 train_loss:0.9381 lr:0.0003000000 time/step:182.38s [2026-01-04 19:44:23,661] - step:107/900 train_loss:0.9364 lr:0.0003000000 time/step:181.67s [2026-01-04 19:47:25,347] - step:108/900 train_loss:0.8914 lr:0.0003000000 time/step:181.68s [2026-01-04 19:50:27,836] - step:109/900 train_loss:0.9485 lr:0.0003000000 time/step:182.48s [2026-01-04 19:53:29,454] - step:110/900 train_loss:0.9246 lr:0.0003000000 time/step:181.62s [2026-01-04 19:56:31,363] - step:111/900 train_loss:0.9277 lr:0.0003000000 time/step:181.91s [2026-01-04 19:59:33,638] - step:112/900 train_loss:0.9334 lr:0.0003000000 time/step:182.26s [2026-01-04 20:02:35,308] - step:113/900 train_loss:0.9466 lr:0.0003000000 time/step:181.66s [2026-01-04 20:05:36,779] - step:114/900 train_loss:0.9226 lr:0.0003000000 time/step:181.47s [2026-01-04 20:08:38,749] - step:115/900 train_loss:0.9124 lr:0.0003000000 time/step:181.97s [2026-01-04 20:11:40,985] - step:116/900 train_loss:0.9146 lr:0.0003000000 time/step:182.23s [2026-01-04 20:14:42,579] - step:117/900 train_loss:0.9350 lr:0.0003000000 time/step:181.59s [2026-01-04 20:17:44,753] - step:118/900 train_loss:0.9201 lr:0.0003000000 time/step:182.17s [2026-01-04 20:20:46,822] - step:119/900 train_loss:0.9357 lr:0.0003000000 time/step:182.06s [2026-01-04 20:23:48,469] - step:120/900 train_loss:0.9067 lr:0.0003000000 time/step:181.64s [2026-01-04 20:26:50,525] - step:121/900 train_loss:0.9153 lr:0.0003000000 time/step:182.05s [2026-01-04 20:29:52,531] - step:122/900 train_loss:0.9387 lr:0.0003000000 time/step:181.99s [2026-01-04 20:32:54,279] - step:123/900 train_loss:0.9192 lr:0.0003000000 time/step:181.74s [2026-01-04 20:35:56,085] - step:124/900 train_loss:0.9142 lr:0.0003000000 time/step:181.80s [2026-01-04 20:38:58,536] - step:125/900 train_loss:0.8904 lr:0.0003000000 time/step:182.45s [2026-01-04 20:42:00,211] - step:126/900 train_loss:0.9075 lr:0.0003000000 time/step:181.67s [2026-01-04 20:45:01,976] - step:127/900 train_loss:0.9545 lr:0.0003000000 time/step:181.76s [2026-01-04 20:48:04,322] - step:128/900 train_loss:0.9524 lr:0.0003000000 time/step:182.34s [2026-01-04 20:51:06,923] - step:129/900 train_loss:0.9383 lr:0.0003000000 time/step:182.58s [2026-01-04 20:54:08,611] - step:130/900 train_loss:0.9299 lr:0.0003000000 time/step:181.68s [2026-01-04 20:57:10,780] - step:131/900 train_loss:0.9381 lr:0.0003000000 time/step:182.17s [2026-01-04 21:00:13,211] - step:132/900 train_loss:0.9177 lr:0.0003000000 time/step:182.41s [2026-01-04 21:03:14,992] - step:133/900 train_loss:0.9090 lr:0.0003000000 time/step:181.77s [2026-01-04 21:06:16,670] - step:134/900 train_loss:0.8934 lr:0.0003000000 time/step:181.67s [2026-01-04 21:09:19,329] - step:135/900 train_loss:0.9121 lr:0.0003000000 time/step:182.66s [2026-01-04 21:12:21,077] - step:136/900 train_loss:0.9212 lr:0.0003000000 time/step:181.74s [2026-01-04 21:15:22,922] - step:137/900 train_loss:0.9360 lr:0.0003000000 time/step:181.84s [2026-01-04 21:18:25,018] - step:138/900 train_loss:0.9238 lr:0.0003000000 time/step:182.09s [2026-01-04 21:21:27,397] - step:139/900 train_loss:0.9195 lr:0.0003000000 time/step:182.37s [2026-01-04 21:24:29,252] - step:140/900 train_loss:0.9200 lr:0.0003000000 time/step:181.85s [2026-01-04 21:27:31,334] - step:141/900 train_loss:0.9421 lr:0.0003000000 time/step:182.08s [2026-01-04 21:30:33,216] - step:142/900 train_loss:0.9553 lr:0.0003000000 time/step:181.87s [2026-01-04 21:33:34,904] - step:143/900 train_loss:0.9180 lr:0.0003000000 time/step:181.68s [2026-01-04 21:36:36,696] - step:144/900 train_loss:0.9375 lr:0.0003000000 time/step:181.79s [2026-01-04 21:39:39,741] - step:145/900 train_loss:0.9419 lr:0.0003000000 time/step:183.04s [2026-01-04 21:42:41,545] - step:146/900 train_loss:0.9413 lr:0.0003000000 time/step:181.78s [2026-01-04 21:45:43,334] - step:147/900 train_loss:0.9455 lr:0.0003000000 time/step:181.79s [2026-01-04 21:48:45,405] - step:148/900 train_loss:0.9060 lr:0.0003000000 time/step:182.06s [2026-01-04 21:51:47,631] - step:149/900 train_loss:0.9470 lr:0.0003000000 time/step:182.22s [2026-01-04 21:54:49,246] - step:150/900 train_loss:0.8990 lr:0.0003000000 time/step:181.61s [2026-01-04 21:57:51,542] - step:151/900 train_loss:0.9449 lr:0.0003000000 time/step:182.29s [2026-01-04 22:00:53,996] - step:152/900 train_loss:0.9325 lr:0.0003000000 time/step:182.45s [2026-01-04 22:03:55,590] - step:153/900 train_loss:0.9305 lr:0.0003000000 time/step:181.59s [2026-01-04 22:06:57,072] - step:154/900 train_loss:0.9439 lr:0.0003000000 time/step:181.48s [2026-01-04 22:09:59,558] - step:155/900 train_loss:0.9252 lr:0.0003000000 time/step:182.48s [2026-01-04 22:13:01,201] - step:156/900 train_loss:0.9097 lr:0.0003000000 time/step:181.63s [2026-01-04 22:16:03,015] - step:157/900 train_loss:0.9166 lr:0.0003000000 time/step:181.81s [2026-01-04 22:19:04,929] - step:158/900 train_loss:0.9120 lr:0.0003000000 time/step:181.91s [2026-01-04 22:22:07,088] - step:159/900 train_loss:0.9257 lr:0.0003000000 time/step:182.15s [2026-01-04 22:25:09,035] - step:160/900 train_loss:0.9306 lr:0.0003000000 time/step:181.94s [2026-01-04 22:28:10,945] - step:161/900 train_loss:0.9350 lr:0.0003000000 time/step:181.91s [2026-01-04 22:31:13,074] - step:162/900 train_loss:0.9296 lr:0.0003000000 time/step:182.12s [2026-01-04 22:34:14,789] - step:163/900 train_loss:0.9272 lr:0.0003000000 time/step:181.70s [2026-01-04 22:37:16,469] - step:164/900 train_loss:0.9339 lr:0.0003000000 time/step:181.68s [2026-01-04 22:40:19,490] - step:165/900 train_loss:0.9280 lr:0.0003000000 time/step:183.02s [2026-01-04 22:43:21,215] - step:166/900 train_loss:0.9208 lr:0.0003000000 time/step:181.72s [2026-01-04 22:46:23,160] - step:167/900 train_loss:0.9180 lr:0.0003000000 time/step:181.94s [2026-01-04 22:49:25,449] - step:168/900 train_loss:0.9160 lr:0.0003000000 time/step:182.29s [2026-01-04 22:52:27,294] - step:169/900 train_loss:0.9184 lr:0.0003000000 time/step:181.84s [2026-01-04 22:55:28,714] - step:170/900 train_loss:0.9250 lr:0.0003000000 time/step:181.42s [2026-01-04 22:58:30,788] - step:171/900 train_loss:0.9154 lr:0.0003000000 time/step:182.07s [2026-01-04 23:01:32,886] - step:172/900 train_loss:0.9396 lr:0.0003000000 time/step:182.09s [2026-01-04 23:04:34,768] - step:173/900 train_loss:0.9232 lr:0.0003000000 time/step:181.88s [2026-01-04 23:07:36,435] - step:174/900 train_loss:0.9040 lr:0.0003000000 time/step:181.66s [2026-01-04 23:10:38,767] - step:175/900 train_loss:0.9004 lr:0.0003000000 time/step:182.33s [2026-01-04 23:13:40,403] - step:176/900 train_loss:0.9260 lr:0.0003000000 time/step:181.63s [2026-01-04 23:16:42,139] - step:177/900 train_loss:0.9151 lr:0.0003000000 time/step:181.73s [2026-01-04 23:19:44,133] - step:178/900 train_loss:0.9355 lr:0.0003000000 time/step:181.99s [2026-01-04 23:22:46,565] - step:179/900 train_loss:0.9184 lr:0.0003000000 time/step:182.42s [2026-01-04 23:25:48,494] - step:180/900 train_loss:0.9279 lr:0.0003000000 time/step:181.92s [2026-01-04 23:28:50,754] - step:181/900 train_loss:0.9203 lr:0.0003000000 time/step:182.26s [2026-01-04 23:31:53,153] - step:182/900 train_loss:0.8988 lr:0.0003000000 time/step:182.39s [2026-01-04 23:34:54,897] - step:183/900 train_loss:0.9068 lr:0.0003000000 time/step:181.74s [2026-01-04 23:37:56,601] - step:184/900 train_loss:0.9089 lr:0.0003000000 time/step:181.70s [2026-01-04 23:40:58,952] - step:185/900 train_loss:0.9283 lr:0.0003000000 time/step:182.35s [2026-01-04 23:44:00,665] - step:186/900 train_loss:0.9227 lr:0.0003000000 time/step:181.71s [2026-01-04 23:47:02,679] - step:187/900 train_loss:0.9194 lr:0.0003000000 time/step:182.01s [2026-01-04 23:50:05,198] - step:188/900 train_loss:0.9457 lr:0.0003000000 time/step:182.51s [2026-01-04 23:53:07,321] - step:189/900 train_loss:0.9314 lr:0.0003000000 time/step:182.11s [2026-01-04 23:56:08,913] - step:190/900 train_loss:0.9354 lr:0.0003000000 time/step:181.59s [2026-01-04 23:59:10,820] - step:191/900 train_loss:0.9617 lr:0.0003000000 time/step:181.90s [2026-01-05 00:02:13,227] - step:192/900 train_loss:0.9358 lr:0.0003000000 time/step:182.40s [2026-01-05 00:05:15,483] - step:193/900 train_loss:0.9310 lr:0.0003000000 time/step:182.24s [2026-01-05 00:08:17,063] - step:194/900 train_loss:0.9100 lr:0.0003000000 time/step:181.58s [2026-01-05 00:11:19,448] - step:195/900 train_loss:0.9195 lr:0.0003000000 time/step:182.38s [2026-01-05 00:14:21,517] - step:196/900 train_loss:0.9148 lr:0.0003000000 time/step:182.06s [2026-01-05 00:17:23,906] - step:197/900 train_loss:0.9051 lr:0.0003000000 time/step:182.38s [2026-01-05 00:20:26,177] - step:198/900 train_loss:0.9393 lr:0.0003000000 time/step:182.27s [2026-01-05 00:23:27,979] - step:199/900 train_loss:0.9058 lr:0.0003000000 time/step:181.80s [2026-01-05 00:26:31,981] - step:200/900 Saved model to /disk/scratch/agrivas/nanoGPT/logs/2026-01-04/14-18-10/model@200.pt... [2026-01-05 00:26:31,982] - step:200/900 train_loss:0.9218 lr:0.0003000000 time/step:182.24s [2026-01-05 00:29:33,743] - step:201/900 train_loss:0.9214 lr:0.0003000000 time/step:181.76s [2026-01-05 00:32:35,428] - step:202/900 train_loss:0.9179 lr:0.0003000000 time/step:181.68s [2026-01-05 00:35:37,540] - step:203/900 train_loss:0.8958 lr:0.0003000000 time/step:182.11s [2026-01-05 00:38:39,604] - step:204/900 train_loss:0.9373 lr:0.0003000000 time/step:182.06s [2026-01-05 00:41:41,318] - step:205/900 train_loss:0.9382 lr:0.0003000000 time/step:181.70s [2026-01-05 00:44:42,921] - step:206/900 train_loss:0.9011 lr:0.0003000000 time/step:181.60s [2026-01-05 00:47:45,167] - step:207/900 train_loss:0.9333 lr:0.0003000000 time/step:182.24s [2026-01-05 00:50:47,367] - step:208/900 train_loss:0.9224 lr:0.0003000000 time/step:182.19s [2026-01-05 00:53:49,161] - step:209/900 train_loss:0.8948 lr:0.0003000000 time/step:181.79s [2026-01-05 00:56:51,280] - step:210/900 train_loss:0.9057 lr:0.0003000000 time/step:182.11s [2026-01-05 00:59:53,574] - step:211/900 train_loss:0.9099 lr:0.0003000000 time/step:182.29s [2026-01-05 01:02:55,351] - step:212/900 train_loss:0.9290 lr:0.0003000000 time/step:181.77s [2026-01-05 01:05:57,768] - step:213/900 train_loss:0.9158 lr:0.0003000000 time/step:182.41s [2026-01-05 01:09:00,142] - step:214/900 train_loss:0.9170 lr:0.0003000000 time/step:182.36s [2026-01-05 01:12:02,103] - step:215/900 train_loss:0.9024 lr:0.0003000000 time/step:181.95s [2026-01-05 01:15:04,142] - step:216/900 train_loss:0.9074 lr:0.0003000000 time/step:182.04s [2026-01-05 01:18:06,668] - step:217/900 train_loss:0.9305 lr:0.0003000000 time/step:182.50s [2026-01-05 01:21:09,225] - step:218/900 train_loss:0.9013 lr:0.0003000000 time/step:182.55s [2026-01-05 01:24:11,471] - step:219/900 train_loss:0.9180 lr:0.0003000000 time/step:182.24s [2026-01-05 01:27:13,998] - step:220/900 train_loss:0.9170 lr:0.0003000000 time/step:182.52s [2026-01-05 01:30:16,175] - step:221/900 train_loss:0.9237 lr:0.0003000000 time/step:182.17s [2026-01-05 01:33:18,186] - step:222/900 train_loss:0.9276 lr:0.0003000000 time/step:181.96s [2026-01-05 01:36:20,377] - step:223/900 train_loss:0.9227 lr:0.0003000000 time/step:182.19s [2026-01-05 01:39:23,303] - step:224/900 train_loss:0.9320 lr:0.0003000000 time/step:182.92s [2026-01-05 01:42:25,299] - step:225/900 train_loss:0.9143 lr:0.0003000000 time/step:181.98s [2026-01-05 01:45:27,509] - step:226/900 train_loss:0.9105 lr:0.0003000000 time/step:182.21s [2026-01-05 01:48:29,536] - step:227/900 train_loss:0.9115 lr:0.0003000000 time/step:182.02s [2026-01-05 01:51:32,059] - step:228/900 train_loss:0.9273 lr:0.0003000000 time/step:182.52s [2026-01-05 01:54:34,058] - step:229/900 train_loss:0.8944 lr:0.0003000000 time/step:181.99s [2026-01-05 01:57:36,556] - step:230/900 train_loss:0.9150 lr:0.0003000000 time/step:182.49s [2026-01-05 02:00:39,012] - step:231/900 train_loss:0.9000 lr:0.0003000000 time/step:182.45s [2026-01-05 02:03:41,000] - step:232/900 train_loss:0.9134 lr:0.0003000000 time/step:181.97s [2026-01-05 02:06:42,891] - step:233/900 train_loss:0.9533 lr:0.0003000000 time/step:181.89s [2026-01-05 02:09:45,496] - step:234/900 train_loss:0.9104 lr:0.0003000000 time/step:182.60s [2026-01-05 02:12:47,682] - step:235/900 train_loss:0.9068 lr:0.0003000000 time/step:182.17s [2026-01-05 02:15:49,869] - step:236/900 train_loss:0.9007 lr:0.0003000000 time/step:182.18s [2026-01-05 02:18:52,149] - step:237/900 train_loss:0.9516 lr:0.0003000000 time/step:182.28s [2026-01-05 02:21:54,114] - step:238/900 train_loss:0.9192 lr:0.0003000000 time/step:181.96s [2026-01-05 02:24:55,896] - step:239/900 train_loss:0.9194 lr:0.0003000000 time/step:181.77s [2026-01-05 02:27:58,158] - step:240/900 train_loss:0.9192 lr:0.0003000000 time/step:182.26s [2026-01-05 02:30:59,967] - step:241/900 train_loss:0.9236 lr:0.0003000000 time/step:181.80s [2026-01-05 02:34:01,640] - step:242/900 train_loss:0.9385 lr:0.0003000000 time/step:181.67s [2026-01-05 02:37:04,084] - step:243/900 train_loss:0.9271 lr:0.0003000000 time/step:182.44s [2026-01-05 02:40:06,050] - step:244/900 train_loss:0.9010 lr:0.0003000000 time/step:181.96s [2026-01-05 02:43:07,837] - step:245/900 train_loss:0.9359 lr:0.0003000000 time/step:181.78s [2026-01-05 02:46:10,034] - step:246/900 train_loss:0.9098 lr:0.0003000000 time/step:182.19s [2026-01-05 02:49:11,918] - step:247/900 train_loss:0.9094 lr:0.0003000000 time/step:181.88s [2026-01-05 02:52:13,582] - step:248/900 train_loss:0.9176 lr:0.0003000000 time/step:181.65s [2026-01-05 02:55:15,102] - step:249/900 train_loss:0.9259 lr:0.0003000000 time/step:181.52s [2026-01-05 02:58:16,900] - step:250/900 train_loss:0.9342 lr:0.0003000000 time/step:181.80s [2026-01-05 03:01:18,720] - step:251/900 train_loss:0.9096 lr:0.0003000000 time/step:181.82s [2026-01-05 03:04:20,137] - step:252/900 train_loss:0.9268 lr:0.0003000000 time/step:181.41s [2026-01-05 03:07:22,432] - step:253/900 train_loss:0.9095 lr:0.0003000000 time/step:182.29s [2026-01-05 03:10:24,312] - step:254/900 train_loss:0.8972 lr:0.0003000000 time/step:181.88s [2026-01-05 03:13:25,962] - step:255/900 train_loss:0.8929 lr:0.0003000000 time/step:181.64s [2026-01-05 03:16:27,631] - step:256/900 train_loss:0.9323 lr:0.0003000000 time/step:181.66s [2026-01-05 03:19:29,474] - step:257/900 train_loss:0.9237 lr:0.0003000000 time/step:181.83s [2026-01-05 03:22:31,221] - step:258/900 train_loss:0.9519 lr:0.0003000000 time/step:181.73s [2026-01-05 03:25:33,059] - step:259/900 train_loss:0.9175 lr:0.0003000000 time/step:181.83s [2026-01-05 03:28:35,315] - step:260/900 train_loss:0.8953 lr:0.0003000000 time/step:182.25s [2026-01-05 03:31:37,484] - step:261/900 train_loss:0.9070 lr:0.0003000000 time/step:182.17s [2026-01-05 03:34:39,159] - step:262/900 train_loss:0.9197 lr:0.0003000000 time/step:181.67s [2026-01-05 03:37:41,276] - step:263/900 train_loss:0.9199 lr:0.0003000000 time/step:182.11s [2026-01-05 03:40:43,792] - step:264/900 train_loss:0.9368 lr:0.0003000000 time/step:182.51s [2026-01-05 03:43:45,948] - step:265/900 train_loss:0.9167 lr:0.0003000000 time/step:182.14s [2026-01-05 03:46:48,179] - step:266/900 train_loss:0.9296 lr:0.0003000000 time/step:182.23s [2026-01-05 03:49:50,567] - step:267/900 train_loss:0.9257 lr:0.0003000000 time/step:182.38s [2026-01-05 03:52:52,598] - step:268/900 train_loss:0.9148 lr:0.0003000000 time/step:182.02s [2026-01-05 03:55:54,568] - step:269/900 train_loss:0.9356 lr:0.0003000000 time/step:181.97s [2026-01-05 03:58:57,164] - step:270/900 train_loss:0.8731 lr:0.0003000000 time/step:182.59s [2026-01-05 04:01:59,338] - step:271/900 train_loss:0.9218 lr:0.0003000000 time/step:182.17s [2026-01-05 04:05:01,198] - step:272/900 train_loss:0.9186 lr:0.0003000000 time/step:181.85s [2026-01-05 04:08:03,434] - step:273/900 train_loss:0.9270 lr:0.0003000000 time/step:182.23s [2026-01-05 04:11:05,289] - step:274/900 train_loss:0.8768 lr:0.0003000000 time/step:181.85s [2026-01-05 04:14:07,189] - step:275/900 train_loss:0.8999 lr:0.0003000000 time/step:181.86s [2026-01-05 04:17:09,234] - step:276/900 train_loss:0.9231 lr:0.0003000000 time/step:182.04s [2026-01-05 04:20:11,485] - step:277/900 train_loss:0.9085 lr:0.0003000000 time/step:182.25s [2026-01-05 04:23:13,251] - step:278/900 train_loss:0.9230 lr:0.0003000000 time/step:181.75s [2026-01-05 04:26:15,218] - step:279/900 train_loss:0.9185 lr:0.0003000000 time/step:181.96s [2026-01-05 04:29:17,261] - step:280/900 train_loss:0.9110 lr:0.0003000000 time/step:182.03s [2026-01-05 04:32:19,548] - step:281/900 train_loss:0.9110 lr:0.0003000000 time/step:182.28s [2026-01-05 04:35:21,220] - step:282/900 train_loss:0.9475 lr:0.0003000000 time/step:181.66s [2026-01-05 04:38:23,667] - step:283/900 train_loss:0.9231 lr:0.0003000000 time/step:182.44s [2026-01-05 04:41:25,940] - step:284/900 train_loss:0.9295 lr:0.0003000000 time/step:182.27s [2026-01-05 04:44:27,716] - step:285/900 train_loss:0.9225 lr:0.0003000000 time/step:181.77s [2026-01-05 04:47:29,965] - step:286/900 train_loss:0.9269 lr:0.0003000000 time/step:182.24s [2026-01-05 04:50:31,538] - step:287/900 train_loss:0.9252 lr:0.0003000000 time/step:181.57s [2026-01-05 04:53:33,313] - step:288/900 train_loss:0.9043 lr:0.0003000000 time/step:181.76s [2026-01-05 04:56:35,505] - step:289/900 train_loss:0.9144 lr:0.0003000000 time/step:182.18s [2026-01-05 04:59:37,369] - step:290/900 train_loss:0.9256 lr:0.0003000000 time/step:181.86s [2026-01-05 05:02:39,537] - step:291/900 train_loss:0.9181 lr:0.0003000000 time/step:182.16s [2026-01-05 05:05:41,242] - step:292/900 train_loss:0.8934 lr:0.0003000000 time/step:181.70s [2026-01-05 05:08:43,871] - step:293/900 train_loss:0.9293 lr:0.0003000000 time/step:182.63s [2026-01-05 05:11:45,599] - step:294/900 train_loss:0.9286 lr:0.0003000000 time/step:181.72s [2026-01-05 05:14:47,527] - step:295/900 train_loss:0.9350 lr:0.0003000000 time/step:181.92s [2026-01-05 05:17:49,781] - step:296/900 train_loss:0.9168 lr:0.0003000000 time/step:182.25s [2026-01-05 05:20:51,953] - step:297/900 train_loss:0.8868 lr:0.0003000000 time/step:182.16s [2026-01-05 05:23:53,724] - step:298/900 train_loss:0.9347 lr:0.0003000000 time/step:181.76s [2026-01-05 05:26:55,834] - step:299/900 train_loss:0.9176 lr:0.0003000000 time/step:182.10s [2026-01-05 05:29:59,095] - step:300/900 Saved model to /disk/scratch/agrivas/nanoGPT/logs/2026-01-04/14-18-10/model@300.pt... [2026-01-05 05:29:59,096] - step:300/900 train_loss:0.9262 lr:0.0003000000 time/step:181.69s [2026-01-05 05:33:01,164] - step:301/900 train_loss:0.9223 lr:0.0003000000 time/step:182.06s [2026-01-05 05:36:02,816] - step:302/900 train_loss:0.9110 lr:0.0003000000 time/step:181.65s [2026-01-05 05:39:05,313] - step:303/900 train_loss:0.9070 lr:0.0003000000 time/step:182.49s [2026-01-05 05:42:07,441] - step:304/900 train_loss:0.9424 lr:0.0003000000 time/step:182.12s [2026-01-05 05:45:09,127] - step:305/900 train_loss:0.9181 lr:0.0003000000 time/step:181.68s [2026-01-05 05:48:11,248] - step:306/900 train_loss:0.9227 lr:0.0003000000 time/step:182.11s [2026-01-05 05:51:13,512] - step:307/900 train_loss:0.8989 lr:0.0003000000 time/step:182.26s [2026-01-05 05:54:15,328] - step:308/900 train_loss:0.9146 lr:0.0003000000 time/step:181.81s [2026-01-05 05:57:17,326] - step:309/900 train_loss:0.9139 lr:0.0003000000 time/step:181.99s [2026-01-05 06:00:19,178] - step:310/900 train_loss:0.9060 lr:0.0003000000 time/step:181.84s [2026-01-05 06:03:21,086] - step:311/900 train_loss:0.8878 lr:0.0003000000 time/step:181.90s [2026-01-05 06:06:22,943] - step:312/900 train_loss:0.8993 lr:0.0003000000 time/step:181.85s [2026-01-05 06:09:25,029] - step:313/900 train_loss:0.8925 lr:0.0003000000 time/step:182.08s [2026-01-05 06:12:27,142] - step:314/900 train_loss:0.9206 lr:0.0003000000 time/step:182.11s [2026-01-05 06:15:29,059] - step:315/900 train_loss:0.9055 lr:0.0003000000 time/step:181.90s [2026-01-05 06:18:31,365] - step:316/900 train_loss:0.9034 lr:0.0003000000 time/step:182.30s [2026-01-05 06:21:33,521] - step:317/900 train_loss:0.9104 lr:0.0003000000 time/step:182.15s [2026-01-05 06:24:35,586] - step:318/900 train_loss:0.9136 lr:0.0003000000 time/step:182.05s [2026-01-05 06:27:37,513] - step:319/900 train_loss:0.9156 lr:0.0003000000 time/step:181.92s [2026-01-05 06:30:39,352] - step:320/900 train_loss:0.9292 lr:0.0003000000 time/step:181.83s [2026-01-05 06:33:41,525] - step:321/900 train_loss:0.9403 lr:0.0003000000 time/step:182.17s [2026-01-05 06:36:43,578] - step:322/900 train_loss:0.9148 lr:0.0003000000 time/step:182.04s [2026-01-05 06:39:45,772] - step:323/900 train_loss:0.9162 lr:0.0003000000 time/step:182.19s [2026-01-05 06:42:48,062] - step:324/900 train_loss:0.9199 lr:0.0003000000 time/step:182.28s [2026-01-05 06:45:49,900] - step:325/900 train_loss:0.9023 lr:0.0003000000 time/step:181.83s [2026-01-05 06:48:52,418] - step:326/900 train_loss:0.9283 lr:0.0003000000 time/step:182.51s [2026-01-05 06:51:54,593] - step:327/900 train_loss:0.9086 lr:0.0003000000 time/step:182.17s [2026-01-05 06:54:56,608] - step:328/900 train_loss:0.8994 lr:0.0003000000 time/step:182.00s [2026-01-05 06:57:59,009] - step:329/900 train_loss:0.9151 lr:0.0003000000 time/step:182.40s [2026-01-05 07:01:00,609] - step:330/900 train_loss:0.9388 lr:0.0003000000 time/step:181.60s [2026-01-05 07:04:02,330] - step:331/900 train_loss:0.9216 lr:0.0003000000 time/step:181.71s [2026-01-05 07:07:04,436] - step:332/900 train_loss:0.9100 lr:0.0003000000 time/step:182.10s [2026-01-05 07:10:06,601] - step:333/900 train_loss:0.9305 lr:0.0003000000 time/step:182.16s [2026-01-05 07:13:08,731] - step:334/900 train_loss:0.9260 lr:0.0003000000 time/step:182.13s [2026-01-05 07:16:10,509] - step:335/900 train_loss:0.9183 lr:0.0003000000 time/step:181.77s [2026-01-05 07:19:12,490] - step:336/900 train_loss:0.8932 lr:0.0003000000 time/step:181.98s [2026-01-05 07:22:14,615] - step:337/900 train_loss:0.9339 lr:0.0003000000 time/step:182.12s [2026-01-05 07:25:16,325] - step:338/900 train_loss:0.9062 lr:0.0003000000 time/step:181.70s [2026-01-05 07:28:18,526] - step:339/900 train_loss:0.8974 lr:0.0003000000 time/step:182.19s [2026-01-05 07:31:20,215] - step:340/900 train_loss:0.9108 lr:0.0003000000 time/step:181.68s [2026-01-05 07:34:22,313] - step:341/900 train_loss:0.9188 lr:0.0003000000 time/step:182.09s [2026-01-05 07:37:24,009] - step:342/900 train_loss:0.9201 lr:0.0003000000 time/step:181.69s [2026-01-05 07:40:26,417] - step:343/900 train_loss:0.9153 lr:0.0003000000 time/step:182.40s [2026-01-05 07:43:28,389] - step:344/900 train_loss:0.9054 lr:0.0003000000 time/step:181.97s [2026-01-05 07:46:29,879] - step:345/900 train_loss:0.9091 lr:0.0003000000 time/step:181.48s [2026-01-05 07:49:32,161] - step:346/900 train_loss:0.9049 lr:0.0003000000 time/step:182.28s [2026-01-05 07:52:33,831] - step:347/900 train_loss:0.9232 lr:0.0003000000 time/step:181.67s [2026-01-05 07:55:35,481] - step:348/900 train_loss:0.9162 lr:0.0003000000 time/step:181.63s [2026-01-05 07:58:37,516] - step:349/900 train_loss:0.9221 lr:0.0003000000 time/step:182.03s [2026-01-05 08:01:40,153] - step:350/900 train_loss:0.8989 lr:0.0003000000 time/step:182.63s [2026-01-05 08:04:41,875] - step:351/900 train_loss:0.9065 lr:0.0003000000 time/step:181.71s [2026-01-05 08:07:43,892] - step:352/900 train_loss:0.9219 lr:0.0003000000 time/step:182.01s [2026-01-05 08:10:45,598] - step:353/900 train_loss:0.8866 lr:0.0003000000 time/step:181.69s [2026-01-05 08:13:47,481] - step:354/900 train_loss:0.9200 lr:0.0003000000 time/step:181.88s [2026-01-05 08:16:49,160] - step:355/900 train_loss:0.9146 lr:0.0003000000 time/step:181.67s [2026-01-05 08:19:51,266] - step:356/900 train_loss:0.8879 lr:0.0003000000 time/step:182.10s [2026-01-05 08:22:53,356] - step:357/900 train_loss:0.9088 lr:0.0003000000 time/step:182.08s [2026-01-05 08:25:55,071] - step:358/900 train_loss:0.9391 lr:0.0003000000 time/step:181.69s [2026-01-05 08:28:57,330] - step:359/900 train_loss:0.9193 lr:0.0003000000 time/step:182.25s [2026-01-05 08:31:59,576] - step:360/900 train_loss:0.9210 lr:0.0003000000 time/step:182.24s [2026-01-05 08:35:01,353] - step:361/900 train_loss:0.8881 lr:0.0003000000 time/step:181.76s [2026-01-05 08:38:03,461] - step:362/900 train_loss:0.9015 lr:0.0003000000 time/step:182.10s [2026-01-05 08:41:05,379] - step:363/900 train_loss:0.9092 lr:0.0003000000 time/step:181.91s [2026-01-05 08:44:07,765] - step:364/900 train_loss:0.9153 lr:0.0003000000 time/step:182.38s [2026-01-05 08:47:09,756] - step:365/900 train_loss:0.9290 lr:0.0003000000 time/step:181.97s [2026-01-05 08:50:11,862] - step:366/900 train_loss:0.8886 lr:0.0003000000 time/step:182.10s [2026-01-05 08:53:14,167] - step:367/900 train_loss:0.9139 lr:0.0003000000 time/step:182.29s [2026-01-05 08:56:16,084] - step:368/900 train_loss:0.9308 lr:0.0003000000 time/step:181.89s [2026-01-05 08:59:18,082] - step:369/900 train_loss:0.9068 lr:0.0003000000 time/step:181.99s [2026-01-05 09:02:19,991] - step:370/900 train_loss:0.9062 lr:0.0003000000 time/step:181.91s [2026-01-05 09:05:22,142] - step:371/900 train_loss:0.9139 lr:0.0003000000 time/step:182.14s [2026-01-05 09:08:24,118] - step:372/900 train_loss:0.8938 lr:0.0003000000 time/step:181.97s [2026-01-05 09:11:25,933] - step:373/900 train_loss:0.9169 lr:0.0003000000 time/step:181.81s [2026-01-05 09:14:28,459] - step:374/900 train_loss:0.9144 lr:0.0003000000 time/step:182.52s [2026-01-05 09:17:30,209] - step:375/900 train_loss:0.9181 lr:0.0003000000 time/step:181.74s [2026-01-05 09:20:32,556] - step:376/900 train_loss:0.8998 lr:0.0003000000 time/step:182.34s [2026-01-05 09:23:34,467] - step:377/900 train_loss:0.8993 lr:0.0003000000 time/step:181.91s [2026-01-05 09:26:36,048] - step:378/900 train_loss:0.9119 lr:0.0003000000 time/step:181.57s [2026-01-05 09:29:38,065] - step:379/900 train_loss:0.8898 lr:0.0003000000 time/step:182.01s [2026-01-05 09:32:39,536] - step:380/900 train_loss:0.9234 lr:0.0003000000 time/step:181.47s [2026-01-05 09:35:41,361] - step:381/900 train_loss:0.9112 lr:0.0003000000 time/step:181.82s [2026-01-05 09:38:43,037] - step:382/900 train_loss:0.9172 lr:0.0003000000 time/step:181.67s [2026-01-05 09:41:45,241] - step:383/900 train_loss:0.9255 lr:0.0003000000 time/step:182.20s [2026-01-05 09:44:46,998] - step:384/900 train_loss:0.9248 lr:0.0003000000 time/step:181.75s [2026-01-05 09:47:48,601] - step:385/900 train_loss:0.8976 lr:0.0003000000 time/step:181.59s [2026-01-05 09:50:50,703] - step:386/900 train_loss:0.8996 lr:0.0003000000 time/step:182.10s [2026-01-05 09:53:52,562] - step:387/900 train_loss:0.9281 lr:0.0003000000 time/step:181.85s [2026-01-05 09:56:54,217] - step:388/900 train_loss:0.9033 lr:0.0003000000 time/step:181.64s [2026-01-05 09:59:56,498] - step:389/900 train_loss:0.9299 lr:0.0003000000 time/step:182.28s [2026-01-05 10:02:58,105] - step:390/900 train_loss:0.9247 lr:0.0003000000 time/step:181.60s [2026-01-05 10:06:00,075] - step:391/900 train_loss:0.9200 lr:0.0003000000 time/step:181.95s [2026-01-05 10:09:01,699] - step:392/900 train_loss:0.8996 lr:0.0003000000 time/step:181.61s [2026-01-05 10:12:03,730] - step:393/900 train_loss:0.9066 lr:0.0003000000 time/step:182.03s [2026-01-05 10:15:05,355] - step:394/900 train_loss:0.9157 lr:0.0003000000 time/step:181.62s [2026-01-05 10:18:07,178] - step:395/900 train_loss:0.9145 lr:0.0003000000 time/step:181.77s [2026-01-05 10:21:09,382] - step:396/900 train_loss:0.9193 lr:0.0003000000 time/step:182.20s [2026-01-05 10:24:10,977] - step:397/900 train_loss:0.9070 lr:0.0003000000 time/step:181.59s [2026-01-05 10:27:12,610] - step:398/900 train_loss:0.9206 lr:0.0003000000 time/step:181.62s [2026-01-05 10:30:15,295] - step:399/900 train_loss:0.8945 lr:0.0003000000 time/step:182.68s [2026-01-05 10:33:18,547] - step:400/900 Saved model to /disk/scratch/agrivas/nanoGPT/logs/2026-01-04/14-18-10/model@400.pt... [2026-01-05 10:33:18,551] - step:400/900 train_loss:0.9316 lr:0.0003000000 time/step:181.71s [2026-01-05 10:36:20,213] - step:401/900 train_loss:0.9242 lr:0.0003000000 time/step:181.65s [2026-01-05 10:39:22,060] - step:402/900 train_loss:0.8867 lr:0.0003000000 time/step:181.84s [2026-01-05 10:42:24,570] - step:403/900 train_loss:0.8847 lr:0.0003000000 time/step:182.51s [2026-01-05 10:45:26,352] - step:404/900 train_loss:0.9081 lr:0.0003000000 time/step:181.77s [2026-01-05 10:48:28,078] - step:405/900 train_loss:0.9269 lr:0.0003000000 time/step:181.72s [2026-01-05 10:51:30,936] - step:406/900 train_loss:0.9052 lr:0.0003000000 time/step:182.85s [2026-01-05 10:54:33,061] - step:407/900 train_loss:0.9211 lr:0.0003000000 time/step:182.12s [2026-01-05 10:57:34,829] - step:408/900 train_loss:0.9106 lr:0.0003000000 time/step:181.75s [2026-01-05 11:00:36,459] - step:409/900 train_loss:0.9075 lr:0.0003000000 time/step:181.63s [2026-01-05 11:03:38,967] - step:410/900 train_loss:0.8768 lr:0.0003000000 time/step:182.50s [2026-01-05 11:06:40,873] - step:411/900 train_loss:0.8889 lr:0.0003000000 time/step:181.89s [2026-01-05 11:09:42,703] - step:412/900 train_loss:0.9226 lr:0.0003000000 time/step:181.83s [2026-01-05 11:12:45,188] - step:413/900 train_loss:0.9095 lr:0.0003000000 time/step:182.48s [2026-01-05 11:15:47,090] - step:414/900 train_loss:0.9097 lr:0.0003000000 time/step:181.89s [2026-01-05 11:18:49,243] - step:415/900 train_loss:0.9136 lr:0.0003000000 time/step:182.14s [2026-01-05 11:21:50,806] - step:416/900 train_loss:0.9225 lr:0.0003000000 time/step:181.56s [2026-01-05 11:24:53,229] - step:417/900 train_loss:0.9034 lr:0.0003000000 time/step:182.42s [2026-01-05 11:27:54,997] - step:418/900 train_loss:0.9139 lr:0.0003000000 time/step:181.76s [2026-01-05 11:30:56,706] - step:419/900 train_loss:0.9030 lr:0.0003000000 time/step:181.71s [2026-01-05 11:33:59,245] - step:420/900 train_loss:0.9213 lr:0.0003000000 time/step:182.53s [2026-01-05 11:37:01,136] - step:421/900 train_loss:0.9292 lr:0.0003000000 time/step:181.88s [2026-01-05 11:40:02,833] - step:422/900 train_loss:0.9034 lr:0.0003000000 time/step:181.69s [2026-01-05 11:43:05,322] - step:423/900 train_loss:0.9282 lr:0.0003000000 time/step:182.49s [2026-01-05 11:46:07,355] - step:424/900 train_loss:0.9220 lr:0.0003000000 time/step:182.02s [2026-01-05 11:49:09,103] - step:425/900 train_loss:0.9003 lr:0.0003000000 time/step:181.74s [2026-01-05 11:52:10,844] - step:426/900 train_loss:0.8698 lr:0.0003000000 time/step:181.74s [2026-01-05 11:55:13,494] - step:427/900 train_loss:0.9129 lr:0.0003000000 time/step:182.65s [2026-01-05 11:58:15,176] - step:428/900 train_loss:0.9251 lr:0.0003000000 time/step:181.63s [2026-01-05 12:01:16,829] - step:429/900 train_loss:0.8870 lr:0.0003000000 time/step:181.65s [2026-01-05 12:04:19,276] - step:430/900 train_loss:0.9287 lr:0.0003000000 time/step:182.44s [2026-01-05 12:07:20,952] - step:431/900 train_loss:0.9075 lr:0.0003000000 time/step:181.67s [2026-01-05 12:10:22,609] - step:432/900 train_loss:0.8986 lr:0.0003000000 time/step:181.65s [2026-01-05 12:13:25,072] - step:433/900 train_loss:0.9034 lr:0.0003000000 time/step:182.46s [2026-01-05 12:16:26,792] - step:434/900 train_loss:0.9112 lr:0.0003000000 time/step:181.70s [2026-01-05 12:19:28,632] - step:435/900 train_loss:0.9057 lr:0.0003000000 time/step:181.84s [2026-01-05 12:22:30,629] - step:436/900 train_loss:0.9112 lr:0.0003000000 time/step:181.99s [2026-01-05 12:25:32,946] - step:437/900 train_loss:0.8942 lr:0.0003000000 time/step:182.31s [2026-01-05 12:28:34,542] - step:438/900 train_loss:0.9247 lr:0.0003000000 time/step:181.59s [2026-01-05 12:31:36,568] - step:439/900 train_loss:0.9060 lr:0.0003000000 time/step:182.02s [2026-01-05 12:34:38,722] - step:440/900 train_loss:0.9016 lr:0.0003000000 time/step:182.15s [2026-01-05 12:37:40,435] - step:441/900 train_loss:0.9058 lr:0.0003000000 time/step:181.69s [2026-01-05 12:40:42,003] - step:442/900 train_loss:0.9207 lr:0.0003000000 time/step:181.56s [2026-01-05 12:43:44,507] - step:443/900 train_loss:0.9037 lr:0.0003000000 time/step:182.50s [2026-01-05 12:46:46,382] - step:444/900 train_loss:0.9129 lr:0.0003000000 time/step:181.86s [2026-01-05 12:49:48,168] - step:445/900 train_loss:0.9039 lr:0.0003000000 time/step:181.78s [2026-01-05 12:52:50,693] - step:446/900 train_loss:0.9206 lr:0.0003000000 time/step:182.52s [2026-01-05 12:55:52,622] - step:447/900 train_loss:0.8926 lr:0.0003000000 time/step:181.88s [2026-01-05 12:58:54,218] - step:448/900 train_loss:0.9260 lr:0.0003000000 time/step:181.59s [2026-01-05 13:01:56,606] - step:449/900 train_loss:0.8968 lr:0.0003000000 time/step:182.38s [2026-01-05 13:04:58,920] - step:450/900 train_loss:0.9100 lr:0.0003000000 time/step:182.31s [2026-01-05 13:08:00,820] - step:451/900 train_loss:0.9185 lr:0.0003000000 time/step:181.88s [2026-01-05 13:11:02,501] - step:452/900 train_loss:0.9356 lr:0.0003000000 time/step:181.68s [2026-01-05 13:14:04,767] - step:453/900 train_loss:0.9002 lr:0.0003000000 time/step:182.26s [2026-01-05 13:17:06,632] - step:454/900 train_loss:0.9245 lr:0.0003000000 time/step:181.86s [2026-01-05 13:20:08,358] - step:455/900 train_loss:0.9088 lr:0.0003000000 time/step:181.72s [2026-01-05 13:23:11,000] - step:456/900 train_loss:0.9403 lr:0.0003000000 time/step:182.64s [2026-01-05 13:26:12,934] - step:457/900 train_loss:0.9052 lr:0.0003000000 time/step:181.92s [2026-01-05 13:29:14,883] - step:458/900 train_loss:0.8935 lr:0.0003000000 time/step:181.95s [2026-01-05 13:32:17,026] - step:459/900 train_loss:0.9516 lr:0.0003000000 time/step:182.14s [2026-01-05 13:35:19,299] - step:460/900 train_loss:0.9252 lr:0.0003000000 time/step:182.27s [2026-01-05 13:38:21,239] - step:461/900 train_loss:0.8942 lr:0.0003000000 time/step:181.93s [2026-01-05 13:41:23,169] - step:462/900 train_loss:0.8966 lr:0.0003000000 time/step:181.92s [2026-01-05 13:44:25,535] - step:463/900 train_loss:0.9235 lr:0.0003000000 time/step:182.36s [2026-01-05 13:47:27,482] - step:464/900 train_loss:0.9167 lr:0.0003000000 time/step:181.94s [2026-01-05 13:50:29,613] - step:465/900 train_loss:0.9176 lr:0.0003000000 time/step:182.13s [2026-01-05 13:53:31,832] - step:466/900 train_loss:0.9091 lr:0.0003000000 time/step:182.22s [2026-01-05 13:56:33,633] - step:467/900 train_loss:0.9114 lr:0.0003000000 time/step:181.79s [2026-01-05 13:59:35,580] - step:468/900 train_loss:0.8970 lr:0.0003000000 time/step:181.94s [2026-01-05 14:02:37,583] - step:469/900 train_loss:0.9022 lr:0.0003000000 time/step:182.00s [2026-01-05 14:05:39,284] - step:470/900 train_loss:0.9143 lr:0.0003000000 time/step:181.70s [2026-01-05 14:08:41,007] - step:471/900 train_loss:0.9062 lr:0.0003000000 time/step:181.72s [2026-01-05 14:11:43,250] - step:472/900 train_loss:0.8963 lr:0.0003000000 time/step:182.24s [2026-01-05 14:14:45,300] - step:473/900 train_loss:0.9213 lr:0.0003000000 time/step:182.04s [2026-01-05 14:17:46,917] - step:474/900 train_loss:0.8935 lr:0.0003000000 time/step:181.59s [2026-01-05 14:20:48,997] - step:475/900 train_loss:0.8986 lr:0.0003000000 time/step:182.07s [2026-01-05 14:23:51,508] - step:476/900 train_loss:0.9017 lr:0.0003000000 time/step:182.50s [2026-01-05 14:26:53,449] - step:477/900 train_loss:0.9152 lr:0.0003000000 time/step:181.93s [2026-01-05 14:29:55,210] - step:478/900 train_loss:0.8831 lr:0.0003000000 time/step:181.76s [2026-01-05 14:32:57,251] - step:479/900 train_loss:0.8975 lr:0.0003000000 time/step:182.04s [2026-01-05 14:35:59,231] - step:480/900 train_loss:0.9144 lr:0.0003000000 time/step:181.98s [2026-01-05 14:39:01,029] - step:481/900 train_loss:0.8867 lr:0.0003000000 time/step:181.79s [2026-01-05 14:42:03,090] - step:482/900 train_loss:0.9015 lr:0.0003000000 time/step:182.05s [2026-01-05 14:45:05,252] - step:483/900 train_loss:0.9367 lr:0.0003000000 time/step:182.15s [2026-01-05 14:48:07,105] - step:484/900 train_loss:0.9313 lr:0.0003000000 time/step:181.84s [2026-01-05 14:51:09,143] - step:485/900 train_loss:0.9083 lr:0.0003000000 time/step:182.03s [2026-01-05 14:54:11,548] - step:486/900 train_loss:0.8916 lr:0.0003000000 time/step:182.40s [2026-01-05 14:57:13,298] - step:487/900 train_loss:0.8951 lr:0.0003000000 time/step:181.73s [2026-01-05 15:00:15,464] - step:488/900 train_loss:0.9039 lr:0.0003000000 time/step:182.16s [2026-01-05 15:03:17,477] - step:489/900 train_loss:0.8814 lr:0.0003000000 time/step:182.01s [2026-01-05 15:06:19,847] - step:490/900 train_loss:0.8814 lr:0.0003000000 time/step:182.36s [2026-01-05 15:09:21,641] - step:491/900 train_loss:0.9271 lr:0.0003000000 time/step:181.78s [2026-01-05 15:12:24,356] - step:492/900 train_loss:0.9246 lr:0.0003000000 time/step:182.71s [2026-01-05 15:15:26,666] - step:493/900 train_loss:0.9146 lr:0.0003000000 time/step:182.29s [2026-01-05 15:18:28,497] - step:494/900 train_loss:0.9022 lr:0.0003000000 time/step:181.82s [2026-01-05 15:21:30,326] - step:495/900 train_loss:0.9135 lr:0.0003000000 time/step:181.82s [2026-01-05 15:24:32,965] - step:496/900 train_loss:0.9035 lr:0.0003000000 time/step:182.64s [2026-01-05 15:27:34,886] - step:497/900 train_loss:0.8987 lr:0.0003000000 time/step:181.91s [2026-01-05 15:30:36,607] - step:498/900 train_loss:0.9204 lr:0.0003000000 time/step:181.71s [2026-01-05 15:33:39,051] - step:499/900 train_loss:0.8937 lr:0.0003000000 time/step:182.43s [2026-01-05 15:36:42,403] - step:500/900 Saved model to /disk/scratch/agrivas/nanoGPT/logs/2026-01-04/14-18-10/model@500.pt... [2026-01-05 15:36:42,407] - step:500/900 train_loss:0.9206 lr:0.0003000000 time/step:181.82s [2026-01-05 15:39:44,387] - step:501/900 train_loss:0.9116 lr:0.0003000000 time/step:181.97s [2026-01-05 15:42:46,534] - step:502/900 train_loss:0.9171 lr:0.0003000000 time/step:182.14s [2026-01-05 15:45:48,730] - step:503/900 train_loss:0.8909 lr:0.0003000000 time/step:182.19s [2026-01-05 15:48:50,495] - step:504/900 train_loss:0.9118 lr:0.0003000000 time/step:181.76s [2026-01-05 15:51:52,337] - step:505/900 train_loss:0.8902 lr:0.0003000000 time/step:181.84s [2026-01-05 15:54:54,990] - step:506/900 train_loss:0.9178 lr:0.0003000000 time/step:182.65s [2026-01-05 15:57:56,794] - step:507/900 train_loss:0.9014 lr:0.0003000000 time/step:181.80s [2026-01-05 16:00:58,452] - step:508/900 train_loss:0.9058 lr:0.0003000000 time/step:181.65s [2026-01-05 16:04:01,361] - step:509/900 train_loss:0.9000 lr:0.0003000000 time/step:182.90s [2026-01-05 16:07:03,047] - step:510/900 train_loss:0.9027 lr:0.0003000000 time/step:181.67s [2026-01-05 16:10:04,580] - step:511/900 train_loss:0.8890 lr:0.0003000000 time/step:181.52s [2026-01-05 16:13:06,751] - step:512/900 train_loss:0.9050 lr:0.0003000000 time/step:182.17s [2026-01-05 16:16:08,802] - step:513/900 train_loss:0.9286 lr:0.0003000000 time/step:182.04s [2026-01-05 16:19:10,418] - step:514/900 train_loss:0.8816 lr:0.0003000000 time/step:181.61s [2026-01-05 16:22:12,248] - step:515/900 train_loss:0.9233 lr:0.0003000000 time/step:181.82s [2026-01-05 16:25:14,898] - step:516/900 train_loss:0.9135 lr:0.0003000000 time/step:182.65s [2026-01-05 16:28:16,683] - step:517/900 train_loss:0.9219 lr:0.0003000000 time/step:181.75s [2026-01-05 16:31:18,573] - step:518/900 train_loss:0.9031 lr:0.0003000000 time/step:181.88s [2026-01-05 16:34:20,801] - step:519/900 train_loss:0.8909 lr:0.0003000000 time/step:182.22s [2026-01-05 16:37:22,771] - step:520/900 train_loss:0.8844 lr:0.0003000000 time/step:181.96s [2026-01-05 16:40:24,437] - step:521/900 train_loss:0.8991 lr:0.0003000000 time/step:181.66s [2026-01-05 16:43:26,308] - step:522/900 train_loss:0.8919 lr:0.0003000000 time/step:181.87s [2026-01-05 16:46:28,657] - step:523/900 train_loss:0.9059 lr:0.0003000000 time/step:182.34s [2026-01-05 16:49:30,903] - step:524/900 train_loss:0.9145 lr:0.0003000000 time/step:182.24s [2026-01-05 16:52:32,919] - step:525/900 train_loss:0.9043 lr:0.0003000000 time/step:182.01s [2026-01-05 16:55:35,153] - step:526/900 train_loss:0.9009 lr:0.0003000000 time/step:182.23s [2026-01-05 16:58:37,092] - step:527/900 train_loss:0.9042 lr:0.0003000000 time/step:181.92s [2026-01-05 17:01:38,965] - step:528/900 train_loss:0.9041 lr:0.0003000000 time/step:181.87s [2026-01-05 17:04:41,034] - step:529/900 train_loss:0.9180 lr:0.0003000000 time/step:182.06s [2026-01-05 17:07:43,234] - step:530/900 train_loss:0.9116 lr:0.0003000000 time/step:182.15s [2026-01-05 17:10:45,236] - step:531/900 train_loss:0.8919 lr:0.0003000000 time/step:181.99s [2026-01-05 17:13:48,004] - step:532/900 train_loss:0.9075 lr:0.0003000000 time/step:182.76s [2026-01-05 17:16:50,662] - step:533/900 train_loss:0.9138 lr:0.0003000000 time/step:182.65s [2026-01-05 17:19:52,352] - step:534/900 train_loss:0.9096 lr:0.0003000000 time/step:181.68s [2026-01-05 17:22:54,482] - step:535/900 train_loss:0.9274 lr:0.0003000000 time/step:182.12s [2026-01-05 17:25:56,474] - step:536/900 train_loss:0.9036 lr:0.0003000000 time/step:181.99s [2026-01-05 17:28:57,960] - step:537/900 train_loss:0.9074 lr:0.0003000000 time/step:181.47s [2026-01-05 17:32:00,064] - step:538/900 train_loss:0.9156 lr:0.0003000000 time/step:182.10s [2026-01-05 17:35:02,095] - step:539/900 train_loss:0.8988 lr:0.0003000000 time/step:182.02s [2026-01-05 17:38:04,142] - step:540/900 train_loss:0.8972 lr:0.0003000000 time/step:182.03s [2026-01-05 17:41:06,127] - step:541/900 train_loss:0.8966 lr:0.0003000000 time/step:181.98s [2026-01-05 17:44:08,984] - step:542/900 train_loss:0.9039 lr:0.0003000000 time/step:182.85s [2026-01-05 17:47:10,988] - step:543/900 train_loss:0.9012 lr:0.0003000000 time/step:181.99s [2026-01-05 17:50:12,487] - step:544/900 train_loss:0.9191 lr:0.0003000000 time/step:181.48s [2026-01-05 17:53:14,384] - step:545/900 train_loss:0.9038 lr:0.0003000000 time/step:181.89s [2026-01-05 17:56:16,036] - step:546/900 train_loss:0.9098 lr:0.0003000000 time/step:181.64s [2026-01-05 17:59:17,935] - step:547/900 train_loss:0.9147 lr:0.0003000000 time/step:181.89s [2026-01-05 18:02:19,403] - step:548/900 train_loss:0.8646 lr:0.0003000000 time/step:181.46s [2026-01-05 18:05:21,198] - step:549/900 train_loss:0.9017 lr:0.0003000000 time/step:181.79s [2026-01-05 18:08:23,124] - step:550/900 train_loss:0.9153 lr:0.0003000000 time/step:181.91s [2026-01-05 18:11:25,165] - step:551/900 train_loss:0.9172 lr:0.0003000000 time/step:182.04s [2026-01-05 18:14:27,971] - step:552/900 train_loss:0.8941 lr:0.0003000000 time/step:182.80s [2026-01-05 18:17:29,695] - step:553/900 train_loss:0.8951 lr:0.0003000000 time/step:181.71s [2026-01-05 18:20:31,349] - step:554/900 train_loss:0.9111 lr:0.0003000000 time/step:181.65s [2026-01-05 18:23:34,010] - step:555/900 train_loss:0.9174 lr:0.0003000000 time/step:182.65s [2026-01-05 18:26:35,334] - step:556/900 train_loss:0.8994 lr:0.0003000000 time/step:181.32s [2026-01-05 18:29:36,850] - step:557/900 train_loss:0.9104 lr:0.0003000000 time/step:181.51s [2026-01-05 18:32:38,986] - step:558/900 train_loss:0.8963 lr:0.0003000000 time/step:182.13s [2026-01-05 18:35:40,758] - step:559/900 train_loss:0.9191 lr:0.0003000000 time/step:181.76s [2026-01-05 18:38:41,876] - step:560/900 train_loss:0.9169 lr:0.0003000000 time/step:181.10s [2026-01-05 18:41:43,516] - step:561/900 train_loss:0.8987 lr:0.0003000000 time/step:181.64s [2026-01-05 18:44:45,507] - step:562/900 train_loss:0.8972 lr:0.0003000000 time/step:181.98s [2026-01-05 18:47:47,101] - step:563/900 train_loss:0.8874 lr:0.0003000000 time/step:181.58s [2026-01-05 18:50:48,592] - step:564/900 train_loss:0.9158 lr:0.0003000000 time/step:181.48s [2026-01-05 18:53:50,780] - step:565/900 train_loss:0.9094 lr:0.0003000000 time/step:182.18s [2026-01-05 18:56:52,832] - step:566/900 train_loss:0.9071 lr:0.0003000000 time/step:182.05s [2026-01-05 18:59:55,089] - step:567/900 train_loss:0.9113 lr:0.0003000000 time/step:182.21s [2026-01-05 19:02:57,437] - step:568/900 train_loss:0.9163 lr:0.0003000000 time/step:182.34s [2026-01-05 19:05:59,137] - step:569/900 train_loss:0.8899 lr:0.0003000000 time/step:181.69s [2026-01-05 19:09:00,874] - step:570/900 train_loss:0.9011 lr:0.0003000000 time/step:181.72s [2026-01-05 19:12:02,885] - step:571/900 train_loss:0.8973 lr:0.0003000000 time/step:181.99s [2026-01-05 19:15:05,260] - step:572/900 train_loss:0.8982 lr:0.0003000000 time/step:182.37s [2026-01-05 19:18:07,080] - step:573/900 train_loss:0.8825 lr:0.0003000000 time/step:181.82s [2026-01-05 19:21:09,003] - step:574/900 train_loss:0.8959 lr:0.0003000000 time/step:181.91s [2026-01-05 19:24:10,931] - step:575/900 train_loss:0.8931 lr:0.0003000000 time/step:181.92s [2026-01-05 19:27:13,030] - step:576/900 train_loss:0.8970 lr:0.0003000000 time/step:182.09s [2026-01-05 19:30:15,422] - step:577/900 train_loss:0.8997 lr:0.0003000000 time/step:182.38s [2026-01-05 19:33:16,907] - step:578/900 train_loss:0.9040 lr:0.0003000000 time/step:181.47s [2026-01-05 19:36:18,877] - step:579/900 train_loss:0.8915 lr:0.0003000000 time/step:181.97s [2026-01-05 19:39:21,079] - step:580/900 train_loss:0.9100 lr:0.0003000000 time/step:182.19s [2026-01-05 19:42:22,922] - step:581/900 train_loss:0.9079 lr:0.0003000000 time/step:181.84s [2026-01-05 19:45:25,131] - step:582/900 train_loss:0.9119 lr:0.0003000000 time/step:182.20s [2026-01-05 19:48:26,608] - step:583/900 train_loss:0.8977 lr:0.0003000000 time/step:181.47s [2026-01-05 19:51:28,798] - step:584/900 train_loss:0.9002 lr:0.0003000000 time/step:182.18s [2026-01-05 19:54:30,989] - step:585/900 train_loss:0.8961 lr:0.0003000000 time/step:182.18s [2026-01-05 19:57:32,652] - step:586/900 train_loss:0.9077 lr:0.0003000000 time/step:181.66s [2026-01-05 20:00:34,827] - step:587/900 train_loss:0.9079 lr:0.0003000000 time/step:182.16s [2026-01-05 20:03:37,624] - step:588/900 train_loss:0.9004 lr:0.0003000000 time/step:182.78s [2026-01-05 20:06:39,816] - step:589/900 train_loss:0.9102 lr:0.0003000000 time/step:182.18s [2026-01-05 20:09:41,161] - step:590/900 train_loss:0.8955 lr:0.0003000000 time/step:181.34s [2026-01-05 20:12:43,278] - step:591/900 train_loss:0.8929 lr:0.0003000000 time/step:182.11s [2026-01-05 20:15:45,728] - step:592/900 train_loss:0.9134 lr:0.0003000000 time/step:182.44s [2026-01-05 20:18:47,343] - step:593/900 train_loss:0.8979 lr:0.0003000000 time/step:181.60s [2026-01-05 20:21:49,644] - step:594/900 train_loss:0.9077 lr:0.0003000000 time/step:182.29s [2026-01-05 20:24:51,685] - step:595/900 train_loss:0.8882 lr:0.0003000000 time/step:182.03s [2026-01-05 20:27:53,704] - step:596/900 train_loss:0.9024 lr:0.0003000000 time/step:182.01s [2026-01-05 20:30:55,885] - step:597/900 train_loss:0.9004 lr:0.0003000000 time/step:182.17s [2026-01-05 20:33:58,283] - step:598/900 train_loss:0.9166 lr:0.0003000000 time/step:182.39s [2026-01-05 20:36:59,697] - step:599/900 train_loss:0.8950 lr:0.0003000000 time/step:181.41s [2026-01-05 20:40:02,454] - step:600/900 Saved model to /disk/scratch/agrivas/nanoGPT/logs/2026-01-04/14-18-10/model@600.pt... [2026-01-05 20:40:02,455] - step:600/900 train_loss:0.8834 lr:0.0003000000 time/step:181.23s [2026-01-05 20:43:04,811] - step:601/900 train_loss:0.8833 lr:0.0003000000 time/step:182.32s [2026-01-05 20:46:07,118] - step:602/900 train_loss:0.8687 lr:0.0003000000 time/step:182.28s [2026-01-05 20:49:09,335] - step:603/900 train_loss:0.8963 lr:0.0003000000 time/step:182.20s [2026-01-05 20:52:11,216] - step:604/900 train_loss:0.8902 lr:0.0003000000 time/step:181.87s [2026-01-05 20:55:13,421] - step:605/900 train_loss:0.9046 lr:0.0003000000 time/step:182.20s [2026-01-05 20:58:15,441] - step:606/900 train_loss:0.8871 lr:0.0003000000 time/step:182.01s [2026-01-05 21:01:17,589] - step:607/900 train_loss:0.8899 lr:0.0003000000 time/step:182.14s [2026-01-05 21:04:19,723] - step:608/900 train_loss:0.8997 lr:0.0003000000 time/step:182.12s [2026-01-05 21:07:21,688] - step:609/900 train_loss:0.8990 lr:0.0003000000 time/step:181.96s [2026-01-05 21:10:23,577] - step:610/900 train_loss:0.8898 lr:0.0003000000 time/step:181.87s [2026-01-05 21:13:25,408] - step:611/900 train_loss:0.9090 lr:0.0003000000 time/step:181.83s [2026-01-05 21:16:27,534] - step:612/900 train_loss:0.9021 lr:0.0003000000 time/step:182.12s [2026-01-05 21:19:29,023] - step:613/900 train_loss:0.8954 lr:0.0003000000 time/step:181.47s [2026-01-05 21:22:31,011] - step:614/900 train_loss:0.8838 lr:0.0003000000 time/step:181.98s [2026-01-05 21:25:33,228] - step:615/900 train_loss:0.9134 lr:0.0003000000 time/step:182.21s [2026-01-05 21:28:35,031] - step:616/900 train_loss:0.8964 lr:0.0003000000 time/step:181.80s [2026-01-05 21:31:37,563] - step:617/900 train_loss:0.9137 lr:0.0003000000 time/step:182.52s [2026-01-05 21:34:39,901] - step:618/900 train_loss:0.8939 lr:0.0003000000 time/step:182.32s [2026-01-05 21:37:41,711] - step:619/900 train_loss:0.9003 lr:0.0003000000 time/step:181.80s [2026-01-05 21:40:43,342] - step:620/900 train_loss:0.9024 lr:0.0003000000 time/step:181.62s [2026-01-05 21:43:45,564] - step:621/900 train_loss:0.9206 lr:0.0003000000 time/step:182.21s [2026-01-05 21:46:47,941] - step:622/900 train_loss:0.8938 lr:0.0003000000 time/step:182.37s [2026-01-05 21:49:49,930] - step:623/900 train_loss:0.9094 lr:0.0003000000 time/step:181.98s [2026-01-05 21:52:52,124] - step:624/900 train_loss:0.8897 lr:0.0003000000 time/step:182.19s [2026-01-05 21:55:54,848] - step:625/900 train_loss:0.8970 lr:0.0003000000 time/step:182.72s [2026-01-05 21:58:57,031] - step:626/900 train_loss:0.8957 lr:0.0003000000 time/step:182.17s [2026-01-05 22:01:59,031] - step:627/900 train_loss:0.9133 lr:0.0003000000 time/step:181.99s [2026-01-05 22:05:01,230] - step:628/900 train_loss:0.8971 lr:0.0003000000 time/step:182.19s [2026-01-05 22:08:03,188] - step:629/900 train_loss:0.8848 lr:0.0003000000 time/step:181.95s [2026-01-05 22:11:05,099] - step:630/900 train_loss:0.9172 lr:0.0003000000 time/step:181.89s [2026-01-05 22:14:07,461] - step:631/900 train_loss:0.9052 lr:0.0003000000 time/step:182.36s [2026-01-05 22:17:09,929] - step:632/900 train_loss:0.9010 lr:0.0003000000 time/step:182.46s [2026-01-05 22:20:11,512] - step:633/900 train_loss:0.8981 lr:0.0003000000 time/step:181.57s [2026-01-05 22:23:13,585] - step:634/900 train_loss:0.9090 lr:0.0003000000 time/step:182.07s [2026-01-05 22:26:16,197] - step:635/900 train_loss:0.8768 lr:0.0003000000 time/step:182.60s [2026-01-05 22:29:18,350] - step:636/900 train_loss:0.9276 lr:0.0003000000 time/step:182.14s [2026-01-05 22:32:20,729] - step:637/900 train_loss:0.8973 lr:0.0003000000 time/step:182.37s [2026-01-05 22:35:23,317] - step:638/900 train_loss:0.9058 lr:0.0003000000 time/step:182.58s [2026-01-05 22:38:25,665] - step:639/900 train_loss:0.8829 lr:0.0003000000 time/step:182.34s [2026-01-05 22:41:28,220] - step:640/900 train_loss:0.8753 lr:0.0003000000 time/step:182.55s [2026-01-05 22:44:30,416] - step:641/900 train_loss:0.8928 lr:0.0003000000 time/step:182.19s [2026-01-05 22:47:33,024] - step:642/900 train_loss:0.9244 lr:0.0003000000 time/step:182.60s [2026-01-05 22:50:34,932] - step:643/900 train_loss:0.9010 lr:0.0003000000 time/step:181.90s [2026-01-05 22:53:37,245] - step:644/900 train_loss:0.8879 lr:0.0003000000 time/step:182.31s [2026-01-05 22:56:40,022] - step:645/900 train_loss:0.8859 lr:0.0003000000 time/step:182.77s [2026-01-05 22:59:41,919] - step:646/900 train_loss:0.8925 lr:0.0003000000 time/step:181.89s [2026-01-05 23:02:43,640] - step:647/900 train_loss:0.8882 lr:0.0003000000 time/step:181.71s [2026-01-05 23:05:45,916] - step:648/900 train_loss:0.9080 lr:0.0003000000 time/step:182.27s [2026-01-05 23:08:48,030] - step:649/900 train_loss:0.9422 lr:0.0003000000 time/step:182.11s [2026-01-05 23:11:50,187] - step:650/900 train_loss:0.8984 lr:0.0003000000 time/step:182.15s [2026-01-05 23:14:51,885] - step:651/900 train_loss:0.9005 lr:0.0003000000 time/step:181.69s [2026-01-05 23:17:54,051] - step:652/900 train_loss:0.8959 lr:0.0003000000 time/step:182.16s [2026-01-05 23:20:55,880] - step:653/900 train_loss:0.9060 lr:0.0003000000 time/step:181.78s [2026-01-05 23:23:58,068] - step:654/900 train_loss:0.8898 lr:0.0003000000 time/step:182.18s [2026-01-05 23:27:00,419] - step:655/900 train_loss:0.8849 lr:0.0003000000 time/step:182.35s [2026-01-05 23:30:02,341] - step:656/900 train_loss:0.8941 lr:0.0003000000 time/step:181.92s [2026-01-05 23:33:04,705] - step:657/900 train_loss:0.8876 lr:0.0003000000 time/step:182.35s [2026-01-05 23:36:07,262] - step:658/900 train_loss:0.9116 lr:0.0003000000 time/step:182.55s [2026-01-05 23:39:09,387] - step:659/900 train_loss:0.9062 lr:0.0003000000 time/step:182.12s [2026-01-05 23:42:11,750] - step:660/900 train_loss:0.8932 lr:0.0003000000 time/step:182.35s [2026-01-05 23:45:13,367] - step:661/900 train_loss:0.8827 lr:0.0003000000 time/step:181.61s [2026-01-05 23:48:15,939] - step:662/900 train_loss:0.8795 lr:0.0003000000 time/step:182.57s [2026-01-05 23:51:18,203] - step:663/900 train_loss:0.8975 lr:0.0003000000 time/step:182.21s [2026-01-05 23:54:20,649] - step:664/900 train_loss:0.8840 lr:0.0003000000 time/step:182.44s [2026-01-05 23:57:22,877] - step:665/900 train_loss:0.9035 lr:0.0003000000 time/step:182.22s [2026-01-06 00:00:24,179] - step:666/900 train_loss:0.9092 lr:0.0003000000 time/step:181.30s [2026-01-06 00:03:26,405] - step:667/900 train_loss:0.9125 lr:0.0003000000 time/step:182.22s [2026-01-06 00:06:29,279] - step:668/900 train_loss:0.8784 lr:0.0003000000 time/step:182.87s [2026-01-06 00:09:31,107] - step:669/900 train_loss:0.8932 lr:0.0003000000 time/step:181.82s [2026-01-06 00:12:33,209] - step:670/900 train_loss:0.9172 lr:0.0003000000 time/step:182.09s [2026-01-06 00:15:35,358] - step:671/900 train_loss:0.9019 lr:0.0003000000 time/step:182.14s [2026-01-06 00:18:36,833] - step:672/900 train_loss:0.9032 lr:0.0003000000 time/step:181.47s [2026-01-06 00:21:38,622] - step:673/900 train_loss:0.8914 lr:0.0003000000 time/step:181.77s [2026-01-06 00:24:40,848] - step:674/900 train_loss:0.8991 lr:0.0003000000 time/step:182.22s [2026-01-06 00:27:42,755] - step:675/900 train_loss:0.9016 lr:0.0003000000 time/step:181.90s [2026-01-06 00:30:44,923] - step:676/900 train_loss:0.8836 lr:0.0003000000 time/step:182.16s [2026-01-06 00:33:47,696] - step:677/900 train_loss:0.8887 lr:0.0003000000 time/step:182.76s [2026-01-06 00:36:49,548] - step:678/900 train_loss:0.8755 lr:0.0003000000 time/step:181.84s [2026-01-06 00:39:51,656] - step:679/900 train_loss:0.8907 lr:0.0003000000 time/step:182.10s [2026-01-06 00:42:54,078] - step:680/900 train_loss:0.8953 lr:0.0003000000 time/step:182.41s [2026-01-06 00:45:56,166] - step:681/900 train_loss:0.9117 lr:0.0003000000 time/step:182.08s [2026-01-06 00:48:57,931] - step:682/900 train_loss:0.8947 lr:0.0003000000 time/step:181.76s [2026-01-06 00:51:59,871] - step:683/900 train_loss:0.9191 lr:0.0003000000 time/step:181.93s [2026-01-06 00:55:01,930] - step:684/900 train_loss:0.8921 lr:0.0003000000 time/step:182.05s [2026-01-06 00:58:03,860] - step:685/900 train_loss:0.9070 lr:0.0003000000 time/step:181.92s [2026-01-06 01:01:05,532] - step:686/900 train_loss:0.8861 lr:0.0003000000 time/step:181.66s [2026-01-06 01:04:07,854] - step:687/900 train_loss:0.8969 lr:0.0003000000 time/step:182.31s [2026-01-06 01:07:09,998] - step:688/900 train_loss:0.9050 lr:0.0003000000 time/step:182.13s [2026-01-06 01:10:11,914] - step:689/900 train_loss:0.8980 lr:0.0003000000 time/step:181.91s [2026-01-06 01:13:14,158] - step:690/900 train_loss:0.8979 lr:0.0003000000 time/step:182.24s [2026-01-06 01:16:16,402] - step:691/900 train_loss:0.8810 lr:0.0003000000 time/step:182.24s [2026-01-06 01:19:18,387] - step:692/900 train_loss:0.8962 lr:0.0003000000 time/step:181.98s [2026-01-06 01:22:20,141] - step:693/900 train_loss:0.8759 lr:0.0003000000 time/step:181.75s [2026-01-06 01:25:21,865] - step:694/900 train_loss:0.9082 lr:0.0003000000 time/step:181.72s [2026-01-06 01:28:24,280] - step:695/900 train_loss:0.8702 lr:0.0003000000 time/step:182.40s [2026-01-06 01:31:26,465] - step:696/900 train_loss:0.9017 lr:0.0003000000 time/step:182.17s [2026-01-06 01:34:28,289] - step:697/900 train_loss:0.8604 lr:0.0003000000 time/step:181.82s [2026-01-06 01:37:30,507] - step:698/900 train_loss:0.8951 lr:0.0003000000 time/step:182.21s [2026-01-06 01:40:32,444] - step:699/900 train_loss:0.9005 lr:0.0003000000 time/step:181.93s [2026-01-06 01:43:36,150] - step:700/900 Saved model to /disk/scratch/agrivas/nanoGPT/logs/2026-01-04/14-18-10/model@700.pt... [2026-01-06 01:43:36,152] - step:700/900 train_loss:0.8927 lr:0.0003000000 time/step:182.18s [2026-01-06 01:46:38,437] - step:701/900 train_loss:0.8995 lr:0.0003000000 time/step:182.28s [2026-01-06 01:49:40,288] - step:702/900 train_loss:0.9090 lr:0.0003000000 time/step:181.83s [2026-01-06 01:52:42,062] - step:703/900 train_loss:0.8803 lr:0.0003000000 time/step:181.76s [2026-01-06 01:55:43,858] - step:704/900 train_loss:0.9323 lr:0.0003000000 time/step:181.77s [2026-01-06 01:58:46,059] - step:705/900 train_loss:0.8839 lr:0.0003000000 time/step:182.20s [2026-01-06 02:01:47,990] - step:706/900 train_loss:0.9119 lr:0.0003000000 time/step:181.93s [2026-01-06 02:04:50,281] - step:707/900 train_loss:0.8844 lr:0.0003000000 time/step:182.28s [2026-01-06 02:07:52,395] - step:708/900 train_loss:0.8963 lr:0.0003000000 time/step:182.11s [2026-01-06 02:10:54,343] - step:709/900 train_loss:0.8935 lr:0.0003000000 time/step:181.94s [2026-01-06 02:13:56,250] - step:710/900 train_loss:0.9127 lr:0.0003000000 time/step:181.90s [2026-01-06 02:16:58,490] - step:711/900 train_loss:0.9061 lr:0.0003000000 time/step:182.23s [2026-01-06 02:20:00,393] - step:712/900 train_loss:0.9204 lr:0.0003000000 time/step:181.89s [2026-01-06 02:23:02,948] - step:713/900 train_loss:0.8832 lr:0.0003000000 time/step:182.54s [2026-01-06 02:26:04,964] - step:714/900 train_loss:0.8830 lr:0.0003000000 time/step:182.01s [2026-01-06 02:29:07,410] - step:715/900 train_loss:0.8939 lr:0.0003000000 time/step:182.44s [2026-01-06 02:32:09,307] - step:716/900 train_loss:0.8987 lr:0.0003000000 time/step:181.88s [2026-01-06 02:35:11,862] - step:717/900 train_loss:0.8814 lr:0.0003000000 time/step:182.55s [2026-01-06 02:38:14,284] - step:718/900 train_loss:0.8909 lr:0.0003000000 time/step:182.42s [2026-01-06 02:41:16,155] - step:719/900 train_loss:0.9042 lr:0.0003000000 time/step:181.87s [2026-01-06 02:44:18,354] - step:720/900 train_loss:0.8960 lr:0.0003000000 time/step:182.18s [2026-01-06 02:47:20,517] - step:721/900 train_loss:0.9080 lr:0.0003000000 time/step:182.15s [2026-01-06 02:50:22,056] - step:722/900 train_loss:0.9020 lr:0.0003000000 time/step:181.53s [2026-01-06 02:53:24,437] - step:723/900 train_loss:0.9034 lr:0.0003000000 time/step:182.37s [2026-01-06 02:56:26,533] - step:724/900 train_loss:0.9063 lr:0.0003000000 time/step:182.09s [2026-01-06 02:59:28,835] - step:725/900 train_loss:0.8967 lr:0.0003000000 time/step:182.30s [2026-01-06 03:02:30,159] - step:726/900 train_loss:0.9098 lr:0.0003000000 time/step:181.31s [2026-01-06 03:05:32,519] - step:727/900 train_loss:0.9041 lr:0.0003000000 time/step:182.35s [2026-01-06 03:08:35,116] - step:728/900 train_loss:0.9301 lr:0.0003000000 time/step:182.59s [2026-01-06 03:11:37,079] - step:729/900 train_loss:0.8783 lr:0.0003000000 time/step:181.96s [2026-01-06 03:14:39,647] - step:730/900 train_loss:0.8957 lr:0.0003000000 time/step:182.55s [2026-01-06 03:17:41,892] - step:731/900 train_loss:0.8907 lr:0.0003000000 time/step:182.24s [2026-01-06 03:20:43,906] - step:732/900 train_loss:0.8907 lr:0.0003000000 time/step:182.01s [2026-01-06 03:23:45,420] - step:733/900 train_loss:0.9035 lr:0.0003000000 time/step:181.50s [2026-01-06 03:26:47,153] - step:734/900 train_loss:0.8955 lr:0.0003000000 time/step:181.73s [2026-01-06 03:29:49,375] - step:735/900 train_loss:0.8897 lr:0.0003000000 time/step:182.22s [2026-01-06 03:32:51,143] - step:736/900 train_loss:0.9005 lr:0.0003000000 time/step:181.75s [2026-01-06 03:35:53,850] - step:737/900 train_loss:0.8983 lr:0.0003000000 time/step:182.70s [2026-01-06 03:38:56,042] - step:738/900 train_loss:0.9043 lr:0.0003000000 time/step:182.18s [2026-01-06 03:41:58,351] - step:739/900 train_loss:0.9037 lr:0.0003000000 time/step:182.30s [2026-01-06 03:45:00,729] - step:740/900 train_loss:0.8778 lr:0.0003000000 time/step:182.35s [2026-01-06 03:48:02,703] - step:741/900 train_loss:0.8988 lr:0.0003000000 time/step:181.97s [2026-01-06 03:51:04,772] - step:742/900 train_loss:0.9128 lr:0.0003000000 time/step:182.06s [2026-01-06 03:54:07,400] - step:743/900 train_loss:0.8910 lr:0.0003000000 time/step:182.62s [2026-01-06 03:57:09,220] - step:744/900 train_loss:0.9025 lr:0.0003000000 time/step:181.81s [2026-01-06 04:00:11,417] - step:745/900 train_loss:0.8949 lr:0.0003000000 time/step:182.19s [2026-01-06 04:03:13,516] - step:746/900 train_loss:0.8962 lr:0.0003000000 time/step:182.07s [2026-01-06 04:06:15,976] - step:747/900 train_loss:0.8824 lr:0.0003000000 time/step:182.45s [2026-01-06 04:09:18,333] - step:748/900 train_loss:0.8866 lr:0.0003000000 time/step:182.35s [2026-01-06 04:12:20,587] - step:749/900 train_loss:0.9029 lr:0.0003000000 time/step:182.24s [2026-01-06 04:15:22,595] - step:750/900 train_loss:0.8948 lr:0.0003000000 time/step:182.00s [2026-01-06 04:18:24,362] - step:751/900 train_loss:0.9038 lr:0.0003000000 time/step:181.76s [2026-01-06 04:21:26,159] - step:752/900 train_loss:0.8932 lr:0.0003000000 time/step:181.79s [2026-01-06 04:24:27,921] - step:753/900 train_loss:0.9031 lr:0.0003000000 time/step:181.75s [2026-01-06 04:27:29,364] - step:754/900 train_loss:0.8888 lr:0.0003000000 time/step:181.43s [2026-01-06 04:30:31,397] - step:755/900 train_loss:0.8987 lr:0.0003000000 time/step:182.03s [2026-01-06 04:33:33,184] - step:756/900 train_loss:0.8889 lr:0.0003000000 time/step:181.77s [2026-01-06 04:36:35,231] - step:757/900 train_loss:0.8819 lr:0.0003000000 time/step:182.04s [2026-01-06 04:39:37,141] - step:758/900 train_loss:0.8964 lr:0.0003000000 time/step:181.91s [2026-01-06 04:42:39,177] - step:759/900 train_loss:0.8869 lr:0.0003000000 time/step:182.03s [2026-01-06 04:45:41,636] - step:760/900 train_loss:0.8785 lr:0.0003000000 time/step:182.45s [2026-01-06 04:48:44,213] - step:761/900 train_loss:0.8806 lr:0.0003000000 time/step:182.57s [2026-01-06 04:51:46,042] - step:762/900 train_loss:0.8784 lr:0.0003000000 time/step:181.82s [2026-01-06 04:54:48,738] - step:763/900 train_loss:0.8918 lr:0.0003000000 time/step:182.68s [2026-01-06 04:57:50,902] - step:764/900 train_loss:0.8965 lr:0.0003000000 time/step:182.15s [2026-01-06 05:00:52,726] - step:765/900 train_loss:0.9190 lr:0.0003000000 time/step:181.82s [2026-01-06 05:03:54,647] - step:766/900 train_loss:0.8776 lr:0.0003000000 time/step:181.91s [2026-01-06 05:06:56,559] - step:767/900 train_loss:0.8858 lr:0.0003000000 time/step:181.91s [2026-01-06 05:09:58,576] - step:768/900 train_loss:0.9242 lr:0.0003000000 time/step:182.01s [2026-01-06 05:13:00,381] - step:769/900 train_loss:0.8767 lr:0.0003000000 time/step:181.80s [2026-01-06 05:16:02,536] - step:770/900 train_loss:0.9030 lr:0.0003000000 time/step:182.15s [2026-01-06 05:19:04,737] - step:771/900 train_loss:0.9251 lr:0.0003000000 time/step:182.19s [2026-01-06 05:22:06,938] - step:772/900 train_loss:0.8788 lr:0.0003000000 time/step:182.19s [2026-01-06 05:25:09,520] - step:773/900 train_loss:0.8841 lr:0.0003000000 time/step:182.57s [2026-01-06 05:28:11,306] - step:774/900 train_loss:0.9081 lr:0.0003000000 time/step:181.77s [2026-01-06 05:31:13,562] - step:775/900 train_loss:0.8999 lr:0.0003000000 time/step:182.25s [2026-01-06 05:34:15,466] - step:776/900 train_loss:0.8972 lr:0.0003000000 time/step:181.89s [2026-01-06 05:37:17,824] - step:777/900 train_loss:0.9018 lr:0.0003000000 time/step:182.35s [2026-01-06 05:40:20,299] - step:778/900 train_loss:0.8755 lr:0.0003000000 time/step:182.47s [2026-01-06 05:43:22,378] - step:779/900 train_loss:0.8846 lr:0.0003000000 time/step:182.07s [2026-01-06 05:46:24,476] - step:780/900 train_loss:0.9025 lr:0.0003000000 time/step:182.08s [2026-01-06 05:49:26,183] - step:781/900 train_loss:0.9041 lr:0.0003000000 time/step:181.70s [2026-01-06 05:52:27,712] - step:782/900 train_loss:0.9195 lr:0.0003000000 time/step:181.52s [2026-01-06 05:55:29,645] - step:783/900 train_loss:0.8730 lr:0.0003000000 time/step:181.91s [2026-01-06 05:58:31,313] - step:784/900 train_loss:0.9142 lr:0.0003000000 time/step:181.66s [2026-01-06 06:01:33,350] - step:785/900 train_loss:0.8734 lr:0.0003000000 time/step:182.03s [2026-01-06 06:04:35,388] - step:786/900 train_loss:0.9062 lr:0.0003000000 time/step:182.03s [2026-01-06 06:07:38,294] - step:787/900 train_loss:0.8935 lr:0.0003000000 time/step:182.90s [2026-01-06 06:10:40,506] - step:788/900 train_loss:0.9061 lr:0.0003000000 time/step:182.20s [2026-01-06 06:13:42,575] - step:789/900 train_loss:0.8887 lr:0.0003000000 time/step:182.06s [2026-01-06 06:16:45,191] - step:790/900 train_loss:0.8970 lr:0.0003000000 time/step:182.60s [2026-01-06 06:19:47,417] - step:791/900 train_loss:0.8935 lr:0.0003000000 time/step:182.21s [2026-01-06 06:22:49,280] - step:792/900 train_loss:0.9074 lr:0.0003000000 time/step:181.86s [2026-01-06 06:25:51,885] - step:793/900 train_loss:0.8885 lr:0.0003000000 time/step:182.59s [2026-01-06 06:28:53,987] - step:794/900 train_loss:0.9060 lr:0.0003000000 time/step:182.09s [2026-01-06 06:31:56,080] - step:795/900 train_loss:0.9145 lr:0.0003000000 time/step:182.09s [2026-01-06 06:34:57,566] - step:796/900 train_loss:0.8915 lr:0.0003000000 time/step:181.47s [2026-01-06 06:37:59,856] - step:797/900 train_loss:0.8841 lr:0.0003000000 time/step:182.28s [2026-01-06 06:41:02,352] - step:798/900 train_loss:0.8919 lr:0.0003000000 time/step:182.49s [2026-01-06 06:44:04,229] - step:799/900 train_loss:0.9027 lr:0.0003000000 time/step:181.87s [2026-01-06 06:47:08,559] - step:800/900 Saved model to /disk/scratch/agrivas/nanoGPT/logs/2026-01-04/14-18-10/model@800.pt... [2026-01-06 06:47:08,561] - step:800/900 train_loss:0.8959 lr:0.0003000000 time/step:182.82s [2026-01-06 06:50:11,034] - step:801/900 train_loss:0.9068 lr:0.0003000000 time/step:182.47s [2026-01-06 06:53:13,187] - step:802/900 train_loss:0.8832 lr:0.0003000000 time/step:182.15s [2026-01-06 06:56:15,656] - step:803/900 train_loss:0.9006 lr:0.0003000000 time/step:182.46s [2026-01-06 06:59:18,148] - step:804/900 train_loss:0.8915 lr:0.0003000000 time/step:182.49s [2026-01-06 07:02:20,094] - step:805/900 train_loss:0.9212 lr:0.0003000000 time/step:181.94s [2026-01-06 07:05:22,289] - step:806/900 train_loss:0.8819 lr:0.0003000000 time/step:182.18s [2026-01-06 07:08:24,319] - step:807/900 train_loss:0.8904 lr:0.0003000000 time/step:182.02s [2026-01-06 07:11:26,927] - step:808/900 train_loss:0.8800 lr:0.0003000000 time/step:182.60s [2026-01-06 07:14:28,874] - step:809/900 train_loss:0.9097 lr:0.0003000000 time/step:181.94s [2026-01-06 07:17:31,049] - step:810/900 train_loss:0.8831 lr:0.0003000000 time/step:182.17s [2026-01-06 07:20:33,024] - step:811/900 train_loss:0.8718 lr:0.0003000000 time/step:181.97s [2026-01-06 07:23:34,781] - step:812/900 train_loss:0.8813 lr:0.0003000000 time/step:181.75s [2026-01-06 07:26:36,943] - step:813/900 train_loss:0.8843 lr:0.0003000000 time/step:182.14s [2026-01-06 07:29:38,332] - step:814/900 train_loss:0.9033 lr:0.0003000000 time/step:181.38s [2026-01-06 07:32:39,831] - step:815/900 train_loss:0.9085 lr:0.0003000000 time/step:181.49s [2026-01-06 07:35:41,679] - step:816/900 train_loss:0.8902 lr:0.0003000000 time/step:181.83s [2026-01-06 07:38:43,002] - step:817/900 train_loss:0.9102 lr:0.0003000000 time/step:181.31s [2026-01-06 07:41:44,670] - step:818/900 train_loss:0.8920 lr:0.0003000000 time/step:181.66s [2026-01-06 07:44:46,911] - step:819/900 train_loss:0.8885 lr:0.0003000000 time/step:182.23s [2026-01-06 07:47:49,176] - step:820/900 train_loss:0.9048 lr:0.0003000000 time/step:182.26s [2026-01-06 07:50:51,118] - step:821/900 train_loss:0.9076 lr:0.0003000000 time/step:181.94s [2026-01-06 07:53:52,903] - step:822/900 train_loss:0.8945 lr:0.0003000000 time/step:181.78s [2026-01-06 07:56:54,788] - step:823/900 train_loss:0.8954 lr:0.0003000000 time/step:181.86s [2026-01-06 07:59:56,631] - step:824/900 train_loss:0.9084 lr:0.0003000000 time/step:181.83s [2026-01-06 08:02:58,221] - step:825/900 train_loss:0.9159 lr:0.0003000000 time/step:181.58s [2026-01-06 08:06:00,538] - step:826/900 train_loss:0.8903 lr:0.0003000000 time/step:182.30s [2026-01-06 08:09:02,955] - step:827/900 train_loss:0.8941 lr:0.0003000000 time/step:182.41s [2026-01-06 08:12:04,642] - step:828/900 train_loss:0.8972 lr:0.0003000000 time/step:181.68s [2026-01-06 08:15:07,199] - step:829/900 train_loss:0.8888 lr:0.0003000000 time/step:182.55s [2026-01-06 08:18:09,503] - step:830/900 train_loss:0.9024 lr:0.0003000000 time/step:182.29s [2026-01-06 08:21:11,546] - step:831/900 train_loss:0.8941 lr:0.0003000000 time/step:182.04s [2026-01-06 08:24:13,660] - step:832/900 train_loss:0.8784 lr:0.0003000000 time/step:182.11s [2026-01-06 08:27:16,249] - step:833/900 train_loss:0.9148 lr:0.0003000000 time/step:182.58s [2026-01-06 08:30:18,119] - step:834/900 train_loss:0.8852 lr:0.0003000000 time/step:181.86s [2026-01-06 08:33:20,158] - step:835/900 train_loss:0.8832 lr:0.0003000000 time/step:182.03s [2026-01-06 08:36:22,363] - step:836/900 train_loss:0.9164 lr:0.0003000000 time/step:182.19s [2026-01-06 08:39:24,609] - step:837/900 train_loss:0.8703 lr:0.0003000000 time/step:182.24s [2026-01-06 08:42:26,387] - step:838/900 train_loss:0.8803 lr:0.0003000000 time/step:181.77s [2026-01-06 08:45:28,685] - step:839/900 train_loss:0.9080 lr:0.0003000000 time/step:182.28s [2026-01-06 08:48:30,870] - step:840/900 train_loss:0.8813 lr:0.0003000000 time/step:182.17s [2026-01-06 08:51:32,783] - step:841/900 train_loss:0.8969 lr:0.0003000000 time/step:181.91s [2026-01-06 08:54:34,752] - step:842/900 train_loss:0.9163 lr:0.0003000000 time/step:181.96s [2026-01-06 08:57:37,299] - step:843/900 train_loss:0.9175 lr:0.0003000000 time/step:182.53s [2026-01-06 09:00:39,499] - step:844/900 train_loss:0.9061 lr:0.0003000000 time/step:182.20s [2026-01-06 09:03:41,513] - step:845/900 train_loss:0.8923 lr:0.0003000000 time/step:182.01s [2026-01-06 09:06:43,522] - step:846/900 train_loss:0.8794 lr:0.0003000000 time/step:182.00s [2026-01-06 09:09:45,934] - step:847/900 train_loss:0.8829 lr:0.0003000000 time/step:182.40s [2026-01-06 09:12:48,116] - step:848/900 train_loss:0.9038 lr:0.0003000000 time/step:182.17s [2026-01-06 09:15:50,725] - step:849/900 train_loss:0.8962 lr:0.0003000000 time/step:182.60s [2026-01-06 09:18:53,432] - step:850/900 train_loss:0.8850 lr:0.0003000000 time/step:182.70s [2026-01-06 09:21:55,307] - step:851/900 train_loss:0.9092 lr:0.0003000000 time/step:181.86s [2026-01-06 09:24:57,475] - step:852/900 train_loss:0.9305 lr:0.0003000000 time/step:182.16s [2026-01-06 09:27:59,485] - step:853/900 train_loss:0.9114 lr:0.0003000000 time/step:182.00s [2026-01-06 09:31:01,587] - step:854/900 train_loss:0.8829 lr:0.0003000000 time/step:182.10s [2026-01-06 09:34:03,331] - step:855/900 train_loss:0.8952 lr:0.0003000000 time/step:181.74s [2026-01-06 09:37:05,280] - step:856/900 train_loss:0.8922 lr:0.0003000000 time/step:181.94s [2026-01-06 09:40:07,326] - step:857/900 train_loss:0.8931 lr:0.0003000000 time/step:182.03s [2026-01-06 09:43:08,824] - step:858/900 train_loss:0.9034 lr:0.0003000000 time/step:181.49s [2026-01-06 09:46:10,962] - step:859/900 train_loss:0.8813 lr:0.0003000000 time/step:182.13s [2026-01-06 09:49:13,503] - step:860/900 train_loss:0.9017 lr:0.0003000000 time/step:182.53s [2026-01-06 09:52:15,454] - step:861/900 train_loss:0.8764 lr:0.0003000000 time/step:181.94s [2026-01-06 09:55:16,945] - step:862/900 train_loss:0.8997 lr:0.0003000000 time/step:181.49s [2026-01-06 09:58:18,680] - step:863/900 train_loss:0.8846 lr:0.0003000000 time/step:181.73s [2026-01-06 10:01:20,298] - step:864/900 train_loss:0.9089 lr:0.0003000000 time/step:181.61s [2026-01-06 10:04:22,390] - step:865/900 train_loss:0.9040 lr:0.0003000000 time/step:182.09s [2026-01-06 10:07:24,658] - step:866/900 train_loss:0.9216 lr:0.0003000000 time/step:182.26s [2026-01-06 10:10:27,140] - step:867/900 train_loss:0.9041 lr:0.0003000000 time/step:182.47s [2026-01-06 10:13:29,245] - step:868/900 train_loss:0.9016 lr:0.0003000000 time/step:182.10s [2026-01-06 10:16:31,698] - step:869/900 train_loss:0.8870 lr:0.0003000000 time/step:182.44s [2026-01-06 10:19:34,119] - step:870/900 train_loss:0.8614 lr:0.0003000000 time/step:182.41s [2026-01-06 10:22:36,216] - step:871/900 train_loss:0.8866 lr:0.0003000000 time/step:182.09s [2026-01-06 10:25:38,188] - step:872/900 train_loss:0.8704 lr:0.0003000000 time/step:181.97s [2026-01-06 10:28:41,382] - step:873/900 train_loss:0.8827 lr:0.0003000000 time/step:183.15s [2026-01-06 10:31:43,745] - step:874/900 train_loss:0.9025 lr:0.0003000000 time/step:182.36s [2026-01-06 10:34:46,239] - step:875/900 train_loss:0.8541 lr:0.0003000000 time/step:182.48s [2026-01-06 10:37:49,083] - step:876/900 train_loss:0.9157 lr:0.0003000000 time/step:182.84s [2026-01-06 10:40:51,597] - step:877/900 train_loss:0.8844 lr:0.0003000000 time/step:182.51s [2026-01-06 10:43:53,118] - step:878/900 train_loss:0.8853 lr:0.0003000000 time/step:181.51s [2026-01-06 10:46:55,150] - step:879/900 train_loss:0.9096 lr:0.0003000000 time/step:182.02s [2026-01-06 10:49:57,698] - step:880/900 train_loss:0.8832 lr:0.0003000000 time/step:182.54s [2026-01-06 10:52:59,874] - step:881/900 train_loss:0.8779 lr:0.0003000000 time/step:182.17s [2026-01-06 10:56:02,511] - step:882/900 train_loss:0.8919 lr:0.0003000000 time/step:182.63s [2026-01-06 10:59:05,498] - step:883/900 train_loss:0.9207 lr:0.0003000000 time/step:182.98s [2026-01-06 11:02:08,068] - step:884/900 train_loss:0.9029 lr:0.0003000000 time/step:182.56s [2026-01-06 11:05:10,779] - step:885/900 train_loss:0.8859 lr:0.0003000000 time/step:182.70s [2026-01-06 11:08:13,320] - step:886/900 train_loss:0.9008 lr:0.0003000000 time/step:182.53s [2026-01-06 11:11:15,882] - step:887/900 train_loss:0.8868 lr:0.0003000000 time/step:182.56s [2026-01-06 11:14:18,133] - step:888/900 train_loss:0.8943 lr:0.0003000000 time/step:182.25s [2026-01-06 11:17:20,816] - step:889/900 train_loss:0.9063 lr:0.0003000000 time/step:182.67s [2026-01-06 11:20:23,424] - step:890/900 train_loss:0.8921 lr:0.0003000000 time/step:182.60s [2026-01-06 11:23:25,258] - step:891/900 train_loss:0.9243 lr:0.0003000000 time/step:181.82s [2026-01-06 11:26:27,159] - step:892/900 train_loss:0.9029 lr:0.0003000000 time/step:181.88s [2026-01-06 11:29:29,726] - step:893/900 train_loss:0.8900 lr:0.0003000000 time/step:182.56s [2026-01-06 11:32:31,594] - step:894/900 train_loss:0.9321 lr:0.0003000000 time/step:181.86s [2026-01-06 11:35:33,388] - step:895/900 train_loss:0.9026 lr:0.0003000000 time/step:181.79s [2026-01-06 11:38:35,322] - step:896/900 train_loss:0.9181 lr:0.0003000000 time/step:181.93s [2026-01-06 11:41:37,744] - step:897/900 train_loss:0.9108 lr:0.0003000000 time/step:182.42s [2026-01-06 11:44:39,604] - step:898/900 train_loss:0.8882 lr:0.0003000000 time/step:181.85s [2026-01-06 11:47:41,527] - step:899/900 train_loss:0.9131 lr:0.0003000000 time/step:181.90s [2026-01-06 11:50:45,420] - step:900/900 Saved model to /disk/scratch/agrivas/nanoGPT/logs/2026-01-04/14-18-10/model@900.pt... [2026-01-06 11:50:45,421] - step:900/900 train_loss:0.8957 lr:0.0003000000 time/step:182.33s