artifacts/adamw_sweep_cmpatino-0/log_lr0.0030_wd0.05_steps2812_cmpatino-0.txt

W0430 20:26:07.534000 1968462 torch/distributed/run.py:851] 
W0430 20:26:07.534000 1968462 torch/distributed/run.py:851] *****************************************
W0430 20:26:07.534000 1968462 torch/distributed/run.py:851] Setting OMP_NUM_THREADS environment variable for each process to be 1 in default, to avoid your system being overloaded, please further tune the variable for optimal performance in your application as needed. 
W0430 20:26:07.534000 1968462 torch/distributed/run.py:851] *****************************************
logs/lr0.0030_wd0.05_steps2812_cmpatino-0_6718625f-5c2a-4446-a5de-063785b3a4ff.txt
CONFIG block_lr=0.003 block_wd=0.05 betas=(0.9,0.95) train_steps=2812 warmup=125 cooldown_frac=0.7
step:0/2812 val_loss:10.82585 train_time:0.000s step_avg:nanms
step:125/2812 val_loss:6.33046 train_time:70.223s step_avg:561.78ms
step:250/2812 val_loss:5.37772 train_time:138.218s step_avg:543.97ms
step:375/2812 val_loss:4.92224 train_time:206.080s step_avg:542.89ms
step:500/2812 val_loss:4.60201 train_time:273.853s step_avg:542.18ms
step:625/2812 val_loss:4.32193 train_time:341.589s step_avg:541.89ms
step:750/2812 val_loss:4.17143 train_time:409.323s step_avg:541.87ms
step:875/2812 val_loss:4.04906 train_time:477.041s step_avg:541.74ms
step:1000/2812 val_loss:3.96373 train_time:544.783s step_avg:541.94ms
step:1125/2812 val_loss:3.89448 train_time:612.466s step_avg:541.46ms
step:1250/2812 val_loss:3.83080 train_time:680.153s step_avg:541.50ms
step:1375/2812 val_loss:3.79947 train_time:747.915s step_avg:542.10ms
step:1500/2812 val_loss:3.73841 train_time:815.712s step_avg:542.37ms
step:1625/2812 val_loss:3.70758 train_time:883.519s step_avg:542.46ms
step:1750/2812 val_loss:3.67663 train_time:951.281s step_avg:542.10ms
step:1875/2812 val_loss:3.64534 train_time:1019.083s step_avg:542.42ms
step:2000/2812 val_loss:3.62034 train_time:1086.900s step_avg:542.54ms
step:2125/2812 val_loss:3.59678 train_time:1154.778s step_avg:543.02ms
step:2250/2812 val_loss:3.57562 train_time:1222.569s step_avg:542.33ms
step:2375/2812 val_loss:3.55627 train_time:1290.355s step_avg:542.29ms
step:2500/2812 val_loss:3.53877 train_time:1358.217s step_avg:542.89ms
step:2625/2812 val_loss:3.52347 train_time:1426.049s step_avg:542.66ms
step:2750/2812 val_loss:3.51199 train_time:1493.881s step_avg:542.65ms
step:2812/2812 val_loss:3.50910 train_time:1527.504s step_avg:542.31ms