Warning: You are sending unauthenticated requests to the HF Hub. Please set a HF_TOKEN to enable higher rate limits and faster downloads.

Loading weights:   0%|          | 0/1 [00:00<?, ?it/s]
Loading weights: 100%|██████████| 1/1 [00:00<00:00, 186.50it/s]

Saving external data:   0%|          | 0/196 [00:00<?, ?it/s]
Saving external data:   1%|          | 1/196 [00:00<00:00, 61680.94it/s, model.layers.0.input_layernorm.weight (f16, [896])]
Saving external data:   1%|          | 2/196 [00:00<00:00, 4668.12it/s, model.layers.0.post_attention_layernorm.weight (f16, [896])]
Saving external data:   2%|▏         | 3/196 [00:00<00:00, 5454.23it/s, model.layers.1.input_layernorm.weight (f16, [896])]         
Saving external data:   2%|▏         | 4/196 [00:00<00:00, 6089.73it/s, model.layers.1.post_attention_layernorm.weight (f16, [896])]
Saving external data:   3%|▎         | 5/196 [00:00<00:00, 6743.25it/s, model.layers.2.input_layernorm.weight (f16, [896])]         
Saving external data:   3%|▎         | 6/196 [00:00<00:00, 7198.46it/s, model.layers.2.post_attention_layernorm.weight (f16, [896])]
Saving external data:   4%|▎         | 7/196 [00:00<00:00, 7649.85it/s, model.layers.3.input_layernorm.weight (f16, [896])]         
Saving external data:   4%|▍         | 8/196 [00:00<00:00, 8038.92it/s, model.layers.3.post_attention_layernorm.weight (f16, [896])]
Saving external data:   5%|▍         | 9/196 [00:00<00:00, 8409.16it/s, model.layers.4.input_layernorm.weight (f16, [896])]         
Saving external data:   5%|▌         | 10/196 [00:00<00:00, 8707.29it/s, model.layers.4.post_attention_layernorm.weight (f16, [896])]
Saving external data:   6%|▌         | 11/196 [00:00<00:00, 8993.63it/s, model.layers.5.input_layernorm.weight (f16, [896])]         
Saving external data:   6%|▌         | 12/196 [00:00<00:00, 9223.32it/s, model.layers.5.post_attention_layernorm.weight (f16, [896])]
Saving external data:   7%|▋         | 13/196 [00:00<00:00, 9423.77it/s, model.layers.6.input_layernorm.weight (f16, [896])]         
Saving external data:   7%|▋         | 14/196 [00:00<00:00, 9616.81it/s, model.layers.6.post_attention_layernorm.weight (f16, [896])]
Saving external data:   8%|▊         | 15/196 [00:00<00:00, 9819.66it/s, model.layers.7.input_layernorm.weight (f16, [896])]         
Saving external data:   8%|▊         | 16/196 [00:00<00:00, 9990.90it/s, model.layers.7.post_attention_layernorm.weight (f16, [896])]
Saving external data:   9%|▊         | 17/196 [00:00<00:00, 10152.81it/s, model.layers.8.input_layernorm.weight (f16, [896])]        
Saving external data:   9%|▉         | 18/196 [00:00<00:00, 10298.39it/s, model.layers.8.post_attention_layernorm.weight (f16, [896])]
Saving external data:  10%|▉         | 19/196 [00:00<00:00, 10432.23it/s, model.layers.9.input_layernorm.weight (f16, [896])]         
Saving external data:  10%|█         | 20/196 [00:00<00:00, 10543.75it/s, model.layers.9.post_attention_layernorm.weight (f16, [896])]
Saving external data:  11%|█         | 21/196 [00:00<00:00, 10655.74it/s, model.layers.10.input_layernorm.weight (f16, [896])]        
Saving external data:  11%|█         | 22/196 [00:00<00:00, 10735.86it/s, model.layers.10.post_attention_layernorm.weight (f16, [896])]
Saving external data:  12%|█▏        | 23/196 [00:00<00:00, 10831.91it/s, model.layers.11.input_layernorm.weight (f16, [896])]         
Saving external data:  12%|█▏        | 24/196 [00:00<00:00, 10916.74it/s, model.layers.11.post_attention_layernorm.weight (f16, [896])]
Saving external data:  13%|█▎        | 25/196 [00:00<00:00, 11004.05it/s, model.layers.12.input_layernorm.weight (f16, [896])]         
Saving external data:  13%|█▎        | 26/196 [00:00<00:00, 11073.51it/s, model.layers.12.post_attention_layernorm.weight (f16, [896])]
Saving external data:  14%|█▍        | 27/196 [00:00<00:00, 11156.16it/s, model.layers.13.input_layernorm.weight (f16, [896])]         
Saving external data:  14%|█▍        | 28/196 [00:00<00:00, 11220.07it/s, model.layers.13.post_attention_layernorm.weight (f16, [896])]
Saving external data:  15%|█▍        | 29/196 [00:00<00:00, 11283.38it/s, model.layers.14.input_layernorm.weight (f16, [896])]         
Saving external data:  15%|█▌        | 30/196 [00:00<00:00, 11340.04it/s, model.layers.14.post_attention_layernorm.weight (f16, [896])]
Saving external data:  16%|█▌        | 31/196 [00:00<00:00, 11408.57it/s, model.layers.15.input_layernorm.weight (f16, [896])]         
Saving external data:  16%|█▋        | 32/196 [00:00<00:00, 11468.66it/s, model.layers.15.post_attention_layernorm.weight (f16, [896])]
Saving external data:  17%|█▋        | 33/196 [00:00<00:00, 11534.34it/s, model.layers.16.input_layernorm.weight (f16, [896])]         
Saving external data:  17%|█▋        | 34/196 [00:00<00:00, 11599.67it/s, model.layers.16.post_attention_layernorm.weight (f16, [896])]
Saving external data:  18%|█▊        | 35/196 [00:00<00:00, 11662.88it/s, model.layers.17.input_layernorm.weight (f16, [896])]         
Saving external data:  18%|█▊        | 36/196 [00:00<00:00, 11701.41it/s, model.layers.17.post_attention_layernorm.weight (f16, [896])]
Saving external data:  19%|█▉        | 37/196 [00:00<00:00, 11758.54it/s, model.layers.18.input_layernorm.weight (f16, [896])]         
Saving external data:  19%|█▉        | 38/196 [00:00<00:00, 11800.94it/s, model.layers.18.post_attention_layernorm.weight (f16, [896])]
Saving external data:  20%|█▉        | 39/196 [00:00<00:00, 11849.17it/s, model.layers.19.input_layernorm.weight (f16, [896])]         
Saving external data:  20%|██        | 40/196 [00:00<00:00, 11889.46it/s, model.layers.19.post_attention_layernorm.weight (f16, [896])]
Saving external data:  21%|██        | 41/196 [00:00<00:00, 11933.00it/s, model.layers.20.input_layernorm.weight (f16, [896])]         
Saving external data:  21%|██▏       | 42/196 [00:00<00:00, 11903.56it/s, model.layers.20.post_attention_layernorm.weight (f16, [896])]
Saving external data:  22%|██▏       | 43/196 [00:00<00:00, 11943.25it/s, model.layers.21.input_layernorm.weight (f16, [896])]         
Saving external data:  22%|██▏       | 44/196 [00:00<00:00, 11974.40it/s, model.layers.21.post_attention_layernorm.weight (f16, [896])]
Saving external data:  23%|██▎       | 45/196 [00:00<00:00, 12008.12it/s, model.layers.22.input_layernorm.weight (f16, [896])]         
Saving external data:  23%|██▎       | 46/196 [00:00<00:00, 12023.31it/s, model.layers.22.post_attention_layernorm.weight (f16, [896])]
Saving external data:  24%|██▍       | 47/196 [00:00<00:00, 12054.07it/s, model.layers.23.input_layernorm.weight (f16, [896])]         
Saving external data:  24%|██▍       | 48/196 [00:00<00:00, 12074.28it/s, model.layers.23.post_attention_layernorm.weight (f16, [896])]
Saving external data:  25%|██▌       | 49/196 [00:00<00:00, 12103.70it/s, model.norm.weight (f16, [896])]                              
Saving external data:  26%|██▌       | 50/196 [00:00<00:00, 12130.68it/s, None (f16, [1152])]            
Saving external data:  26%|██▌       | 51/196 [00:00<00:00, 11590.87it/s, None (f16, [1152])]
Saving external data:  27%|██▋       | 52/196 [00:00<00:00, 11405.31it/s, None (f16, [1152])]
Saving external data:  27%|██▋       | 53/196 [00:00<00:00, 11285.89it/s, None (f16, [1152])]
Saving external data:  28%|██▊       | 54/196 [00:00<00:00, 11182.60it/s, None (f16, [1152])]
Saving external data:  28%|██▊       | 55/196 [00:00<00:00, 11085.38it/s, None (f16, [1152])]
Saving external data:  29%|██▊       | 56/196 [00:00<00:00, 10995.27it/s, None (f16, [1152])]
Saving external data:  29%|██▉       | 57/196 [00:00<00:00, 10909.71it/s, None (f16, [1152])]
Saving external data:  30%|██▉       | 58/196 [00:00<00:00, 10833.17it/s, None (f16, [1152])]
Saving external data:  30%|███       | 59/196 [00:00<00:00, 10760.71it/s, None (f16, [1152])]
Saving external data:  31%|███       | 60/196 [00:00<00:00, 10687.49it/s, None (f16, [1152])]
Saving external data:  31%|███       | 61/196 [00:00<00:00, 10625.55it/s, None (f16, [1152])]
Saving external data:  32%|███▏      | 62/196 [00:00<00:00, 10225.99it/s, None (f16, [1152])]
Saving external data:  32%|███▏      | 63/196 [00:00<00:00, 10157.65it/s, None (f16, [1152])]
Saving external data:  33%|███▎      | 64/196 [00:00<00:00, 10105.23it/s, None (f16, [1152])]
Saving external data:  33%|███▎      | 65/196 [00:00<00:00, 10059.03it/s, None (f16, [1152])]
Saving external data:  34%|███▎      | 66/196 [00:00<00:00, 10008.46it/s, None (f16, [1152])]
Saving external data:  34%|███▍      | 67/196 [00:00<00:00, 9965.90it/s, None (f16, [1152])] 
Saving external data:  35%|███▍      | 68/196 [00:00<00:00, 9921.82it/s, None (f16, [1152])]
Saving external data:  35%|███▌      | 69/196 [00:00<00:00, 9877.71it/s, None (f16, [1152])]
Saving external data:  36%|███▌      | 70/196 [00:00<00:00, 9840.83it/s, None (f16, [1152])]
Saving external data:  36%|███▌      | 71/196 [00:00<00:00, 9805.91it/s, None (f16, [1152])]
Saving external data:  37%|███▋      | 72/196 [00:00<00:00, 9773.14it/s, None (f16, [1152])]
Saving external data:  37%|███▋      | 73/196 [00:00<00:00, 9709.34it/s, None (f16, [1152])]
Saving external data:  38%|███▊      | 74/196 [00:00<00:00, 9674.24it/s, model.layers.0.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  38%|███▊      | 75/196 [00:00<00:00, 2477.36it/s, model.layers.1.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  39%|███▉      | 76/196 [00:00<00:00, 1048.81it/s, model.layers.2.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  39%|███▉      | 77/196 [00:00<00:00, 568.32it/s, model.layers.2.self_attn.o_proj.weight_t (f16, [896,896])] 
Saving external data:  39%|███▉      | 77/196 [00:00<00:00, 568.32it/s, model.layers.3.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  40%|███▉      | 78/196 [00:00<00:00, 568.32it/s, model.layers.4.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  40%|████      | 79/196 [00:00<00:00, 568.32it/s, model.layers.5.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  41%|████      | 80/196 [00:00<00:00, 568.32it/s, model.layers.6.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  41%|████▏     | 81/196 [00:00<00:00, 568.32it/s, model.layers.7.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  42%|████▏     | 82/196 [00:00<00:00, 568.32it/s, model.layers.8.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  42%|████▏     | 83/196 [00:00<00:00, 568.32it/s, model.layers.9.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  43%|████▎     | 84/196 [00:00<00:00, 568.32it/s, model.layers.10.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  43%|████▎     | 85/196 [00:00<00:00, 568.32it/s, model.layers.11.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  44%|████▍     | 86/196 [00:00<00:00, 568.32it/s, model.layers.12.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  44%|████▍     | 87/196 [00:00<00:00, 568.32it/s, model.layers.13.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  45%|████▍     | 88/196 [00:00<00:00, 568.32it/s, model.layers.14.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  45%|████▌     | 89/196 [00:00<00:00, 568.32it/s, model.layers.15.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  46%|████▌     | 90/196 [00:00<00:00, 568.32it/s, model.layers.16.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  46%|████▋     | 91/196 [00:01<00:00, 568.32it/s, model.layers.17.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  47%|████▋     | 92/196 [00:01<00:00, 568.32it/s, model.layers.18.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  47%|████▋     | 93/196 [00:01<00:00, 568.32it/s, model.layers.19.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  48%|████▊     | 94/196 [00:01<00:00, 568.32it/s, model.layers.20.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  48%|████▊     | 95/196 [00:01<00:00, 568.32it/s, model.layers.21.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  49%|████▉     | 96/196 [00:01<00:00, 568.32it/s, model.layers.22.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  49%|████▉     | 97/196 [00:01<00:00, 568.32it/s, model.layers.23.self_attn.o_proj.weight_t (f16, [896,896])]
Saving external data:  50%|█████     | 98/196 [00:01<00:00, 568.32it/s, model.layers.0.self_attn.q_proj.weight__model.layers.0.self_attn.k_proj.weight__model.layers.0.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  51%|█████     | 99/196 [00:01<00:00, 568.32it/s, model.layers.1.self_attn.q_proj.weight__model.layers.1.self_attn.k_proj.weight__model.layers.1.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  51%|█████     | 100/196 [00:01<00:00, 568.32it/s, model.layers.2.self_attn.q_proj.weight__model.layers.2.self_attn.k_proj.weight__model.layers.2.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  52%|█████▏    | 101/196 [00:01<00:00, 568.32it/s, model.layers.3.self_attn.q_proj.weight__model.layers.3.self_attn.k_proj.weight__model.layers.3.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  52%|█████▏    | 102/196 [00:01<00:00, 568.32it/s, model.layers.4.self_attn.q_proj.weight__model.layers.4.self_attn.k_proj.weight__model.layers.4.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  53%|█████▎    | 103/196 [00:01<00:00, 568.32it/s, model.layers.5.self_attn.q_proj.weight__model.layers.5.self_attn.k_proj.weight__model.layers.5.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  53%|█████▎    | 104/196 [00:01<00:00, 568.32it/s, model.layers.6.self_attn.q_proj.weight__model.layers.6.self_attn.k_proj.weight__model.layers.6.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  54%|█████▎    | 105/196 [00:02<00:00, 568.32it/s, model.layers.7.self_attn.q_proj.weight__model.layers.7.self_attn.k_proj.weight__model.layers.7.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  54%|█████▍    | 106/196 [00:02<00:00, 568.32it/s, model.layers.8.self_attn.q_proj.weight__model.layers.8.self_attn.k_proj.weight__model.layers.8.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  55%|█████▍    | 107/196 [00:02<00:00, 568.32it/s, model.layers.9.self_attn.q_proj.weight__model.layers.9.self_attn.k_proj.weight__model.layers.9.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  55%|█████▌    | 108/196 [00:02<00:00, 568.32it/s, model.layers.10.self_attn.q_proj.weight__model.layers.10.self_attn.k_proj.weight__model.layers.10.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  56%|█████▌    | 109/196 [00:02<00:00, 568.32it/s, model.layers.11.self_attn.q_proj.weight__model.layers.11.self_attn.k_proj.weight__model.layers.11.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  56%|█████▌    | 110/196 [00:02<00:00, 568.32it/s, model.layers.12.self_attn.q_proj.weight__model.layers.12.self_attn.k_proj.weight__model.layers.12.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  57%|█████▋    | 111/196 [00:02<00:00, 568.32it/s, model.layers.13.self_attn.q_proj.weight__model.layers.13.self_attn.k_proj.weight__model.layers.13.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  57%|█████▋    | 112/196 [00:02<00:00, 568.32it/s, model.layers.14.self_attn.q_proj.weight__model.layers.14.self_attn.k_proj.weight__model.layers.14.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  58%|█████▊    | 113/196 [00:02<00:00, 568.32it/s, model.layers.15.self_attn.q_proj.weight__model.layers.15.self_attn.k_proj.weight__model.layers.15.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  58%|█████▊    | 114/196 [00:02<00:00, 568.32it/s, model.layers.16.self_attn.q_proj.weight__model.layers.16.self_attn.k_proj.weight__model.layers.16.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  59%|█████▊    | 115/196 [00:02<00:00, 568.32it/s, model.layers.17.self_attn.q_proj.weight__model.layers.17.self_attn.k_proj.weight__model.layers.17.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  59%|█████▉    | 116/196 [00:03<00:00, 568.32it/s, model.layers.18.self_attn.q_proj.weight__model.layers.18.self_attn.k_proj.weight__model.layers.18.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  60%|█████▉    | 117/196 [00:03<00:00, 568.32it/s, model.layers.19.self_attn.q_proj.weight__model.layers.19.self_attn.k_proj.weight__model.layers.19.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  60%|██████    | 118/196 [00:03<00:00, 568.32it/s, model.layers.20.self_attn.q_proj.weight__model.layers.20.self_attn.k_proj.weight__model.layers.20.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  61%|██████    | 119/196 [00:03<00:00, 568.32it/s, model.layers.21.self_attn.q_proj.weight__model.layers.21.self_attn.k_proj.weight__model.layers.21.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  61%|██████    | 120/196 [00:03<00:00, 568.32it/s, model.layers.22.self_attn.q_proj.weight__model.layers.22.self_attn.k_proj.weight__model.layers.22.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  62%|██████▏   | 121/196 [00:03<00:00, 568.32it/s, model.layers.23.self_attn.q_proj.weight__model.layers.23.self_attn.k_proj.weight__model.layers.23.self_attn.v_proj.weight__axis_0__concat_t (f16, [896,1152])]
Saving external data:  62%|██████▏   | 122/196 [00:03<00:00, 568.32it/s, model.rotary_emb.cos_cache (f16, [32768,32])]                                                                                                                 
Saving external data:  63%|██████▎   | 123/196 [00:03<00:00, 568.32it/s, model.rotary_emb.sin_cache (f16, [32768,32])]
Saving external data:  63%|██████▎   | 124/196 [00:03<00:00, 568.32it/s, model.layers.0.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  64%|██████▍   | 125/196 [00:03<00:00, 568.32it/s, model.layers.0.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  64%|██████▍   | 126/196 [00:03<00:00, 568.32it/s, model.layers.0.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  65%|██████▍   | 127/196 [00:03<00:00, 568.32it/s, model.layers.1.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  65%|██████▌   | 128/196 [00:03<00:00, 568.32it/s, model.layers.1.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  66%|██████▌   | 129/196 [00:04<00:00, 568.32it/s, model.layers.1.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  66%|██████▋   | 130/196 [00:04<00:00, 568.32it/s, model.layers.2.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  67%|██████▋   | 131/196 [00:04<00:00, 568.32it/s, model.layers.2.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  67%|██████▋   | 132/196 [00:04<00:00, 568.32it/s, model.layers.2.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  68%|██████▊   | 133/196 [00:04<00:00, 568.32it/s, model.layers.3.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  68%|██████▊   | 134/196 [00:04<00:02, 24.36it/s, model.layers.3.mlp.gate_proj.weight_t (f16, [896,4864])] 
Saving external data:  68%|██████▊   | 134/196 [00:04<00:02, 24.36it/s, model.layers.3.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  69%|██████▉   | 135/196 [00:04<00:02, 24.36it/s, model.layers.3.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  69%|██████▉   | 136/196 [00:04<00:02, 24.36it/s, model.layers.4.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  70%|██████▉   | 137/196 [00:04<00:02, 24.36it/s, model.layers.4.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  70%|███████   | 138/196 [00:05<00:02, 24.36it/s, model.layers.4.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  71%|███████   | 139/196 [00:05<00:02, 24.36it/s, model.layers.5.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  71%|███████▏  | 140/196 [00:05<00:02, 24.36it/s, model.layers.5.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  72%|███████▏  | 141/196 [00:05<00:02, 24.36it/s, model.layers.5.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  72%|███████▏  | 142/196 [00:05<00:02, 24.36it/s, model.layers.6.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  73%|███████▎  | 143/196 [00:05<00:02, 24.36it/s, model.layers.6.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  73%|███████▎  | 144/196 [00:05<00:02, 24.36it/s, model.layers.6.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  74%|███████▍  | 145/196 [00:05<00:02, 24.36it/s, model.layers.7.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  74%|███████▍  | 146/196 [00:05<00:02, 24.36it/s, model.layers.7.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  75%|███████▌  | 147/196 [00:05<00:02, 24.36it/s, model.layers.7.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  76%|███████▌  | 148/196 [00:06<00:01, 24.36it/s, model.layers.8.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  76%|███████▌  | 149/196 [00:06<00:01, 24.36it/s, model.layers.8.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  77%|███████▋  | 150/196 [00:06<00:01, 24.36it/s, model.layers.8.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  77%|███████▋  | 151/196 [00:06<00:01, 24.36it/s, model.layers.9.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  78%|███████▊  | 152/196 [00:06<00:01, 24.36it/s, model.layers.9.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  78%|███████▊  | 153/196 [00:06<00:01, 24.36it/s, model.layers.9.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  79%|███████▊  | 154/196 [00:06<00:01, 24.36it/s, model.layers.10.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  79%|███████▉  | 155/196 [00:06<00:01, 24.36it/s, model.layers.10.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  80%|███████▉  | 156/196 [00:06<00:01, 24.36it/s, model.layers.10.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  80%|████████  | 157/196 [00:07<00:01, 24.36it/s, model.layers.11.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  81%|████████  | 158/196 [00:07<00:01, 24.36it/s, model.layers.11.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  81%|████████  | 159/196 [00:07<00:02, 17.58it/s, model.layers.11.mlp.up_proj.weight_t (f16, [896,4864])]
Saving external data:  81%|████████  | 159/196 [00:07<00:02, 17.58it/s, model.layers.11.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  82%|████████▏ | 160/196 [00:07<00:02, 17.58it/s, model.layers.12.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  82%|████████▏ | 161/196 [00:07<00:01, 17.58it/s, model.layers.12.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  83%|████████▎ | 162/196 [00:07<00:01, 17.58it/s, model.layers.12.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  83%|████████▎ | 163/196 [00:07<00:01, 17.58it/s, model.layers.13.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  84%|████████▎ | 164/196 [00:07<00:01, 17.58it/s, model.layers.13.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  84%|████████▍ | 165/196 [00:07<00:01, 17.58it/s, model.layers.13.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  85%|████████▍ | 166/196 [00:07<00:01, 17.58it/s, model.layers.14.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  85%|████████▌ | 167/196 [00:08<00:01, 17.58it/s, model.layers.14.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  86%|████████▌ | 168/196 [00:08<00:01, 17.58it/s, model.layers.14.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  86%|████████▌ | 169/196 [00:08<00:01, 17.58it/s, model.layers.15.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  87%|████████▋ | 170/196 [00:08<00:01, 17.58it/s, model.layers.15.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  87%|████████▋ | 171/196 [00:08<00:01, 17.58it/s, model.layers.15.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  88%|████████▊ | 172/196 [00:08<00:01, 17.58it/s, model.layers.16.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  88%|████████▊ | 173/196 [00:08<00:01, 15.31it/s, model.layers.16.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  88%|████████▊ | 173/196 [00:08<00:01, 15.31it/s, model.layers.16.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  89%|████████▉ | 174/196 [00:08<00:01, 15.31it/s, model.layers.16.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  89%|████████▉ | 175/196 [00:08<00:01, 15.31it/s, model.layers.17.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  90%|████████▉ | 176/196 [00:09<00:01, 15.31it/s, model.layers.17.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  90%|█████████ | 177/196 [00:09<00:01, 15.31it/s, model.layers.17.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  91%|█████████ | 178/196 [00:09<00:01, 15.31it/s, model.layers.18.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  91%|█████████▏| 179/196 [00:09<00:01, 15.31it/s, model.layers.18.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  92%|█████████▏| 180/196 [00:09<00:01, 15.31it/s, model.layers.18.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  92%|█████████▏| 181/196 [00:09<00:00, 15.31it/s, model.layers.19.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  93%|█████████▎| 182/196 [00:09<00:00, 14.01it/s, model.layers.19.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  93%|█████████▎| 182/196 [00:09<00:00, 14.01it/s, model.layers.19.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  93%|█████████▎| 183/196 [00:09<00:00, 14.01it/s, model.layers.19.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  94%|█████████▍| 184/196 [00:09<00:00, 14.01it/s, model.layers.20.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  94%|█████████▍| 185/196 [00:10<00:00, 14.01it/s, model.layers.20.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  95%|█████████▍| 186/196 [00:10<00:00, 14.01it/s, model.layers.20.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  95%|█████████▌| 187/196 [00:10<00:00, 14.01it/s, model.layers.21.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  96%|█████████▌| 188/196 [00:10<00:00, 13.21it/s, model.layers.21.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  96%|█████████▌| 188/196 [00:10<00:00, 13.21it/s, model.layers.21.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  96%|█████████▋| 189/196 [00:10<00:00, 13.21it/s, model.layers.21.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  97%|█████████▋| 190/196 [00:10<00:00, 13.21it/s, model.layers.22.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  97%|█████████▋| 191/196 [00:10<00:00, 13.21it/s, model.layers.22.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  98%|█████████▊| 192/196 [00:10<00:00, 13.21it/s, model.layers.22.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  98%|█████████▊| 193/196 [00:11<00:00, 12.45it/s, model.layers.22.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data:  98%|█████████▊| 193/196 [00:11<00:00, 12.45it/s, model.layers.23.mlp.gate_proj.weight_t (f16, [896,4864])]
Saving external data:  99%|█████████▉| 194/196 [00:11<00:00, 12.45it/s, model.layers.23.mlp.up_proj.weight_t (f16, [896,4864])]  
Saving external data:  99%|█████████▉| 195/196 [00:11<00:00, 12.45it/s, model.layers.23.mlp.down_proj.weight_t (f16, [4864,896])]
Saving external data: 100%|██████████| 196/196 [00:11<00:00, 12.45it/s, model.embed_tokens.weight (f16, [151936,896])]           
Saving external data: 100%|██████████| 196/196 [00:11<00:00, 17.25it/s, model.embed_tokens.weight (f16, [151936,896])]
Saved model to /datadisks/disk1/justinchu/inference-metadata-catalogue/qwen2.5-0.5b-cuda-gqa-f16/model.onnx
  inference_metadata: /datadisks/disk1/justinchu/inference-metadata-catalogue/qwen2.5-0.5b-cuda-gqa-f16/inference_metadata.yaml
  tokenizer: /datadisks/disk1/justinchu/inference-metadata-catalogue/qwen2.5-0.5b-cuda-gqa-f16/tokenizer.json
  tokenizer_config: /datadisks/disk1/justinchu/inference-metadata-catalogue/qwen2.5-0.5b-cuda-gqa-f16/tokenizer_config.json
  merges: /datadisks/disk1/justinchu/inference-metadata-catalogue/qwen2.5-0.5b-cuda-gqa-f16/merges.txt
  vocab: /datadisks/disk1/justinchu/inference-metadata-catalogue/qwen2.5-0.5b-cuda-gqa-f16/vocab.json
  chat_template: /datadisks/disk1/justinchu/inference-metadata-catalogue/qwen2.5-0.5b-cuda-gqa-f16/chat_template.jinja
elapsed=24.655 user=176.938 sys=4.878