logs/5_log.txt

Running 1 job
{
    "type": "diffusion_trainer",
    "training_folder": "/teamspace/studios/this_studio/ai-toolkit/output",
    "sqlite_db_path": "/teamspace/studios/this_studio/ai-toolkit/aitk_db.db",
    "device": "cuda",
    "trigger_word": "xtishaz1",
    "performance_log_every": 10,
    "network": {
        "type": "lora",
        "linear": 32,
        "linear_alpha": 32,
        "conv": 16,
        "conv_alpha": 16,
        "lokr_full_rank": true,
        "lokr_factor": -1,
        "network_kwargs": {
            "ignore_if_contains": []
        }
    },
    "save": {
        "dtype": "bf16",
        "save_every": 500,
        "max_step_saves_to_keep": 8,
        "save_format": "diffusers",
        "push_to_hub": false
    },
    "datasets": [
        {
            "folder_path": "/teamspace/studios/this_studio/ai-toolkit/datasets/tisha",
            "mask_path": null,
            "mask_min_value": 0.1,
            "default_caption": "Indian 18y nude girl",
            "caption_ext": "txt",
            "caption_dropout_rate": 0.05,
            "cache_latents_to_disk": false,
            "is_reg": false,
            "network_weight": 1,
            "resolution": [
                1024
            ],
            "controls": [],
            "shrink_video_to_frames": true,
            "num_frames": 1,
            "do_i2v": true,
            "flip_x": false,
            "flip_y": false
        }
    ],
    "train": {
        "batch_size": 1,
        "bypass_guidance_embedding": false,
        "steps": 3500,
        "gradient_accumulation": 1,
        "train_unet": true,
        "train_text_encoder": false,
        "gradient_checkpointing": true,
        "noise_scheduler": "flowmatch",
        "optimizer": "adamw8bit",
        "timestep_type": "weighted",
        "content_or_style": "balanced",
        "optimizer_params": {
            "weight_decay": 0.0001
        },
        "unload_text_encoder": true,
        "cache_text_embeddings": false,
        "lr": 0.0001,
        "ema_config": {
            "use_ema": false,
            "ema_decay": 0.99
        },
        "skip_first_sample": false,
        "force_first_sample": false,
        "disable_sampling": false,
        "dtype": "bf16",
        "diff_output_preservation": false,
        "diff_output_preservation_multiplier": 1,
        "diff_output_preservation_class": "person",
        "switch_boundary_every": 1,
        "loss_type": "mse",
        "do_differential_guidance": true,
        "differential_guidance_scale": 3
    },
    "model": {
        "name_or_path": "Tongyi-MAI/Z-Image-Turbo",
        "quantize": true,
        "qtype": "qfloat8",
        "quantize_te": true,
        "qtype_te": "qfloat8",
        "arch": "zimage:turbo",
        "low_vram": true,
        "model_kwargs": {},
        "layer_offloading": false,
        "layer_offloading_text_encoder_percent": 1,
        "layer_offloading_transformer_percent": 1,
        "assistant_lora_path": "ostris/zimage_turbo_training_adapter/zimage_turbo_training_adapter_v1.safetensors"
    },
    "sample": {
        "sampler": "flowmatch",
        "sample_every": 250,
        "width": 1024,
        "height": 1024,
        "samples": [
            {
                "prompt": "xtishaz1, A young nude woman with a soft oval face shape, smooth light-to-medium warm skin tone, and clear glowing complexion, large expressive almond-shaped dark brown eyes, well-defined natural eyebrows, a small straight nose, and full pink lips with a gentle smile, long straight silky black hair styled with volume at the crown (slight puffed front) flowing past the shoulders, with a youthful, fresh, and naturally elegant appearance and balanced facial symmetry, is captured in a moment of intense intimacy as she leans forward with her eyes closed in pleasure, her tongue delicately exploring the base of a man\u2019s erect penis, her head tilted back slightly, her left hand gently cradling the back of her head while her right arm rests along his torso, the man\u2019s tattooed forearm adorned with a black dagger design rests possessively on her head, his body partially visible with defined musculature and natural body hair, the scene bathed in warm, golden-orange ambient lighting that casts soft shadows and highlights the contours of their skin, the background blurred into a smooth gradient of rich amber tones with subtle bokeh lights, creating a shallow depth of field that draws focus entirely to the couple\u2019s connection, the camera positioned at a close, slightly low angle to emphasize the intimacy and raw emotion of the moment, the woman\u2019s delicate gold hoop earring and thin gold chain necklace catching the light, adding a touch of elegance to the sensual scene, the overall composition exudes a sense of passion, trust, and natural beauty, rendered in ultra-high detail with a realistic, NSFW, adult, Z-Image Turbo optimized aesthetic."
            },
            {
                "prompt": "xtishaz1, A young nude woman with a soft oval face shape, smooth light-to-medium warm skin tone, and clear glowing complexion, large expressive almond-shaped dark brown eyes, well-defined natural eyebrows, a small straight nose, and full pink lips with a gentle smile, long straight silky black hair styled with volume at the crown (slight puffed front) flowing past the shoulders, with a youthful, fresh, and naturally elegant appearance and balanced facial symmetry, is captured in a moment of intense intimacy, kneeling on a plush white quilted bed, her body arched gracefully as she leans forward, one hand resting possessively on her hip while the other is gently placed on her thigh, her skin glistening with natural moisture under the soft, diffused natural light filtering through sheer white curtains and a wooden-framed window in the background, the warm beige walls and a wicker basket subtly visible in the corner adding to the serene, private atmosphere, the camera angle is low and intimate, emphasizing the curves of her body and the sensual tension of the moment, the depth of field is shallow, blurring the background slightly to draw focus to her form and the subtle interplay of light and shadow across her skin, creating a highly detailed, realistic, NSFW, adult, Z-Image Turbo optimized scene that exudes passion, elegance, and natural beauty."
            },
            {
                "prompt": "xtishaz1, \"Photo of a nude Indian woman 21y old standing in a bedroom, facing the camera, medium wide shot, full body, black hair, dark eyes, medium breasts, slender physique, medium skin tone, brown eyes, dark eyebrows, small areola,  standing with her legs together , perfect feet, hands at her sides, perfect fingers, visible clitoris, pussy, vagina, trimmed pussy, looking at the camera, natural lighting, bright and airy room, white walls, large window with sheer           white curtains, white bed with a wooden frame, white bed linens, wooden floor, potted plant in the background, casual and relaxed pose, confident  expression, soft shadows, high quality, jpeg artifacts, no watermark, perfectly optimized for Z-Image Turbo.\""
            },
            {
                "prompt": "xtishaz1, A young nude woman with a soft oval face shape, smooth light-to-medium warm skin tone, and clear glowing complexion, large expressive almond-shaped dark brown eyes, well-defined natural eyebrows, a small straight nose, and full pink lips with a gentle smile, long straight silky black hair styled with volume at the crown (slight puffed front) flowing past the shoulders, with a youthful, fresh, and naturally elegant appearance and balanced facial symmetry, reclines provocatively atop a plush, deep purple satin couch, her legs spread wide in a bold, sensual pose that accentuates her curves and natural beauty, her tongue playfully extended in a teasing expression, the rich, velvety texture of the couch contrasting with the smooth, glistening skin of her body, the ambient lighting casting soft, warm highlights across her form, the background revealing a cozy, intimate room with a purple wall, a bookshelf filled with books and decorative items, and a vintage-style lamp casting a gentle glow, the depth of field keeps the focus sharply on her figure while softly blurring the background elements, creating a luxurious, NSFW, adult, Z-Image Turbo optimized scene that exudes confidence, allure, and raw sensuality."
            },
            {
                "prompt": "xtishaz1, A young nude woman with a soft oval face shape, smooth light-to-medium warm skin tone, and clear glowing complexion, large expressive almond-shaped dark brown eyes, well-defined natural eyebrows, a small straight nose, and full pink lips with a gentle smile, long straight silky black hair styled with volume at the crown (slight puffed front) flowing past the shoulders, with a youthful, fresh, and naturally elegant appearance and balanced facial symmetry, kneels gracefully on gray tiled bathroom floor in a poised, slightly arched position, her body glistening with subtle sheen under soft, diffused ambient lighting that highlights the natural curves and contours of her torso, hips, and thighs, her left hand resting gently on her inner thigh while her right hand lightly touches her knee, her gaze directed confidently toward the viewer with an air of serene sensuality, behind her, a pristine white ceramic toilet stands against a backdrop of muted gray wall tiles with clean, minimalist grout lines, the scene framed by a slightly elevated camera angle that captures the full length of her form from mid-thighs upward, creating a sense of depth and intimacy, the shallow depth of field softly blurs the background elements while keeping her figure sharply in focus, evoking a quiet, private moment of vulnerability and elegance within a modern, sterile bathroom environment, the overall composition exudes a natural, unposed beauty with a touch of NSFW allure, rendered in ultra-high detail with realistic textures and lighting, optimized for Z-Image Turbo."
            }
        ],
        "neg": "",
        "seed": 42,
        "walk_seed": true,
        "guidance_scale": 1,
        "sample_steps": 8,
        "num_frames": 1,
        "fps": 1
    },
    "logging": {
        "log_every": 1,
        "use_ui_logger": true
    }
}
Using SQLite database at /teamspace/studios/this_studio/ai-toolkit/aitk_db.db
Job ID: "f7eb6cbb-a54a-4f3a-92b0-66455621336c"

#############################################
# Running job: my_first_lora_v6
#############################################


Running  1 process
Loading ZImage model
Loading transformer

Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards:  33%|###3      | 1/3 [00:00<00:01,  1.06it/s]
Loading checkpoint shards:  33%|###3      | 1/3 [00:00<00:01,  1.06it/s]
Loading checkpoint shards:  67%|######6   | 2/3 [00:01<00:00,  1.10it/s]
Loading checkpoint shards:  67%|######6   | 2/3 [00:01<00:00,  1.10it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:02<00:00,  1.47it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:02<00:00,  1.47it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:02<00:00,  1.34it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:02<00:00,  1.34it/s]

Loading assistant LoRA
create LoRA network. base dim (rank): 32, alpha: 32
neuron dropout: p=None, rank dropout: p=None, module dropout: p=None
create LoRA for Text Encoder: 0 modules.
create LoRA for U-Net: 276 modules.
enable LoRA for U-Net
Merging in assistant LoRA
Missing keys: []
Quantizing Transformer
 - quantizing 30 transformer blocks

  0%|          | 0/30 [00:00<?, ?it/s]
  0%|          | 0/30 [00:00<?, ?it/s]
  3%|3         | 1/30 [00:00<00:04,  6.55it/s]
  3%|3         | 1/30 [00:00<00:04,  6.55it/s]
  7%|6         | 2/30 [00:00<00:03,  7.68it/s]
  7%|6         | 2/30 [00:00<00:03,  7.68it/s]
 10%|#         | 3/30 [00:00<00:03,  8.14it/s]
 10%|#         | 3/30 [00:00<00:03,  8.14it/s]
 13%|#3        | 4/30 [00:00<00:03,  8.40it/s]
 13%|#3        | 4/30 [00:00<00:03,  8.40it/s]
 17%|#6        | 5/30 [00:00<00:02,  8.55it/s]
 17%|#6        | 5/30 [00:00<00:02,  8.55it/s]
 20%|##        | 6/30 [00:00<00:02,  8.63it/s]
 20%|##        | 6/30 [00:00<00:02,  8.63it/s]
 23%|##3       | 7/30 [00:00<00:02,  8.70it/s]
 23%|##3       | 7/30 [00:00<00:02,  8.70it/s]
 27%|##6       | 8/30 [00:00<00:02,  8.75it/s]
 27%|##6       | 8/30 [00:00<00:02,  8.75it/s]
 30%|###       | 9/30 [00:01<00:02,  8.54it/s]
 30%|###       | 9/30 [00:01<00:02,  8.54it/s]
 33%|###3      | 10/30 [00:01<00:02,  8.55it/s]
 33%|###3      | 10/30 [00:01<00:02,  8.55it/s]
 37%|###6      | 11/30 [00:01<00:02,  8.59it/s]
 37%|###6      | 11/30 [00:01<00:02,  8.59it/s]
 40%|####      | 12/30 [00:01<00:02,  8.61it/s]
 40%|####      | 12/30 [00:01<00:02,  8.61it/s]
 43%|####3     | 13/30 [00:01<00:01,  8.70it/s]
 43%|####3     | 13/30 [00:01<00:01,  8.70it/s]
 47%|####6     | 14/30 [00:01<00:01,  8.77it/s]
 47%|####6     | 14/30 [00:01<00:01,  8.77it/s]
 50%|#####     | 15/30 [00:01<00:01,  8.75it/s]
 50%|#####     | 15/30 [00:01<00:01,  8.75it/s]
 53%|#####3    | 16/30 [00:01<00:01,  8.74it/s]
 53%|#####3    | 16/30 [00:01<00:01,  8.74it/s]
 57%|#####6    | 17/30 [00:01<00:01,  8.62it/s]
 57%|#####6    | 17/30 [00:01<00:01,  8.62it/s]
 60%|######    | 18/30 [00:02<00:01,  8.48it/s]
 60%|######    | 18/30 [00:02<00:01,  8.48it/s]
 63%|######3   | 19/30 [00:02<00:01,  8.56it/s]
 63%|######3   | 19/30 [00:02<00:01,  8.56it/s]
 70%|#######   | 21/30 [00:02<00:01,  8.96it/s]
 70%|#######   | 21/30 [00:02<00:01,  8.96it/s]
 73%|#######3  | 22/30 [00:02<00:00,  8.92it/s]
 73%|#######3  | 22/30 [00:02<00:00,  8.92it/s]
 77%|#######6  | 23/30 [00:02<00:00,  8.89it/s]
 77%|#######6  | 23/30 [00:02<00:00,  8.89it/s]
 80%|########  | 24/30 [00:02<00:00,  8.85it/s]
 80%|########  | 24/30 [00:02<00:00,  8.85it/s]
 83%|########3 | 25/30 [00:02<00:00,  8.82it/s]
 83%|########3 | 25/30 [00:02<00:00,  8.82it/s]
 87%|########6 | 26/30 [00:03<00:00,  8.61it/s]
 87%|########6 | 26/30 [00:03<00:00,  8.61it/s]
 90%|######### | 27/30 [00:03<00:00,  8.81it/s]
 90%|######### | 27/30 [00:03<00:00,  8.81it/s]
 93%|#########3| 28/30 [00:03<00:00,  8.78it/s]
 93%|#########3| 28/30 [00:03<00:00,  8.78it/s]
 97%|#########6| 29/30 [00:03<00:00,  8.75it/s]
 97%|#########6| 29/30 [00:03<00:00,  8.75it/s]
100%|##########| 30/30 [00:03<00:00,  8.77it/s]
100%|##########| 30/30 [00:03<00:00,  8.77it/s]
100%|##########| 30/30 [00:03<00:00,  8.65it/s]
100%|##########| 30/30 [00:03<00:00,  8.65it/s]

 - quantizing extras
Moving transformer to CPU
Text Encoder
`torch_dtype` is deprecated! Use `dtype` instead!
`torch_dtype` is deprecated! Use `dtype` instead!

Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards:   0%|          | 0/3 [00:00<?, ?it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:00<00:00, 62.98it/s]
Loading checkpoint shards: 100%|##########| 3/3 [00:00<00:00, 62.98it/s]

Quantizing Text Encoder
Loading VAE
Making pipe
Preparing Model
Model Loaded
create LoRA network. base dim (rank): 32, alpha: 32
neuron dropout: p=None, rank dropout: p=None, module dropout: p=None
apply LoRA to Conv2d with kernel size (3,3). dim (rank): 16, alpha: 16
create LoRA for Text Encoder: 0 modules.
create LoRA for U-Net: 240 modules.
enable LoRA for U-Net
#### IMPORTANT RESUMING FROM /teamspace/studios/this_studio/ai-toolkit/output/my_first_lora_v6/my_first_lora_v6_000002000.safetensors ####
Loading from /teamspace/studios/this_studio/ai-toolkit/output/my_first_lora_v6/my_first_lora_v6_000002000.safetensors
Missing keys: []
Found step 2000 in metadata, starting from there
Loading optimizer state from /teamspace/studios/this_studio/ai-toolkit/output/my_first_lora_v6/optimizer.pt
Updating optimizer LR from params
Dataset: /teamspace/studios/this_studio/ai-toolkit/datasets/tisha
  -  Preprocessing image dimensions

  0%|          | 0/9 [00:00<?, ?it/s]
  0%|          | 0/9 [00:00<?, ?it/s]
100%|##########| 9/9 [00:00<00:00, 23937.06it/s]
100%|##########| 9/9 [00:00<00:00, 23937.06it/s]

  -  Found 9 images
Bucket sizes for /teamspace/studios/this_studio/ai-toolkit/datasets/tisha:
832x1152: 4 files
896x1152: 1 files
512x832: 2 files
864x864: 1 files
768x1056: 1 files
5 buckets made
Caching embeddings and unloading text encoder

***** UNLOADING TEXT ENCODER *****
This will train only with a blank prompt or trigger word, if set
If this is not what you want, remove the unload_text_encoder flag
***********************************


my_first_lora_v6:  57%|#####7    | 2000/3500 [00:00<?, ?it/s]
my_first_lora_v6:  57%|#####7    | 2000/3500 [00:00<?, ?it/s]
my_first_lora_v6:  57%|#####7    | 2000/3500 [00:03<?, ?it/s, lr: 1.0e-04 loss: 7.648e-01]
my_first_lora_v6:  57%|#####7    | 2000/3500 [00:03<?, ?it/s, lr: 1.0e-04 loss: 7.648e-01]
my_first_lora_v6:  57%|#####7    | 2000/3500 [00:03<?, ?it/s, lr: 1.0e-04 loss: 7.648e-01]
my_first_lora_v6:  57%|#####7    | 2000/3500 [00:03<?, ?it/s, lr: 1.0e-04 loss: 7.648e-01]
my_first_lora_v6:  57%|#####7    | 2000/3500 [00:05<?, ?it/s, lr: 1.0e-04 loss: 5.598e-01]
my_first_lora_v6:  57%|#####7    | 2000/3500 [00:05<?, ?it/s, lr: 1.0e-04 loss: 5.598e-01]
my_first_lora_v6:  57%|#####7    | 2001/3500 [00:08<3:25:44,  8.24s/it, lr: 1.0e-04 loss: 7.892e-01]
my_first_lora_v6:  57%|#####7    | 2001/3500 [00:08<3:25:44,  8.24s/it, lr: 1.0e-04 loss: 7.892e-01]
my_first_lora_v6:  57%|#####7    | 2002/3500 [00:10<2:07:42,  5.11s/it, lr: 1.0e-04 loss: 3.643e-01]
my_first_lora_v6:  57%|#####7    | 2002/3500 [00:10<2:07:42,  5.11s/it, lr: 1.0e-04 loss: 3.643e-01]
my_first_lora_v6:  57%|#####7    | 2003/3500 [00:12<1:40:05,  4.01s/it, lr: 1.0e-04 loss: 1.997e-01]
my_first_lora_v6:  57%|#####7    | 2003/3500 [00:12<1:40:05,  4.01s/it, lr: 1.0e-04 loss: 1.997e-01]
my_first_lora_v6:  57%|#####7    | 2004/3500 [00:13<1:21:22,  3.26s/it, lr: 1.0e-04 loss: 5.888e-01]
my_first_lora_v6:  57%|#####7    | 2004/3500 [00:13<1:21:22,  3.26s/it, lr: 1.0e-04 loss: 5.888e-01]
my_first_lora_v6:  57%|#####7    | 2005/3500 [00:15<1:17:09,  3.10s/it, lr: 1.0e-04 loss: 7.245e-01]
my_first_lora_v6:  57%|#####7    | 2005/3500 [00:15<1:17:09,  3.10s/it, lr: 1.0e-04 loss: 7.245e-01]
my_first_lora_v6:  57%|#####7    | 2006/3500 [00:16<1:08:22,  2.75s/it, lr: 1.0e-04 loss: 8.414e-01]
my_first_lora_v6:  57%|#####7    | 2006/3500 [00:16<1:08:22,  2.75s/it, lr: 1.0e-04 loss: 8.414e-01]
my_first_lora_v6:  57%|#####7    | 2007/3500 [00:18<1:07:11,  2.70s/it, lr: 1.0e-04 loss: 9.988e-02]
my_first_lora_v6:  57%|#####7    | 2007/3500 [00:18<1:07:11,  2.70s/it, lr: 1.0e-04 loss: 9.988e-02]
my_first_lora_v6:  57%|#####7    | 2008/3500 [00:20<1:04:58,  2.61s/it, lr: 1.0e-04 loss: 2.664e-01]
my_first_lora_v6:  57%|#####7    | 2008/3500 [00:20<1:04:58,  2.61s/it, lr: 1.0e-04 loss: 2.664e-01]
my_first_lora_v6:  57%|#####7    | 2009/3500 [00:22<1:03:05,  2.54s/it, lr: 1.0e-04 loss: 4.369e-01]
my_first_lora_v6:  57%|#####7    | 2009/3500 [00:22<1:03:05,  2.54s/it, lr: 1.0e-04 loss: 4.369e-01]
my_first_lora_v6:  57%|#####7    | 2010/3500 [00:23<59:11,  2.38s/it, lr: 1.0e-04 loss: 2.563e-01]  
my_first_lora_v6:  57%|#####7    | 2010/3500 [00:23<59:11,  2.38s/it, lr: 1.0e-04 loss: 2.563e-01]  
my_first_lora_v6:  57%|#####7    | 2011/3500 [00:26<59:16,  2.39s/it, lr: 1.0e-04 loss: 6.583e-01]
my_first_lora_v6:  57%|#####7    | 2011/3500 [00:26<59:16,  2.39s/it, lr: 1.0e-04 loss: 6.583e-01]
my_first_lora_v6:  57%|#####7    | 2012/3500 [00:28<59:20,  2.39s/it, lr: 1.0e-04 loss: 6.865e-01]
my_first_lora_v6:  57%|#####7    | 2012/3500 [00:28<59:20,  2.39s/it, lr: 1.0e-04 loss: 6.865e-01]
my_first_lora_v6:  58%|#####7    | 2013/3500 [00:31<59:22,  2.40s/it, lr: 1.0e-04 loss: 6.496e-01]
my_first_lora_v6:  58%|#####7    | 2013/3500 [00:31<59:22,  2.40s/it, lr: 1.0e-04 loss: 6.496e-01]
my_first_lora_v6:  58%|#####7    | 2014/3500 [00:33<59:51,  2.42s/it, lr: 1.0e-04 loss: 2.771e-01]
my_first_lora_v6:  58%|#####7    | 2014/3500 [00:33<59:51,  2.42s/it, lr: 1.0e-04 loss: 2.771e-01]
my_first_lora_v6:  58%|#####7    | 2015/3500 [00:36<1:00:17,  2.44s/it, lr: 1.0e-04 loss: 2.106e-01]
my_first_lora_v6:  58%|#####7    | 2015/3500 [00:36<1:00:17,  2.44s/it, lr: 1.0e-04 loss: 2.106e-01]
my_first_lora_v6:  58%|#####7    | 2016/3500 [00:37<58:02,  2.35s/it, lr: 1.0e-04 loss: 6.712e-01]  
my_first_lora_v6:  58%|#####7    | 2016/3500 [00:37<58:02,  2.35s/it, lr: 1.0e-04 loss: 6.712e-01]  
my_first_lora_v6:  58%|#####7    | 2017/3500 [00:40<58:26,  2.36s/it, lr: 1.0e-04 loss: 7.258e-01]
my_first_lora_v6:  58%|#####7    | 2017/3500 [00:40<58:26,  2.36s/it, lr: 1.0e-04 loss: 7.258e-01]
my_first_lora_v6:  58%|#####7    | 2018/3500 [00:41<56:36,  2.29s/it, lr: 1.0e-04 loss: 4.462e-01]
my_first_lora_v6:  58%|#####7    | 2018/3500 [00:41<56:36,  2.29s/it, lr: 1.0e-04 loss: 4.462e-01]
my_first_lora_v6:  58%|#####7    | 2019/3500 [00:43<57:04,  2.31s/it, lr: 1.0e-04 loss: 7.010e-01]
my_first_lora_v6:  58%|#####7    | 2019/3500 [00:43<57:04,  2.31s/it, lr: 1.0e-04 loss: 7.010e-01]
my_first_lora_v6:  58%|#####7    | 2020/3500 [00:46<57:13,  2.32s/it, lr: 1.0e-04 loss: 5.350e-01]
my_first_lora_v6:  58%|#####7    | 2020/3500 [00:46<57:13,  2.32s/it, lr: 1.0e-04 loss: 5.350e-01]
my_first_lora_v6:  58%|#####7    | 2021/3500 [00:48<57:19,  2.33s/it, lr: 1.0e-04 loss: 2.820e-01]
my_first_lora_v6:  58%|#####7    | 2021/3500 [00:48<57:19,  2.33s/it, lr: 1.0e-04 loss: 2.820e-01]
my_first_lora_v6:  58%|#####7    | 2022/3500 [00:50<56:41,  2.30s/it, lr: 1.0e-04 loss: 5.319e-01]
my_first_lora_v6:  58%|#####7    | 2022/3500 [00:50<56:41,  2.30s/it, lr: 1.0e-04 loss: 5.319e-01]
my_first_lora_v6:  58%|#####7    | 2023/3500 [00:51<55:14,  2.24s/it, lr: 1.0e-04 loss: 8.155e-01]
my_first_lora_v6:  58%|#####7    | 2023/3500 [00:51<55:14,  2.24s/it, lr: 1.0e-04 loss: 8.155e-01]
my_first_lora_v6:  58%|#####7    | 2024/3500 [00:54<55:23,  2.25s/it, lr: 1.0e-04 loss: 3.141e-01]
my_first_lora_v6:  58%|#####7    | 2024/3500 [00:54<55:23,  2.25s/it, lr: 1.0e-04 loss: 3.141e-01]
my_first_lora_v6:  58%|#####7    | 2025/3500 [00:55<55:02,  2.24s/it, lr: 1.0e-04 loss: 3.497e-01]
my_first_lora_v6:  58%|#####7    | 2025/3500 [00:55<55:02,  2.24s/it, lr: 1.0e-04 loss: 3.497e-01]
my_first_lora_v6:  58%|#####7    | 2026/3500 [00:57<54:00,  2.20s/it, lr: 1.0e-04 loss: 8.462e-01]
my_first_lora_v6:  58%|#####7    | 2026/3500 [00:57<54:00,  2.20s/it, lr: 1.0e-04 loss: 8.462e-01]
my_first_lora_v6:  58%|#####7    | 2027/3500 [00:59<54:11,  2.21s/it, lr: 1.0e-04 loss: 1.568e-01]
my_first_lora_v6:  58%|#####7    | 2027/3500 [00:59<54:11,  2.21s/it, lr: 1.0e-04 loss: 1.568e-01]
my_first_lora_v6:  58%|#####7    | 2028/3500 [01:01<54:08,  2.21s/it, lr: 1.0e-04 loss: 4.646e-01]
my_first_lora_v6:  58%|#####7    | 2028/3500 [01:01<54:08,  2.21s/it, lr: 1.0e-04 loss: 4.646e-01]
my_first_lora_v6:  58%|#####7    | 2029/3500 [01:04<54:17,  2.21s/it, lr: 1.0e-04 loss: 5.797e-01]
my_first_lora_v6:  58%|#####7    | 2029/3500 [01:04<54:17,  2.21s/it, lr: 1.0e-04 loss: 5.797e-01]
my_first_lora_v6:  58%|#####8    | 2030/3500 [01:06<54:26,  2.22s/it, lr: 1.0e-04 loss: 4.089e-01]
my_first_lora_v6:  58%|#####8    | 2030/3500 [01:06<54:26,  2.22s/it, lr: 1.0e-04 loss: 4.089e-01]
my_first_lora_v6:  58%|#####8    | 2031/3500 [01:09<54:35,  2.23s/it, lr: 1.0e-04 loss: 3.572e-01]
my_first_lora_v6:  58%|#####8    | 2031/3500 [01:09<54:35,  2.23s/it, lr: 1.0e-04 loss: 3.572e-01]
my_first_lora_v6:  58%|#####8    | 2032/3500 [01:10<53:36,  2.19s/it, lr: 1.0e-04 loss: 7.819e-01]
my_first_lora_v6:  58%|#####8    | 2032/3500 [01:10<53:36,  2.19s/it, lr: 1.0e-04 loss: 7.819e-01]
my_first_lora_v6:  58%|#####8    | 2033/3500 [01:12<53:24,  2.18s/it, lr: 1.0e-04 loss: 3.206e-01]
my_first_lora_v6:  58%|#####8    | 2033/3500 [01:12<53:24,  2.18s/it, lr: 1.0e-04 loss: 3.206e-01]
my_first_lora_v6:  58%|#####8    | 2034/3500 [01:14<53:45,  2.20s/it, lr: 1.0e-04 loss: 7.582e-01]
my_first_lora_v6:  58%|#####8    | 2034/3500 [01:14<53:45,  2.20s/it, lr: 1.0e-04 loss: 7.582e-01]
my_first_lora_v6:  58%|#####8    | 2035/3500 [01:16<53:35,  2.19s/it, lr: 1.0e-04 loss: 6.565e-02]
my_first_lora_v6:  58%|#####8    | 2035/3500 [01:16<53:35,  2.19s/it, lr: 1.0e-04 loss: 6.565e-02]
my_first_lora_v6:  58%|#####8    | 2036/3500 [01:19<53:52,  2.21s/it, lr: 1.0e-04 loss: 4.684e-01]
my_first_lora_v6:  58%|#####8    | 2036/3500 [01:19<53:52,  2.21s/it, lr: 1.0e-04 loss: 4.684e-01]
my_first_lora_v6:  58%|#####8    | 2037/3500 [01:21<53:41,  2.20s/it, lr: 1.0e-04 loss: 8.570e-02]
my_first_lora_v6:  58%|#####8    | 2037/3500 [01:21<53:41,  2.20s/it, lr: 1.0e-04 loss: 8.570e-02]
my_first_lora_v6:  58%|#####8    | 2038/3500 [01:23<53:50,  2.21s/it, lr: 1.0e-04 loss: 1.033e-01]
my_first_lora_v6:  58%|#####8    | 2038/3500 [01:23<53:50,  2.21s/it, lr: 1.0e-04 loss: 1.033e-01]
my_first_lora_v6:  58%|#####8    | 2039/3500 [01:26<53:57,  2.22s/it, lr: 1.0e-04 loss: 7.253e-01]
my_first_lora_v6:  58%|#####8    | 2039/3500 [01:26<53:57,  2.22s/it, lr: 1.0e-04 loss: 7.253e-01]
my_first_lora_v6:  58%|#####8    | 2040/3500 [01:28<54:04,  2.22s/it, lr: 1.0e-04 loss: 5.856e-01]
my_first_lora_v6:  58%|#####8    | 2040/3500 [01:28<54:04,  2.22s/it, lr: 1.0e-04 loss: 5.856e-01]
my_first_lora_v6:  58%|#####8    | 2041/3500 [01:31<54:11,  2.23s/it, lr: 1.0e-04 loss: 2.249e-01]
my_first_lora_v6:  58%|#####8    | 2041/3500 [01:31<54:11,  2.23s/it, lr: 1.0e-04 loss: 2.249e-01]
my_first_lora_v6:  58%|#####8    | 2042/3500 [01:32<53:37,  2.21s/it, lr: 1.0e-04 loss: 7.985e-01]
my_first_lora_v6:  58%|#####8    | 2042/3500 [01:32<53:37,  2.21s/it, lr: 1.0e-04 loss: 7.985e-01]
my_first_lora_v6:  58%|#####8    | 2043/3500 [01:33<52:55,  2.18s/it, lr: 1.0e-04 loss: 8.261e-01]
my_first_lora_v6:  58%|#####8    | 2043/3500 [01:33<52:55,  2.18s/it, lr: 1.0e-04 loss: 8.261e-01]
my_first_lora_v6:  58%|#####8    | 2044/3500 [01:35<52:48,  2.18s/it, lr: 1.0e-04 loss: 1.388e-01]
my_first_lora_v6:  58%|#####8    | 2044/3500 [01:35<52:48,  2.18s/it, lr: 1.0e-04 loss: 1.388e-01]
my_first_lora_v6:  58%|#####8    | 2045/3500 [01:38<52:55,  2.18s/it, lr: 1.0e-04 loss: 8.343e-01]
my_first_lora_v6:  58%|#####8    | 2045/3500 [01:38<52:55,  2.18s/it, lr: 1.0e-04 loss: 8.343e-01]
my_first_lora_v6:  58%|#####8    | 2046/3500 [01:40<53:02,  2.19s/it, lr: 1.0e-04 loss: 7.235e-01]
my_first_lora_v6:  58%|#####8    | 2046/3500 [01:40<53:02,  2.19s/it, lr: 1.0e-04 loss: 7.235e-01]
my_first_lora_v6:  58%|#####8    | 2047/3500 [01:41<52:23,  2.16s/it, lr: 1.0e-04 loss: 8.106e-01]
my_first_lora_v6:  58%|#####8    | 2047/3500 [01:41<52:23,  2.16s/it, lr: 1.0e-04 loss: 8.106e-01]
my_first_lora_v6:  59%|#####8    | 2048/3500 [01:44<52:38,  2.17s/it, lr: 1.0e-04 loss: 7.667e-01]
my_first_lora_v6:  59%|#####8    | 2048/3500 [01:44<52:38,  2.17s/it, lr: 1.0e-04 loss: 7.667e-01]
my_first_lora_v6:  59%|#####8    | 2049/3500 [01:46<52:30,  2.17s/it, lr: 1.0e-04 loss: 7.024e-01]
my_first_lora_v6:  59%|#####8    | 2049/3500 [01:46<52:30,  2.17s/it, lr: 1.0e-04 loss: 7.024e-01]
my_first_lora_v6:  59%|#####8    | 2050/3500 [01:48<52:37,  2.18s/it, lr: 1.0e-04 loss: 7.098e-01]
my_first_lora_v6:  59%|#####8    | 2050/3500 [01:48<52:37,  2.18s/it, lr: 1.0e-04 loss: 7.098e-01]
my_first_lora_v6:  59%|#####8    | 2051/3500 [01:51<52:44,  2.18s/it, lr: 1.0e-04 loss: 3.946e-01]
my_first_lora_v6:  59%|#####8    | 2051/3500 [01:51<52:44,  2.18s/it, lr: 1.0e-04 loss: 3.946e-01]
my_first_lora_v6:  59%|#####8    | 2052/3500 [01:52<52:09,  2.16s/it, lr: 1.0e-04 loss: 3.357e-01]
my_first_lora_v6:  59%|#####8    | 2052/3500 [01:52<52:09,  2.16s/it, lr: 1.0e-04 loss: 3.357e-01]
my_first_lora_v6:  59%|#####8    | 2053/3500 [01:53<51:41,  2.14s/it, lr: 1.0e-04 loss: 2.998e-01]
my_first_lora_v6:  59%|#####8    | 2053/3500 [01:53<51:41,  2.14s/it, lr: 1.0e-04 loss: 2.998e-01]
my_first_lora_v6:  59%|#####8    | 2054/3500 [01:55<51:31,  2.14s/it, lr: 1.0e-04 loss: 5.258e-01]
my_first_lora_v6:  59%|#####8    | 2054/3500 [01:55<51:31,  2.14s/it, lr: 1.0e-04 loss: 5.258e-01]
my_first_lora_v6:  59%|#####8    | 2055/3500 [01:57<51:38,  2.14s/it, lr: 1.0e-04 loss: 7.878e-01]
my_first_lora_v6:  59%|#####8    | 2055/3500 [01:57<51:38,  2.14s/it, lr: 1.0e-04 loss: 7.878e-01]
my_first_lora_v6:  59%|#####8    | 2056/3500 [02:00<51:45,  2.15s/it, lr: 1.0e-04 loss: 3.997e-01]
my_first_lora_v6:  59%|#####8    | 2056/3500 [02:00<51:45,  2.15s/it, lr: 1.0e-04 loss: 3.997e-01]
my_first_lora_v6:  59%|#####8    | 2057/3500 [02:01<51:23,  2.14s/it, lr: 1.0e-04 loss: 1.380e-01]
my_first_lora_v6:  59%|#####8    | 2057/3500 [02:01<51:23,  2.14s/it, lr: 1.0e-04 loss: 1.380e-01]
my_first_lora_v6:  59%|#####8    | 2058/3500 [02:04<51:36,  2.15s/it, lr: 1.0e-04 loss: 4.649e-01]
my_first_lora_v6:  59%|#####8    | 2058/3500 [02:04<51:36,  2.15s/it, lr: 1.0e-04 loss: 4.649e-01]
my_first_lora_v6:  59%|#####8    | 2059/3500 [02:07<51:42,  2.15s/it, lr: 1.0e-04 loss: 1.216e-01]
my_first_lora_v6:  59%|#####8    | 2059/3500 [02:07<51:42,  2.15s/it, lr: 1.0e-04 loss: 1.216e-01]
my_first_lora_v6:  59%|#####8    | 2060/3500 [02:09<51:36,  2.15s/it, lr: 1.0e-04 loss: 8.167e-01]
my_first_lora_v6:  59%|#####8    | 2060/3500 [02:09<51:36,  2.15s/it, lr: 1.0e-04 loss: 8.167e-01]
my_first_lora_v6:  59%|#####8    | 2061/3500 [02:11<51:42,  2.16s/it, lr: 1.0e-04 loss: 3.547e-01]
my_first_lora_v6:  59%|#####8    | 2061/3500 [02:11<51:42,  2.16s/it, lr: 1.0e-04 loss: 3.547e-01]
my_first_lora_v6:  59%|#####8    | 2062/3500 [02:14<51:52,  2.16s/it, lr: 1.0e-04 loss: 1.073e-01]
my_first_lora_v6:  59%|#####8    | 2062/3500 [02:14<51:52,  2.16s/it, lr: 1.0e-04 loss: 1.073e-01]
my_first_lora_v6:  59%|#####8    | 2063/3500 [02:16<51:46,  2.16s/it, lr: 1.0e-04 loss: 1.103e-01]
my_first_lora_v6:  59%|#####8    | 2063/3500 [02:16<51:46,  2.16s/it, lr: 1.0e-04 loss: 1.103e-01]
my_first_lora_v6:  59%|#####8    | 2064/3500 [02:17<51:18,  2.14s/it, lr: 1.0e-04 loss: 5.240e-01]
my_first_lora_v6:  59%|#####8    | 2064/3500 [02:17<51:18,  2.14s/it, lr: 1.0e-04 loss: 5.240e-01]
my_first_lora_v6:  59%|#####8    | 2065/3500 [02:19<51:23,  2.15s/it, lr: 1.0e-04 loss: 7.774e-01]
my_first_lora_v6:  59%|#####8    | 2065/3500 [02:19<51:23,  2.15s/it, lr: 1.0e-04 loss: 7.774e-01]
my_first_lora_v6:  59%|#####9    | 2066/3500 [02:22<51:34,  2.16s/it, lr: 1.0e-04 loss: 4.413e-01]
my_first_lora_v6:  59%|#####9    | 2066/3500 [02:22<51:34,  2.16s/it, lr: 1.0e-04 loss: 4.413e-01]
my_first_lora_v6:  59%|#####9    | 2067/3500 [02:24<51:25,  2.15s/it, lr: 1.0e-04 loss: 2.586e-01]
my_first_lora_v6:  59%|#####9    | 2067/3500 [02:24<51:25,  2.15s/it, lr: 1.0e-04 loss: 2.586e-01]
my_first_lora_v6:  59%|#####9    | 2068/3500 [02:26<51:29,  2.16s/it, lr: 1.0e-04 loss: 7.920e-01]
my_first_lora_v6:  59%|#####9    | 2068/3500 [02:26<51:29,  2.16s/it, lr: 1.0e-04 loss: 7.920e-01]
my_first_lora_v6:  59%|#####9    | 2069/3500 [02:27<51:04,  2.14s/it, lr: 1.0e-04 loss: 7.470e-01]
my_first_lora_v6:  59%|#####9    | 2069/3500 [02:27<51:04,  2.14s/it, lr: 1.0e-04 loss: 7.470e-01]
my_first_lora_v6:  59%|#####9    | 2070/3500 [02:30<51:08,  2.15s/it, lr: 1.0e-04 loss: 1.856e-01]
my_first_lora_v6:  59%|#####9    | 2070/3500 [02:30<51:08,  2.15s/it, lr: 1.0e-04 loss: 1.856e-01]
my_first_lora_v6:  59%|#####9    | 2071/3500 [02:31<50:47,  2.13s/it, lr: 1.0e-04 loss: 7.891e-01]
my_first_lora_v6:  59%|#####9    | 2071/3500 [02:31<50:47,  2.13s/it, lr: 1.0e-04 loss: 7.891e-01]
my_first_lora_v6:  59%|#####9    | 2072/3500 [02:34<50:57,  2.14s/it, lr: 1.0e-04 loss: 7.194e-01]
my_first_lora_v6:  59%|#####9    | 2072/3500 [02:34<50:57,  2.14s/it, lr: 1.0e-04 loss: 7.194e-01]
my_first_lora_v6:  59%|#####9    | 2073/3500 [02:35<50:33,  2.13s/it, lr: 1.0e-04 loss: 7.382e-01]
my_first_lora_v6:  59%|#####9    | 2073/3500 [02:35<50:33,  2.13s/it, lr: 1.0e-04 loss: 7.382e-01]
my_first_lora_v6:  59%|#####9    | 2074/3500 [02:37<50:28,  2.12s/it, lr: 1.0e-04 loss: 8.222e-01]
my_first_lora_v6:  59%|#####9    | 2074/3500 [02:37<50:28,  2.12s/it, lr: 1.0e-04 loss: 8.222e-01]
my_first_lora_v6:  59%|#####9    | 2075/3500 [02:38<50:20,  2.12s/it, lr: 1.0e-04 loss: 1.176e-01]
my_first_lora_v6:  59%|#####9    | 2075/3500 [02:38<50:20,  2.12s/it, lr: 1.0e-04 loss: 1.176e-01]
my_first_lora_v6:  59%|#####9    | 2076/3500 [02:41<50:24,  2.12s/it, lr: 1.0e-04 loss: 7.349e-01]
my_first_lora_v6:  59%|#####9    | 2076/3500 [02:41<50:24,  2.12s/it, lr: 1.0e-04 loss: 7.349e-01]
my_first_lora_v6:  59%|#####9    | 2077/3500 [02:43<50:29,  2.13s/it, lr: 1.0e-04 loss: 4.717e-01]
my_first_lora_v6:  59%|#####9    | 2077/3500 [02:43<50:29,  2.13s/it, lr: 1.0e-04 loss: 4.717e-01]
my_first_lora_v6:  59%|#####9    | 2078/3500 [02:46<50:37,  2.14s/it, lr: 1.0e-04 loss: 1.567e-01]
my_first_lora_v6:  59%|#####9    | 2078/3500 [02:46<50:37,  2.14s/it, lr: 1.0e-04 loss: 1.567e-01]
my_first_lora_v6:  59%|#####9    | 2079/3500 [02:49<50:41,  2.14s/it, lr: 1.0e-04 loss: 2.199e-01]
my_first_lora_v6:  59%|#####9    | 2079/3500 [02:49<50:41,  2.14s/it, lr: 1.0e-04 loss: 2.199e-01]
my_first_lora_v6:  59%|#####9    | 2080/3500 [02:51<50:48,  2.15s/it, lr: 1.0e-04 loss: 7.206e-02]
my_first_lora_v6:  59%|#####9    | 2080/3500 [02:51<50:48,  2.15s/it, lr: 1.0e-04 loss: 7.206e-02]
my_first_lora_v6:  59%|#####9    | 2081/3500 [02:54<50:52,  2.15s/it, lr: 1.0e-04 loss: 7.788e-01]
my_first_lora_v6:  59%|#####9    | 2081/3500 [02:54<50:52,  2.15s/it, lr: 1.0e-04 loss: 7.788e-01]
my_first_lora_v6:  59%|#####9    | 2082/3500 [02:55<50:30,  2.14s/it, lr: 1.0e-04 loss: 5.137e-02]
my_first_lora_v6:  59%|#####9    | 2082/3500 [02:55<50:30,  2.14s/it, lr: 1.0e-04 loss: 5.137e-02]
my_first_lora_v6:  60%|#####9    | 2083/3500 [02:57<50:25,  2.14s/it, lr: 1.0e-04 loss: 1.863e-01]
my_first_lora_v6:  60%|#####9    | 2083/3500 [02:57<50:25,  2.14s/it, lr: 1.0e-04 loss: 1.863e-01]
my_first_lora_v6:  60%|#####9    | 2084/3500 [02:58<50:04,  2.12s/it, lr: 1.0e-04 loss: 5.915e-01]
my_first_lora_v6:  60%|#####9    | 2084/3500 [02:58<50:04,  2.12s/it, lr: 1.0e-04 loss: 5.915e-01]
my_first_lora_v6:  60%|#####9    | 2085/3500 [03:00<50:12,  2.13s/it, lr: 1.0e-04 loss: 3.124e-01]
my_first_lora_v6:  60%|#####9    | 2085/3500 [03:00<50:12,  2.13s/it, lr: 1.0e-04 loss: 3.124e-01]
my_first_lora_v6:  60%|#####9    | 2086/3500 [03:03<50:09,  2.13s/it, lr: 1.0e-04 loss: 2.020e-01]
my_first_lora_v6:  60%|#####9    | 2086/3500 [03:03<50:09,  2.13s/it, lr: 1.0e-04 loss: 2.020e-01]
my_first_lora_v6:  60%|#####9    | 2087/3500 [03:05<50:12,  2.13s/it, lr: 1.0e-04 loss: 5.274e-02]
my_first_lora_v6:  60%|#####9    | 2087/3500 [03:05<50:12,  2.13s/it, lr: 1.0e-04 loss: 5.274e-02]
my_first_lora_v6:  60%|#####9    | 2088/3500 [03:07<50:15,  2.14s/it, lr: 1.0e-04 loss: 8.101e-01]
my_first_lora_v6:  60%|#####9    | 2088/3500 [03:07<50:15,  2.14s/it, lr: 1.0e-04 loss: 8.101e-01]
my_first_lora_v6:  60%|#####9    | 2089/3500 [03:10<50:22,  2.14s/it, lr: 1.0e-04 loss: 2.941e-01]
my_first_lora_v6:  60%|#####9    | 2089/3500 [03:10<50:22,  2.14s/it, lr: 1.0e-04 loss: 2.941e-01]
my_first_lora_v6:  60%|#####9    | 2090/3500 [03:11<50:02,  2.13s/it, lr: 1.0e-04 loss: 8.482e-01]
my_first_lora_v6:  60%|#####9    | 2090/3500 [03:11<50:02,  2.13s/it, lr: 1.0e-04 loss: 8.482e-01]
my_first_lora_v6:  60%|#####9    | 2091/3500 [03:14<50:09,  2.14s/it, lr: 1.0e-04 loss: 4.160e-01]
my_first_lora_v6:  60%|#####9    | 2091/3500 [03:14<50:09,  2.14s/it, lr: 1.0e-04 loss: 4.160e-01]
my_first_lora_v6:  60%|#####9    | 2092/3500 [03:16<50:03,  2.13s/it, lr: 1.0e-04 loss: 3.471e-01]
my_first_lora_v6:  60%|#####9    | 2092/3500 [03:16<50:03,  2.13s/it, lr: 1.0e-04 loss: 3.471e-01]
my_first_lora_v6:  60%|#####9    | 2093/3500 [03:18<50:06,  2.14s/it, lr: 1.0e-04 loss: 2.864e-01]
my_first_lora_v6:  60%|#####9    | 2093/3500 [03:18<50:06,  2.14s/it, lr: 1.0e-04 loss: 2.864e-01]
my_first_lora_v6:  60%|#####9    | 2094/3500 [03:19<49:47,  2.12s/it, lr: 1.0e-04 loss: 3.867e-02]
my_first_lora_v6:  60%|#####9    | 2094/3500 [03:19<49:47,  2.12s/it, lr: 1.0e-04 loss: 3.867e-02]
my_first_lora_v6:  60%|#####9    | 2095/3500 [03:21<49:43,  2.12s/it, lr: 1.0e-04 loss: 7.882e-01]
my_first_lora_v6:  60%|#####9    | 2095/3500 [03:21<49:43,  2.12s/it, lr: 1.0e-04 loss: 7.882e-01]
my_first_lora_v6:  60%|#####9    | 2096/3500 [03:24<49:46,  2.13s/it, lr: 1.0e-04 loss: 8.492e-01]
my_first_lora_v6:  60%|#####9    | 2096/3500 [03:24<49:46,  2.13s/it, lr: 1.0e-04 loss: 8.492e-01]
my_first_lora_v6:  60%|#####9    | 2097/3500 [03:26<49:49,  2.13s/it, lr: 1.0e-04 loss: 1.228e-01]
my_first_lora_v6:  60%|#####9    | 2097/3500 [03:26<49:49,  2.13s/it, lr: 1.0e-04 loss: 1.228e-01]
my_first_lora_v6:  60%|#####9    | 2098/3500 [03:29<49:54,  2.14s/it, lr: 1.0e-04 loss: 3.006e-01]
my_first_lora_v6:  60%|#####9    | 2098/3500 [03:29<49:54,  2.14s/it, lr: 1.0e-04 loss: 3.006e-01]
my_first_lora_v6:  60%|#####9    | 2099/3500 [03:32<50:01,  2.14s/it, lr: 1.0e-04 loss: 4.409e-01]
my_first_lora_v6:  60%|#####9    | 2099/3500 [03:32<50:01,  2.14s/it, lr: 1.0e-04 loss: 4.409e-01]
my_first_lora_v6:  60%|######    | 2100/3500 [03:33<49:43,  2.13s/it, lr: 1.0e-04 loss: 7.704e-01]
my_first_lora_v6:  60%|######    | 2100/3500 [03:33<49:43,  2.13s/it, lr: 1.0e-04 loss: 7.704e-01]
my_first_lora_v6:  60%|######    | 2101/3500 [03:35<49:42,  2.13s/it, lr: 1.0e-04 loss: 6.811e-02]
my_first_lora_v6:  60%|######    | 2101/3500 [03:35<49:42,  2.13s/it, lr: 1.0e-04 loss: 6.811e-02]
my_first_lora_v6:  60%|######    | 2102/3500 [03:37<49:38,  2.13s/it, lr: 1.0e-04 loss: 6.972e-01]
my_first_lora_v6:  60%|######    | 2102/3500 [03:37<49:38,  2.13s/it, lr: 1.0e-04 loss: 6.972e-01]
my_first_lora_v6:  60%|######    | 2103/3500 [03:39<49:41,  2.13s/it, lr: 1.0e-04 loss: 3.825e-01]
my_first_lora_v6:  60%|######    | 2103/3500 [03:39<49:41,  2.13s/it, lr: 1.0e-04 loss: 3.825e-01]
my_first_lora_v6:  60%|######    | 2104/3500 [03:42<49:43,  2.14s/it, lr: 1.0e-04 loss: 6.842e-01]
my_first_lora_v6:  60%|######    | 2104/3500 [03:42<49:43,  2.14s/it, lr: 1.0e-04 loss: 6.842e-01]
my_first_lora_v6:  60%|######    | 2105/3500 [03:44<49:46,  2.14s/it, lr: 1.0e-04 loss: 7.562e-01]
my_first_lora_v6:  60%|######    | 2105/3500 [03:44<49:46,  2.14s/it, lr: 1.0e-04 loss: 7.562e-01]
my_first_lora_v6:  60%|######    | 2106/3500 [03:45<49:29,  2.13s/it, lr: 1.0e-04 loss: 6.046e-01]
my_first_lora_v6:  60%|######    | 2106/3500 [03:45<49:29,  2.13s/it, lr: 1.0e-04 loss: 6.046e-01]
my_first_lora_v6:  60%|######    | 2107/3500 [03:48<49:37,  2.14s/it, lr: 1.0e-04 loss: 4.949e-01]
my_first_lora_v6:  60%|######    | 2107/3500 [03:48<49:37,  2.14s/it, lr: 1.0e-04 loss: 4.949e-01]
my_first_lora_v6:  60%|######    | 2108/3500 [03:49<49:21,  2.13s/it, lr: 1.0e-04 loss: 5.805e-01]
my_first_lora_v6:  60%|######    | 2108/3500 [03:49<49:21,  2.13s/it, lr: 1.0e-04 loss: 5.805e-01]
my_first_lora_v6:  60%|######    | 2109/3500 [03:51<49:15,  2.12s/it, lr: 1.0e-04 loss: 2.842e-01]
my_first_lora_v6:  60%|######    | 2109/3500 [03:51<49:15,  2.12s/it, lr: 1.0e-04 loss: 2.842e-01]
my_first_lora_v6:  60%|######    | 2110/3500 [03:54<49:18,  2.13s/it, lr: 1.0e-04 loss: 3.092e-01]
my_first_lora_v6:  60%|######    | 2110/3500 [03:54<49:18,  2.13s/it, lr: 1.0e-04 loss: 3.092e-01]
my_first_lora_v6:  60%|######    | 2111/3500 [03:56<49:20,  2.13s/it, lr: 1.0e-04 loss: 7.763e-01]
my_first_lora_v6:  60%|######    | 2111/3500 [03:56<49:20,  2.13s/it, lr: 1.0e-04 loss: 7.763e-01]
my_first_lora_v6:  60%|######    | 2112/3500 [03:58<49:17,  2.13s/it, lr: 1.0e-04 loss: 4.138e-01]
my_first_lora_v6:  60%|######    | 2112/3500 [03:58<49:17,  2.13s/it, lr: 1.0e-04 loss: 4.138e-01]
my_first_lora_v6:  60%|######    | 2113/3500 [04:01<49:19,  2.13s/it, lr: 1.0e-04 loss: 1.255e-01]
my_first_lora_v6:  60%|######    | 2113/3500 [04:01<49:19,  2.13s/it, lr: 1.0e-04 loss: 1.255e-01]
my_first_lora_v6:  60%|######    | 2114/3500 [04:02<49:03,  2.12s/it, lr: 1.0e-04 loss: 6.217e-01]
my_first_lora_v6:  60%|######    | 2114/3500 [04:02<49:03,  2.12s/it, lr: 1.0e-04 loss: 6.217e-01]
my_first_lora_v6:  60%|######    | 2115/3500 [04:04<49:08,  2.13s/it, lr: 1.0e-04 loss: 2.144e-01]
my_first_lora_v6:  60%|######    | 2115/3500 [04:04<49:08,  2.13s/it, lr: 1.0e-04 loss: 2.144e-01]
my_first_lora_v6:  60%|######    | 2116/3500 [04:07<49:12,  2.13s/it, lr: 1.0e-04 loss: 7.456e-01]
my_first_lora_v6:  60%|######    | 2116/3500 [04:07<49:12,  2.13s/it, lr: 1.0e-04 loss: 7.456e-01]
my_first_lora_v6:  60%|######    | 2117/3500 [04:09<49:14,  2.14s/it, lr: 1.0e-04 loss: 3.644e-01]
my_first_lora_v6:  60%|######    | 2117/3500 [04:09<49:14,  2.14s/it, lr: 1.0e-04 loss: 3.644e-01]
my_first_lora_v6:  61%|######    | 2118/3500 [04:12<49:16,  2.14s/it, lr: 1.0e-04 loss: 4.762e-01]
my_first_lora_v6:  61%|######    | 2118/3500 [04:12<49:16,  2.14s/it, lr: 1.0e-04 loss: 4.762e-01]
my_first_lora_v6:  61%|######    | 2119/3500 [04:14<49:18,  2.14s/it, lr: 1.0e-04 loss: 8.431e-01]
my_first_lora_v6:  61%|######    | 2119/3500 [04:14<49:18,  2.14s/it, lr: 1.0e-04 loss: 8.431e-01]
my_first_lora_v6:  61%|######    | 2120/3500 [04:16<49:12,  2.14s/it, lr: 1.0e-04 loss: 7.228e-02]
my_first_lora_v6:  61%|######    | 2120/3500 [04:16<49:12,  2.14s/it, lr: 1.0e-04 loss: 7.228e-02]
my_first_lora_v6:  61%|######    | 2121/3500 [04:19<49:17,  2.14s/it, lr: 1.0e-04 loss: 2.464e-01]
my_first_lora_v6:  61%|######    | 2121/3500 [04:19<49:17,  2.14s/it, lr: 1.0e-04 loss: 2.464e-01]
my_first_lora_v6:  61%|######    | 2122/3500 [04:20<49:02,  2.14s/it, lr: 1.0e-04 loss: 7.301e-02]
my_first_lora_v6:  61%|######    | 2122/3500 [04:20<49:02,  2.14s/it, lr: 1.0e-04 loss: 7.301e-02]
my_first_lora_v6:  61%|######    | 2123/3500 [04:21<48:47,  2.13s/it, lr: 1.0e-04 loss: 3.187e-01]
my_first_lora_v6:  61%|######    | 2123/3500 [04:21<48:47,  2.13s/it, lr: 1.0e-04 loss: 3.187e-01]
my_first_lora_v6:  61%|######    | 2124/3500 [04:23<48:44,  2.13s/it, lr: 1.0e-04 loss: 3.303e-01]
my_first_lora_v6:  61%|######    | 2124/3500 [04:23<48:44,  2.13s/it, lr: 1.0e-04 loss: 3.303e-01]
my_first_lora_v6:  61%|######    | 2125/3500 [04:24<48:32,  2.12s/it, lr: 1.0e-04 loss: 1.686e-01]
my_first_lora_v6:  61%|######    | 2125/3500 [04:24<48:32,  2.12s/it, lr: 1.0e-04 loss: 1.686e-01]
my_first_lora_v6:  61%|######    | 2126/3500 [04:26<48:27,  2.12s/it, lr: 1.0e-04 loss: 5.221e-01]
my_first_lora_v6:  61%|######    | 2126/3500 [04:26<48:27,  2.12s/it, lr: 1.0e-04 loss: 5.221e-01]
my_first_lora_v6:  61%|######    | 2127/3500 [04:29<48:28,  2.12s/it, lr: 1.0e-04 loss: 3.974e-02]
my_first_lora_v6:  61%|######    | 2127/3500 [04:29<48:28,  2.12s/it, lr: 1.0e-04 loss: 3.974e-02]
my_first_lora_v6:  61%|######    | 2128/3500 [04:31<48:30,  2.12s/it, lr: 1.0e-04 loss: 5.755e-02]
my_first_lora_v6:  61%|######    | 2128/3500 [04:31<48:30,  2.12s/it, lr: 1.0e-04 loss: 5.755e-02]
my_first_lora_v6:  61%|######    | 2129/3500 [04:34<48:35,  2.13s/it, lr: 1.0e-04 loss: 5.066e-01]
my_first_lora_v6:  61%|######    | 2129/3500 [04:34<48:35,  2.13s/it, lr: 1.0e-04 loss: 5.066e-01]
my_first_lora_v6:  61%|######    | 2130/3500 [04:37<48:40,  2.13s/it, lr: 1.0e-04 loss: 1.439e-01]
my_first_lora_v6:  61%|######    | 2130/3500 [04:37<48:40,  2.13s/it, lr: 1.0e-04 loss: 1.439e-01]
my_first_lora_v6:  61%|######    | 2131/3500 [04:38<48:26,  2.12s/it, lr: 1.0e-04 loss: 6.575e-01]
my_first_lora_v6:  61%|######    | 2131/3500 [04:38<48:26,  2.12s/it, lr: 1.0e-04 loss: 6.575e-01]
my_first_lora_v6:  61%|######    | 2132/3500 [04:40<48:23,  2.12s/it, lr: 1.0e-04 loss: 7.394e-02]
my_first_lora_v6:  61%|######    | 2132/3500 [04:40<48:23,  2.12s/it, lr: 1.0e-04 loss: 7.394e-02]
my_first_lora_v6:  61%|######    | 2133/3500 [04:42<48:24,  2.13s/it, lr: 1.0e-04 loss: 7.337e-01]
my_first_lora_v6:  61%|######    | 2133/3500 [04:42<48:24,  2.13s/it, lr: 1.0e-04 loss: 7.337e-01]
my_first_lora_v6:  61%|######    | 2134/3500 [04:44<48:21,  2.12s/it, lr: 1.0e-04 loss: 1.490e-01]
my_first_lora_v6:  61%|######    | 2134/3500 [04:44<48:21,  2.12s/it, lr: 1.0e-04 loss: 1.490e-01]
my_first_lora_v6:  61%|######1   | 2135/3500 [04:47<48:23,  2.13s/it, lr: 1.0e-04 loss: 9.491e-02]
my_first_lora_v6:  61%|######1   | 2135/3500 [04:47<48:23,  2.13s/it, lr: 1.0e-04 loss: 9.491e-02]
my_first_lora_v6:  61%|######1   | 2136/3500 [04:48<48:10,  2.12s/it, lr: 1.0e-04 loss: 5.535e-01]
my_first_lora_v6:  61%|######1   | 2136/3500 [04:48<48:10,  2.12s/it, lr: 1.0e-04 loss: 5.535e-01]
my_first_lora_v6:  61%|######1   | 2137/3500 [04:50<48:11,  2.12s/it, lr: 1.0e-04 loss: 1.326e-01]
my_first_lora_v6:  61%|######1   | 2137/3500 [04:50<48:11,  2.12s/it, lr: 1.0e-04 loss: 1.326e-01]
my_first_lora_v6:  61%|######1   | 2138/3500 [04:51<47:58,  2.11s/it, lr: 1.0e-04 loss: 3.991e-01]
my_first_lora_v6:  61%|######1   | 2138/3500 [04:51<47:58,  2.11s/it, lr: 1.0e-04 loss: 3.991e-01]
my_first_lora_v6:  61%|######1   | 2139/3500 [04:54<48:00,  2.12s/it, lr: 1.0e-04 loss: 7.012e-01]
my_first_lora_v6:  61%|######1   | 2139/3500 [04:54<48:00,  2.12s/it, lr: 1.0e-04 loss: 7.012e-01]
my_first_lora_v6:  61%|######1   | 2140/3500 [04:56<48:04,  2.12s/it, lr: 1.0e-04 loss: 4.059e-01]
my_first_lora_v6:  61%|######1   | 2140/3500 [04:56<48:04,  2.12s/it, lr: 1.0e-04 loss: 4.059e-01]
my_first_lora_v6:  61%|######1   | 2141/3500 [04:59<48:06,  2.12s/it, lr: 1.0e-04 loss: 3.981e-02]
my_first_lora_v6:  61%|######1   | 2141/3500 [04:59<48:06,  2.12s/it, lr: 1.0e-04 loss: 3.981e-02]
my_first_lora_v6:  61%|######1   | 2142/3500 [05:01<48:03,  2.12s/it, lr: 1.0e-04 loss: 5.229e-01]
my_first_lora_v6:  61%|######1   | 2142/3500 [05:01<48:03,  2.12s/it, lr: 1.0e-04 loss: 5.229e-01]
my_first_lora_v6:  61%|######1   | 2143/3500 [05:03<48:04,  2.13s/it, lr: 1.0e-04 loss: 3.966e-01]
my_first_lora_v6:  61%|######1   | 2143/3500 [05:03<48:04,  2.13s/it, lr: 1.0e-04 loss: 3.966e-01]
my_first_lora_v6:  61%|######1   | 2144/3500 [05:06<48:07,  2.13s/it, lr: 1.0e-04 loss: 7.604e-01]
my_first_lora_v6:  61%|######1   | 2144/3500 [05:06<48:07,  2.13s/it, lr: 1.0e-04 loss: 7.604e-01]
my_first_lora_v6:  61%|######1   | 2145/3500 [05:08<48:03,  2.13s/it, lr: 1.0e-04 loss: 3.975e-02]
my_first_lora_v6:  61%|######1   | 2145/3500 [05:08<48:03,  2.13s/it, lr: 1.0e-04 loss: 3.975e-02]
my_first_lora_v6:  61%|######1   | 2146/3500 [05:09<47:50,  2.12s/it, lr: 1.0e-04 loss: 3.262e-01]
my_first_lora_v6:  61%|######1   | 2146/3500 [05:09<47:50,  2.12s/it, lr: 1.0e-04 loss: 3.262e-01]
my_first_lora_v6:  61%|######1   | 2147/3500 [05:10<47:38,  2.11s/it, lr: 1.0e-04 loss: 4.922e-01]
my_first_lora_v6:  61%|######1   | 2147/3500 [05:10<47:38,  2.11s/it, lr: 1.0e-04 loss: 4.922e-01]
my_first_lora_v6:  61%|######1   | 2148/3500 [05:13<47:39,  2.11s/it, lr: 1.0e-04 loss: 7.036e-01]
my_first_lora_v6:  61%|######1   | 2148/3500 [05:13<47:39,  2.11s/it, lr: 1.0e-04 loss: 7.036e-01]
my_first_lora_v6:  61%|######1   | 2149/3500 [05:15<47:40,  2.12s/it, lr: 1.0e-04 loss: 6.410e-01]
my_first_lora_v6:  61%|######1   | 2149/3500 [05:15<47:40,  2.12s/it, lr: 1.0e-04 loss: 6.410e-01]
my_first_lora_v6:  61%|######1   | 2150/3500 [05:17<47:41,  2.12s/it, lr: 1.0e-04 loss: 7.604e-01]
my_first_lora_v6:  61%|######1   | 2150/3500 [05:17<47:41,  2.12s/it, lr: 1.0e-04 loss: 7.604e-01]
my_first_lora_v6:  61%|######1   | 2151/3500 [05:20<47:42,  2.12s/it, lr: 1.0e-04 loss: 8.088e-02]
my_first_lora_v6:  61%|######1   | 2151/3500 [05:20<47:42,  2.12s/it, lr: 1.0e-04 loss: 8.088e-02]
my_first_lora_v6:  61%|######1   | 2152/3500 [05:22<47:39,  2.12s/it, lr: 1.0e-04 loss: 9.552e-02]
my_first_lora_v6:  61%|######1   | 2152/3500 [05:22<47:39,  2.12s/it, lr: 1.0e-04 loss: 9.552e-02]
my_first_lora_v6:  62%|######1   | 2153/3500 [05:24<47:40,  2.12s/it, lr: 1.0e-04 loss: 7.544e-01]
my_first_lora_v6:  62%|######1   | 2153/3500 [05:24<47:40,  2.12s/it, lr: 1.0e-04 loss: 7.544e-01]
my_first_lora_v6:  62%|######1   | 2154/3500 [05:27<47:41,  2.13s/it, lr: 1.0e-04 loss: 7.738e-01]
my_first_lora_v6:  62%|######1   | 2154/3500 [05:27<47:41,  2.13s/it, lr: 1.0e-04 loss: 7.738e-01]
my_first_lora_v6:  62%|######1   | 2155/3500 [05:29<47:42,  2.13s/it, lr: 1.0e-04 loss: 5.943e-02]
my_first_lora_v6:  62%|######1   | 2155/3500 [05:29<47:42,  2.13s/it, lr: 1.0e-04 loss: 5.943e-02]
my_first_lora_v6:  62%|######1   | 2156/3500 [05:32<47:43,  2.13s/it, lr: 1.0e-04 loss: 2.649e-01]
my_first_lora_v6:  62%|######1   | 2156/3500 [05:32<47:43,  2.13s/it, lr: 1.0e-04 loss: 2.649e-01]
my_first_lora_v6:  62%|######1   | 2157/3500 [05:33<47:31,  2.12s/it, lr: 1.0e-04 loss: 7.438e-01]
my_first_lora_v6:  62%|######1   | 2157/3500 [05:33<47:31,  2.12s/it, lr: 1.0e-04 loss: 7.438e-01]
my_first_lora_v6:  62%|######1   | 2158/3500 [05:36<47:36,  2.13s/it, lr: 1.0e-04 loss: 2.042e-01]
my_first_lora_v6:  62%|######1   | 2158/3500 [05:36<47:36,  2.13s/it, lr: 1.0e-04 loss: 2.042e-01]
my_first_lora_v6:  62%|######1   | 2159/3500 [05:38<47:33,  2.13s/it, lr: 1.0e-04 loss: 4.057e-01]
my_first_lora_v6:  62%|######1   | 2159/3500 [05:38<47:33,  2.13s/it, lr: 1.0e-04 loss: 4.057e-01]
my_first_lora_v6:  62%|######1   | 2160/3500 [05:39<47:21,  2.12s/it, lr: 1.0e-04 loss: 3.834e-02]
my_first_lora_v6:  62%|######1   | 2160/3500 [05:39<47:21,  2.12s/it, lr: 1.0e-04 loss: 3.834e-02]
my_first_lora_v6:  62%|######1   | 2161/3500 [05:41<47:24,  2.12s/it, lr: 1.0e-04 loss: 7.080e-01]
my_first_lora_v6:  62%|######1   | 2161/3500 [05:41<47:24,  2.12s/it, lr: 1.0e-04 loss: 7.080e-01]
my_first_lora_v6:  62%|######1   | 2162/3500 [05:44<47:26,  2.13s/it, lr: 1.0e-04 loss: 7.564e-01]
my_first_lora_v6:  62%|######1   | 2162/3500 [05:44<47:26,  2.13s/it, lr: 1.0e-04 loss: 7.564e-01]
my_first_lora_v6:  62%|######1   | 2163/3500 [05:47<47:27,  2.13s/it, lr: 1.0e-04 loss: 3.079e-01]
my_first_lora_v6:  62%|######1   | 2163/3500 [05:47<47:27,  2.13s/it, lr: 1.0e-04 loss: 3.079e-01]
my_first_lora_v6:  62%|######1   | 2164/3500 [05:48<47:16,  2.12s/it, lr: 1.0e-04 loss: 3.603e-02]
my_first_lora_v6:  62%|######1   | 2164/3500 [05:48<47:16,  2.12s/it, lr: 1.0e-04 loss: 3.603e-02]
my_first_lora_v6:  62%|######1   | 2165/3500 [05:49<47:05,  2.12s/it, lr: 1.0e-04 loss: 1.649e-01]
my_first_lora_v6:  62%|######1   | 2165/3500 [05:49<47:05,  2.12s/it, lr: 1.0e-04 loss: 1.649e-01]
my_first_lora_v6:  62%|######1   | 2166/3500 [05:51<47:06,  2.12s/it, lr: 1.0e-04 loss: 7.218e-01]
my_first_lora_v6:  62%|######1   | 2166/3500 [05:51<47:06,  2.12s/it, lr: 1.0e-04 loss: 7.218e-01]
my_first_lora_v6:  62%|######1   | 2167/3500 [05:53<47:01,  2.12s/it, lr: 1.0e-04 loss: 3.198e-01]
my_first_lora_v6:  62%|######1   | 2167/3500 [05:53<47:01,  2.12s/it, lr: 1.0e-04 loss: 3.198e-01]
my_first_lora_v6:  62%|######1   | 2168/3500 [05:55<46:58,  2.12s/it, lr: 1.0e-04 loss: 1.598e-01]
my_first_lora_v6:  62%|######1   | 2168/3500 [05:55<46:58,  2.12s/it, lr: 1.0e-04 loss: 1.598e-01]
my_first_lora_v6:  62%|######1   | 2169/3500 [05:57<46:59,  2.12s/it, lr: 1.0e-04 loss: 7.228e-01]
my_first_lora_v6:  62%|######1   | 2169/3500 [05:57<46:59,  2.12s/it, lr: 1.0e-04 loss: 7.228e-01]
my_first_lora_v6:  62%|######2   | 2170/3500 [06:00<47:01,  2.12s/it, lr: 1.0e-04 loss: 8.934e-02]
my_first_lora_v6:  62%|######2   | 2170/3500 [06:00<47:01,  2.12s/it, lr: 1.0e-04 loss: 8.934e-02]
my_first_lora_v6:  62%|######2   | 2171/3500 [06:03<47:04,  2.12s/it, lr: 1.0e-04 loss: 3.741e-01]
my_first_lora_v6:  62%|######2   | 2171/3500 [06:03<47:04,  2.12s/it, lr: 1.0e-04 loss: 3.741e-01]
my_first_lora_v6:  62%|######2   | 2172/3500 [06:06<47:06,  2.13s/it, lr: 1.0e-04 loss: 8.198e-01]
my_first_lora_v6:  62%|######2   | 2172/3500 [06:06<47:06,  2.13s/it, lr: 1.0e-04 loss: 8.198e-01]
my_first_lora_v6:  62%|######2   | 2173/3500 [06:08<47:07,  2.13s/it, lr: 1.0e-04 loss: 4.870e-01]
my_first_lora_v6:  62%|######2   | 2173/3500 [06:08<47:07,  2.13s/it, lr: 1.0e-04 loss: 4.870e-01]
my_first_lora_v6:  62%|######2   | 2174/3500 [06:11<47:07,  2.13s/it, lr: 1.0e-04 loss: 6.711e-01]
my_first_lora_v6:  62%|######2   | 2174/3500 [06:11<47:07,  2.13s/it, lr: 1.0e-04 loss: 6.711e-01]
my_first_lora_v6:  62%|######2   | 2175/3500 [06:13<47:04,  2.13s/it, lr: 1.0e-04 loss: 1.751e-01]
my_first_lora_v6:  62%|######2   | 2175/3500 [06:13<47:04,  2.13s/it, lr: 1.0e-04 loss: 1.751e-01]
my_first_lora_v6:  62%|######2   | 2176/3500 [06:14<46:53,  2.13s/it, lr: 1.0e-04 loss: 2.102e-01]
my_first_lora_v6:  62%|######2   | 2176/3500 [06:14<46:53,  2.13s/it, lr: 1.0e-04 loss: 2.102e-01]
my_first_lora_v6:  62%|######2   | 2177/3500 [06:15<46:43,  2.12s/it, lr: 1.0e-04 loss: 6.948e-01]
my_first_lora_v6:  62%|######2   | 2177/3500 [06:15<46:43,  2.12s/it, lr: 1.0e-04 loss: 6.948e-01]
my_first_lora_v6:  62%|######2   | 2178/3500 [06:16<46:39,  2.12s/it, lr: 1.0e-04 loss: 3.378e-01]
my_first_lora_v6:  62%|######2   | 2178/3500 [06:16<46:39,  2.12s/it, lr: 1.0e-04 loss: 3.378e-01]
my_first_lora_v6:  62%|######2   | 2179/3500 [06:19<46:43,  2.12s/it, lr: 1.0e-04 loss: 6.120e-01]
my_first_lora_v6:  62%|######2   | 2179/3500 [06:19<46:43,  2.12s/it, lr: 1.0e-04 loss: 6.120e-01]
my_first_lora_v6:  62%|######2   | 2180/3500 [06:21<46:40,  2.12s/it, lr: 1.0e-04 loss: 4.021e-01]
my_first_lora_v6:  62%|######2   | 2180/3500 [06:21<46:40,  2.12s/it, lr: 1.0e-04 loss: 4.021e-01]
my_first_lora_v6:  62%|######2   | 2181/3500 [06:22<46:29,  2.12s/it, lr: 1.0e-04 loss: 2.747e-01]
my_first_lora_v6:  62%|######2   | 2181/3500 [06:22<46:29,  2.12s/it, lr: 1.0e-04 loss: 2.747e-01]
my_first_lora_v6:  62%|######2   | 2182/3500 [06:25<46:30,  2.12s/it, lr: 1.0e-04 loss: 3.001e-01]
my_first_lora_v6:  62%|######2   | 2182/3500 [06:25<46:30,  2.12s/it, lr: 1.0e-04 loss: 3.001e-01]
my_first_lora_v6:  62%|######2   | 2183/3500 [06:27<46:31,  2.12s/it, lr: 1.0e-04 loss: 8.232e-01]
my_first_lora_v6:  62%|######2   | 2183/3500 [06:27<46:31,  2.12s/it, lr: 1.0e-04 loss: 8.232e-01]
my_first_lora_v6:  62%|######2   | 2184/3500 [06:30<46:31,  2.12s/it, lr: 1.0e-04 loss: 5.834e-01]
my_first_lora_v6:  62%|######2   | 2184/3500 [06:30<46:31,  2.12s/it, lr: 1.0e-04 loss: 5.834e-01]
my_first_lora_v6:  62%|######2   | 2185/3500 [06:31<46:21,  2.12s/it, lr: 1.0e-04 loss: 1.965e-01]
my_first_lora_v6:  62%|######2   | 2185/3500 [06:31<46:21,  2.12s/it, lr: 1.0e-04 loss: 1.965e-01]
my_first_lora_v6:  62%|######2   | 2186/3500 [06:33<46:17,  2.11s/it, lr: 1.0e-04 loss: 4.434e-01]
my_first_lora_v6:  62%|######2   | 2186/3500 [06:33<46:17,  2.11s/it, lr: 1.0e-04 loss: 4.434e-01]
my_first_lora_v6:  62%|######2   | 2187/3500 [06:36<46:20,  2.12s/it, lr: 1.0e-04 loss: 2.323e-01]
my_first_lora_v6:  62%|######2   | 2187/3500 [06:36<46:20,  2.12s/it, lr: 1.0e-04 loss: 2.323e-01]
my_first_lora_v6:  63%|######2   | 2188/3500 [06:38<46:17,  2.12s/it, lr: 1.0e-04 loss: 3.752e-01]
my_first_lora_v6:  63%|######2   | 2188/3500 [06:38<46:17,  2.12s/it, lr: 1.0e-04 loss: 3.752e-01]
my_first_lora_v6:  63%|######2   | 2189/3500 [06:39<46:08,  2.11s/it, lr: 1.0e-04 loss: 6.507e-02]
my_first_lora_v6:  63%|######2   | 2189/3500 [06:39<46:08,  2.11s/it, lr: 1.0e-04 loss: 6.507e-02]
my_first_lora_v6:  63%|######2   | 2190/3500 [06:41<46:08,  2.11s/it, lr: 1.0e-04 loss: 3.625e-01]
my_first_lora_v6:  63%|######2   | 2190/3500 [06:41<46:08,  2.11s/it, lr: 1.0e-04 loss: 3.625e-01]
my_first_lora_v6:  63%|######2   | 2191/3500 [06:44<46:09,  2.12s/it, lr: 1.0e-04 loss: 2.248e-01]
my_first_lora_v6:  63%|######2   | 2191/3500 [06:44<46:09,  2.12s/it, lr: 1.0e-04 loss: 2.248e-01]
my_first_lora_v6:  63%|######2   | 2192/3500 [06:46<46:11,  2.12s/it, lr: 1.0e-04 loss: 1.121e-01]
my_first_lora_v6:  63%|######2   | 2192/3500 [06:46<46:11,  2.12s/it, lr: 1.0e-04 loss: 1.121e-01]
my_first_lora_v6:  63%|######2   | 2193/3500 [06:47<46:02,  2.11s/it, lr: 1.0e-04 loss: 2.340e-01]
my_first_lora_v6:  63%|######2   | 2193/3500 [06:47<46:02,  2.11s/it, lr: 1.0e-04 loss: 2.340e-01]
my_first_lora_v6:  63%|######2   | 2194/3500 [06:50<46:02,  2.12s/it, lr: 1.0e-04 loss: 2.353e-01]
my_first_lora_v6:  63%|######2   | 2194/3500 [06:50<46:02,  2.12s/it, lr: 1.0e-04 loss: 2.353e-01]
my_first_lora_v6:  63%|######2   | 2195/3500 [06:52<46:02,  2.12s/it, lr: 1.0e-04 loss: 6.592e-01]
my_first_lora_v6:  63%|######2   | 2195/3500 [06:52<46:02,  2.12s/it, lr: 1.0e-04 loss: 6.592e-01]
my_first_lora_v6:  63%|######2   | 2196/3500 [06:54<45:59,  2.12s/it, lr: 1.0e-04 loss: 7.901e-01]
my_first_lora_v6:  63%|######2   | 2196/3500 [06:54<45:59,  2.12s/it, lr: 1.0e-04 loss: 7.901e-01]
my_first_lora_v6:  63%|######2   | 2197/3500 [06:56<45:51,  2.11s/it, lr: 1.0e-04 loss: 2.767e-01]
my_first_lora_v6:  63%|######2   | 2197/3500 [06:56<45:51,  2.11s/it, lr: 1.0e-04 loss: 2.767e-01]
my_first_lora_v6:  63%|######2   | 2198/3500 [06:58<45:52,  2.11s/it, lr: 1.0e-04 loss: 1.162e-01]
my_first_lora_v6:  63%|######2   | 2198/3500 [06:58<45:52,  2.11s/it, lr: 1.0e-04 loss: 1.162e-01]
my_first_lora_v6:  63%|######2   | 2199/3500 [07:01<45:52,  2.12s/it, lr: 1.0e-04 loss: 2.376e-01]
my_first_lora_v6:  63%|######2   | 2199/3500 [07:01<45:52,  2.12s/it, lr: 1.0e-04 loss: 2.376e-01]
my_first_lora_v6:  63%|######2   | 2200/3500 [07:03<45:52,  2.12s/it, lr: 1.0e-04 loss: 7.965e-01]
my_first_lora_v6:  63%|######2   | 2200/3500 [07:03<45:52,  2.12s/it, lr: 1.0e-04 loss: 7.965e-01]
my_first_lora_v6:  63%|######2   | 2201/3500 [07:06<45:54,  2.12s/it, lr: 1.0e-04 loss: 5.738e-01]
my_first_lora_v6:  63%|######2   | 2201/3500 [07:06<45:54,  2.12s/it, lr: 1.0e-04 loss: 5.738e-01]
my_first_lora_v6:  63%|######2   | 2202/3500 [07:07<45:45,  2.12s/it, lr: 1.0e-04 loss: 8.427e-01]
my_first_lora_v6:  63%|######2   | 2202/3500 [07:07<45:45,  2.12s/it, lr: 1.0e-04 loss: 8.427e-01]
my_first_lora_v6:  63%|######2   | 2203/3500 [07:09<45:41,  2.11s/it, lr: 1.0e-04 loss: 3.316e-01]
my_first_lora_v6:  63%|######2   | 2203/3500 [07:09<45:41,  2.11s/it, lr: 1.0e-04 loss: 3.316e-01]
my_first_lora_v6:  63%|######2   | 2204/3500 [07:11<45:38,  2.11s/it, lr: 1.0e-04 loss: 1.204e-01]
my_first_lora_v6:  63%|######2   | 2204/3500 [07:11<45:38,  2.11s/it, lr: 1.0e-04 loss: 1.204e-01]
my_first_lora_v6:  63%|######3   | 2205/3500 [07:13<45:40,  2.12s/it, lr: 1.0e-04 loss: 3.334e-01]
my_first_lora_v6:  63%|######3   | 2205/3500 [07:13<45:40,  2.12s/it, lr: 1.0e-04 loss: 3.334e-01]
my_first_lora_v6:  63%|######3   | 2206/3500 [07:16<45:41,  2.12s/it, lr: 1.0e-04 loss: 2.073e-01]
my_first_lora_v6:  63%|######3   | 2206/3500 [07:16<45:41,  2.12s/it, lr: 1.0e-04 loss: 2.073e-01]
my_first_lora_v6:  63%|######3   | 2207/3500 [07:17<45:32,  2.11s/it, lr: 1.0e-04 loss: 6.988e-01]
my_first_lora_v6:  63%|######3   | 2207/3500 [07:17<45:32,  2.11s/it, lr: 1.0e-04 loss: 6.988e-01]
my_first_lora_v6:  63%|######3   | 2208/3500 [07:19<45:32,  2.12s/it, lr: 1.0e-04 loss: 2.991e-01]
my_first_lora_v6:  63%|######3   | 2208/3500 [07:19<45:32,  2.12s/it, lr: 1.0e-04 loss: 2.991e-01]
my_first_lora_v6:  63%|######3   | 2209/3500 [07:22<45:32,  2.12s/it, lr: 1.0e-04 loss: 6.784e-01]
my_first_lora_v6:  63%|######3   | 2209/3500 [07:22<45:32,  2.12s/it, lr: 1.0e-04 loss: 6.784e-01]
my_first_lora_v6:  63%|######3   | 2210/3500 [07:24<45:29,  2.12s/it, lr: 1.0e-04 loss: 1.733e-01]
my_first_lora_v6:  63%|######3   | 2210/3500 [07:24<45:29,  2.12s/it, lr: 1.0e-04 loss: 1.733e-01]
my_first_lora_v6:  63%|######3   | 2211/3500 [07:27<45:31,  2.12s/it, lr: 1.0e-04 loss: 3.622e-01]
my_first_lora_v6:  63%|######3   | 2211/3500 [07:27<45:31,  2.12s/it, lr: 1.0e-04 loss: 3.622e-01]
my_first_lora_v6:  63%|######3   | 2212/3500 [07:28<45:27,  2.12s/it, lr: 1.0e-04 loss: 4.601e-01]
my_first_lora_v6:  63%|######3   | 2212/3500 [07:28<45:27,  2.12s/it, lr: 1.0e-04 loss: 4.601e-01]
my_first_lora_v6:  63%|######3   | 2213/3500 [07:29<45:18,  2.11s/it, lr: 1.0e-04 loss: 6.843e-02]
my_first_lora_v6:  63%|######3   | 2213/3500 [07:29<45:18,  2.11s/it, lr: 1.0e-04 loss: 6.843e-02]
my_first_lora_v6:  63%|######3   | 2214/3500 [07:32<45:18,  2.11s/it, lr: 1.0e-04 loss: 8.198e-02]
my_first_lora_v6:  63%|######3   | 2214/3500 [07:32<45:18,  2.11s/it, lr: 1.0e-04 loss: 8.198e-02]
my_first_lora_v6:  63%|######3   | 2215/3500 [07:35<45:21,  2.12s/it, lr: 1.0e-04 loss: 7.149e-01]
my_first_lora_v6:  63%|######3   | 2215/3500 [07:35<45:21,  2.12s/it, lr: 1.0e-04 loss: 7.149e-01]
my_first_lora_v6:  63%|######3   | 2216/3500 [07:36<45:13,  2.11s/it, lr: 1.0e-04 loss: 3.749e-01]
my_first_lora_v6:  63%|######3   | 2216/3500 [07:36<45:13,  2.11s/it, lr: 1.0e-04 loss: 3.749e-01]
my_first_lora_v6:  63%|######3   | 2217/3500 [07:38<45:13,  2.11s/it, lr: 1.0e-04 loss: 5.577e-01]
my_first_lora_v6:  63%|######3   | 2217/3500 [07:38<45:13,  2.11s/it, lr: 1.0e-04 loss: 5.577e-01]
my_first_lora_v6:  63%|######3   | 2218/3500 [07:39<45:04,  2.11s/it, lr: 1.0e-04 loss: 5.491e-01]
my_first_lora_v6:  63%|######3   | 2218/3500 [07:39<45:04,  2.11s/it, lr: 1.0e-04 loss: 5.491e-01]
my_first_lora_v6:  63%|######3   | 2219/3500 [07:42<45:06,  2.11s/it, lr: 1.0e-04 loss: 7.535e-01]
my_first_lora_v6:  63%|######3   | 2219/3500 [07:42<45:06,  2.11s/it, lr: 1.0e-04 loss: 7.535e-01]
my_first_lora_v6:  63%|######3   | 2220/3500 [07:45<45:06,  2.11s/it, lr: 1.0e-04 loss: 4.938e-01]
my_first_lora_v6:  63%|######3   | 2220/3500 [07:45<45:06,  2.11s/it, lr: 1.0e-04 loss: 4.938e-01]
my_first_lora_v6:  63%|######3   | 2221/3500 [07:47<45:02,  2.11s/it, lr: 1.0e-04 loss: 4.518e-02]
my_first_lora_v6:  63%|######3   | 2221/3500 [07:47<45:02,  2.11s/it, lr: 1.0e-04 loss: 4.518e-02]
my_first_lora_v6:  63%|######3   | 2222/3500 [07:49<45:02,  2.11s/it, lr: 1.0e-04 loss: 3.467e-01]
my_first_lora_v6:  63%|######3   | 2222/3500 [07:49<45:02,  2.11s/it, lr: 1.0e-04 loss: 3.467e-01]
my_first_lora_v6:  64%|######3   | 2223/3500 [07:51<45:00,  2.11s/it, lr: 1.0e-04 loss: 1.229e-01]
my_first_lora_v6:  64%|######3   | 2223/3500 [07:51<45:00,  2.11s/it, lr: 1.0e-04 loss: 1.229e-01]
my_first_lora_v6:  64%|######3   | 2224/3500 [07:54<45:01,  2.12s/it, lr: 1.0e-04 loss: 4.267e-01]
my_first_lora_v6:  64%|######3   | 2224/3500 [07:54<45:01,  2.12s/it, lr: 1.0e-04 loss: 4.267e-01]
my_first_lora_v6:  64%|######3   | 2225/3500 [07:56<45:01,  2.12s/it, lr: 1.0e-04 loss: 8.121e-01]
my_first_lora_v6:  64%|######3   | 2225/3500 [07:56<45:01,  2.12s/it, lr: 1.0e-04 loss: 8.121e-01]
my_first_lora_v6:  64%|######3   | 2226/3500 [07:59<45:01,  2.12s/it, lr: 1.0e-04 loss: 6.048e-01]
my_first_lora_v6:  64%|######3   | 2226/3500 [07:59<45:01,  2.12s/it, lr: 1.0e-04 loss: 6.048e-01]
my_first_lora_v6:  64%|######3   | 2227/3500 [08:01<45:02,  2.12s/it, lr: 1.0e-04 loss: 4.230e-01]
my_first_lora_v6:  64%|######3   | 2227/3500 [08:01<45:02,  2.12s/it, lr: 1.0e-04 loss: 4.230e-01]
my_first_lora_v6:  64%|######3   | 2228/3500 [08:04<45:02,  2.12s/it, lr: 1.0e-04 loss: 7.185e-01]
my_first_lora_v6:  64%|######3   | 2228/3500 [08:04<45:02,  2.12s/it, lr: 1.0e-04 loss: 7.185e-01]
my_first_lora_v6:  64%|######3   | 2229/3500 [08:05<44:56,  2.12s/it, lr: 1.0e-04 loss: 5.764e-01]
my_first_lora_v6:  64%|######3   | 2229/3500 [08:05<44:56,  2.12s/it, lr: 1.0e-04 loss: 5.764e-01]
my_first_lora_v6:  64%|######3   | 2230/3500 [08:06<44:48,  2.12s/it, lr: 1.0e-04 loss: 1.436e-01]
my_first_lora_v6:  64%|######3   | 2230/3500 [08:06<44:48,  2.12s/it, lr: 1.0e-04 loss: 1.436e-01]
my_first_lora_v6:  64%|######3   | 2231/3500 [08:08<44:44,  2.12s/it, lr: 1.0e-04 loss: 3.799e-01]
my_first_lora_v6:  64%|######3   | 2231/3500 [08:08<44:44,  2.12s/it, lr: 1.0e-04 loss: 3.799e-01]
my_first_lora_v6:  64%|######3   | 2232/3500 [08:10<44:41,  2.12s/it, lr: 1.0e-04 loss: 2.688e-01]
my_first_lora_v6:  64%|######3   | 2232/3500 [08:10<44:41,  2.12s/it, lr: 1.0e-04 loss: 2.688e-01]
my_first_lora_v6:  64%|######3   | 2233/3500 [08:12<44:40,  2.12s/it, lr: 1.0e-04 loss: 6.591e-01]
my_first_lora_v6:  64%|######3   | 2233/3500 [08:12<44:40,  2.12s/it, lr: 1.0e-04 loss: 6.591e-01]
my_first_lora_v6:  64%|######3   | 2234/3500 [08:15<44:40,  2.12s/it, lr: 1.0e-04 loss: 5.630e-01]
my_first_lora_v6:  64%|######3   | 2234/3500 [08:15<44:40,  2.12s/it, lr: 1.0e-04 loss: 5.630e-01]
my_first_lora_v6:  64%|######3   | 2235/3500 [08:17<44:39,  2.12s/it, lr: 1.0e-04 loss: 1.158e-01]
my_first_lora_v6:  64%|######3   | 2235/3500 [08:17<44:39,  2.12s/it, lr: 1.0e-04 loss: 1.158e-01]
my_first_lora_v6:  64%|######3   | 2236/3500 [08:18<44:31,  2.11s/it, lr: 1.0e-04 loss: 4.227e-01]
my_first_lora_v6:  64%|######3   | 2236/3500 [08:18<44:31,  2.11s/it, lr: 1.0e-04 loss: 4.227e-01]
my_first_lora_v6:  64%|######3   | 2237/3500 [08:19<44:23,  2.11s/it, lr: 1.0e-04 loss: 7.702e-01]
my_first_lora_v6:  64%|######3   | 2237/3500 [08:19<44:23,  2.11s/it, lr: 1.0e-04 loss: 7.702e-01]
my_first_lora_v6:  64%|######3   | 2238/3500 [08:22<44:25,  2.11s/it, lr: 1.0e-04 loss: 5.611e-01]
my_first_lora_v6:  64%|######3   | 2238/3500 [08:22<44:25,  2.11s/it, lr: 1.0e-04 loss: 5.611e-01]
my_first_lora_v6:  64%|######3   | 2239/3500 [08:25<44:25,  2.11s/it, lr: 1.0e-04 loss: 7.124e-01]
my_first_lora_v6:  64%|######3   | 2239/3500 [08:25<44:25,  2.11s/it, lr: 1.0e-04 loss: 7.124e-01]
my_first_lora_v6:  64%|######4   | 2240/3500 [08:26<44:21,  2.11s/it, lr: 1.0e-04 loss: 4.685e-01]
my_first_lora_v6:  64%|######4   | 2240/3500 [08:26<44:21,  2.11s/it, lr: 1.0e-04 loss: 4.685e-01]
my_first_lora_v6:  64%|######4   | 2241/3500 [08:29<44:21,  2.11s/it, lr: 1.0e-04 loss: 7.580e-01]
my_first_lora_v6:  64%|######4   | 2241/3500 [08:29<44:21,  2.11s/it, lr: 1.0e-04 loss: 7.580e-01]
my_first_lora_v6:  64%|######4   | 2242/3500 [08:32<44:22,  2.12s/it, lr: 1.0e-04 loss: 6.284e-01]
my_first_lora_v6:  64%|######4   | 2242/3500 [08:32<44:22,  2.12s/it, lr: 1.0e-04 loss: 6.284e-01]
my_first_lora_v6:  64%|######4   | 2243/3500 [08:33<44:14,  2.11s/it, lr: 1.0e-04 loss: 8.469e-02]
my_first_lora_v6:  64%|######4   | 2243/3500 [08:33<44:14,  2.11s/it, lr: 1.0e-04 loss: 8.469e-02]
my_first_lora_v6:  64%|######4   | 2244/3500 [08:35<44:15,  2.11s/it, lr: 1.0e-04 loss: 7.453e-02]
my_first_lora_v6:  64%|######4   | 2244/3500 [08:35<44:15,  2.11s/it, lr: 1.0e-04 loss: 7.453e-02]
my_first_lora_v6:  64%|######4   | 2245/3500 [08:36<44:07,  2.11s/it, lr: 1.0e-04 loss: 1.762e-01]
my_first_lora_v6:  64%|######4   | 2245/3500 [08:36<44:07,  2.11s/it, lr: 1.0e-04 loss: 1.762e-01]
my_first_lora_v6:  64%|######4   | 2246/3500 [08:39<44:07,  2.11s/it, lr: 1.0e-04 loss: 3.070e-02]
my_first_lora_v6:  64%|######4   | 2246/3500 [08:39<44:07,  2.11s/it, lr: 1.0e-04 loss: 3.070e-02]
my_first_lora_v6:  64%|######4   | 2247/3500 [08:42<44:08,  2.11s/it, lr: 1.0e-04 loss: 7.157e-02]
my_first_lora_v6:  64%|######4   | 2247/3500 [08:42<44:08,  2.11s/it, lr: 1.0e-04 loss: 7.157e-02]
my_first_lora_v6:  64%|######4   | 2248/3500 [08:44<44:08,  2.12s/it, lr: 1.0e-04 loss: 1.125e-01]
my_first_lora_v6:  64%|######4   | 2248/3500 [08:44<44:08,  2.12s/it, lr: 1.0e-04 loss: 1.125e-01]
my_first_lora_v6:  64%|######4   | 2249/3500 [08:46<44:05,  2.11s/it, lr: 1.0e-04 loss: 3.735e-01]
my_first_lora_v6:  64%|######4   | 2249/3500 [08:46<44:05,  2.11s/it, lr: 1.0e-04 loss: 3.735e-01]Unloading assistant lora



Generating Images:   0%|          | 0/5 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/5 [00:00<?, ?it/s]


Generating Images:  20%|##        | 1/5 [00:07<00:31,  7.92s/it]
Generating Images:  20%|##        | 1/5 [00:07<00:31,  7.92s/it]


Generating Images:  40%|####      | 2/5 [00:15<00:23,  7.86s/it]
Generating Images:  40%|####      | 2/5 [00:15<00:23,  7.86s/it]


Generating Images:  60%|######    | 3/5 [00:23<00:15,  7.75s/it]
Generating Images:  60%|######    | 3/5 [00:23<00:15,  7.75s/it]


Generating Images:  80%|########  | 4/5 [00:31<00:07,  7.77s/it]
Generating Images:  80%|########  | 4/5 [00:31<00:07,  7.77s/it]


Generating Images: 100%|##########| 5/5 [00:39<00:00,  7.79s/it]
Generating Images: 100%|##########| 5/5 [00:39<00:00,  7.79s/it]


                                                                
                                                                Loading assistant lora

my_first_lora_v6:  64%|######4   | 2250/3500 [08:48<44:01,  2.11s/it, lr: 1.0e-04 loss: 4.313e-02]
my_first_lora_v6:  64%|######4   | 2250/3500 [08:48<44:01,  2.11s/it, lr: 1.0e-04 loss: 4.313e-02]
my_first_lora_v6:  64%|######4   | 2251/3500 [08:51<44:03,  2.12s/it, lr: 1.0e-04 loss: 7.729e-01]
my_first_lora_v6:  64%|######4   | 2251/3500 [08:51<44:03,  2.12s/it, lr: 1.0e-04 loss: 7.729e-01]
my_first_lora_v6:  64%|######4   | 2252/3500 [08:52<43:55,  2.11s/it, lr: 1.0e-04 loss: 2.070e-01]
my_first_lora_v6:  64%|######4   | 2252/3500 [08:52<43:55,  2.11s/it, lr: 1.0e-04 loss: 2.070e-01]
my_first_lora_v6:  64%|######4   | 2253/3500 [08:54<43:52,  2.11s/it, lr: 1.0e-04 loss: 7.685e-02]
my_first_lora_v6:  64%|######4   | 2253/3500 [08:54<43:52,  2.11s/it, lr: 1.0e-04 loss: 7.685e-02]
my_first_lora_v6:  64%|######4   | 2254/3500 [08:55<43:45,  2.11s/it, lr: 1.0e-04 loss: 3.944e-01]
my_first_lora_v6:  64%|######4   | 2254/3500 [08:55<43:45,  2.11s/it, lr: 1.0e-04 loss: 3.944e-01]
my_first_lora_v6:  64%|######4   | 2255/3500 [08:57<43:45,  2.11s/it, lr: 1.0e-04 loss: 6.712e-01]
my_first_lora_v6:  64%|######4   | 2255/3500 [08:57<43:45,  2.11s/it, lr: 1.0e-04 loss: 6.712e-01]
my_first_lora_v6:  64%|######4   | 2256/3500 [09:00<43:44,  2.11s/it, lr: 1.0e-04 loss: 7.242e-01]
my_first_lora_v6:  64%|######4   | 2256/3500 [09:00<43:44,  2.11s/it, lr: 1.0e-04 loss: 7.242e-01]
my_first_lora_v6:  64%|######4   | 2257/3500 [09:02<43:44,  2.11s/it, lr: 1.0e-04 loss: 7.960e-01]
my_first_lora_v6:  64%|######4   | 2257/3500 [09:02<43:44,  2.11s/it, lr: 1.0e-04 loss: 7.960e-01]
my_first_lora_v6:  65%|######4   | 2258/3500 [09:04<43:40,  2.11s/it, lr: 1.0e-04 loss: 1.240e-01]
my_first_lora_v6:  65%|######4   | 2258/3500 [09:04<43:40,  2.11s/it, lr: 1.0e-04 loss: 1.240e-01]
my_first_lora_v6:  65%|######4   | 2259/3500 [09:07<43:41,  2.11s/it, lr: 1.0e-04 loss: 4.235e-01]
my_first_lora_v6:  65%|######4   | 2259/3500 [09:07<43:41,  2.11s/it, lr: 1.0e-04 loss: 4.235e-01]
my_first_lora_v6:  65%|######4   | 2260/3500 [09:10<43:43,  2.12s/it, lr: 1.0e-04 loss: 5.961e-01]
my_first_lora_v6:  65%|######4   | 2260/3500 [09:10<43:43,  2.12s/it, lr: 1.0e-04 loss: 5.961e-01]
my_first_lora_v6:  65%|######4   | 2261/3500 [09:12<43:43,  2.12s/it, lr: 1.0e-04 loss: 4.553e-01]
my_first_lora_v6:  65%|######4   | 2261/3500 [09:12<43:43,  2.12s/it, lr: 1.0e-04 loss: 4.553e-01]
my_first_lora_v6:  65%|######4   | 2262/3500 [09:15<43:42,  2.12s/it, lr: 1.0e-04 loss: 2.252e-01]
my_first_lora_v6:  65%|######4   | 2262/3500 [09:15<43:42,  2.12s/it, lr: 1.0e-04 loss: 2.252e-01]
my_first_lora_v6:  65%|######4   | 2263/3500 [09:16<43:35,  2.11s/it, lr: 1.0e-04 loss: 6.133e-01]
my_first_lora_v6:  65%|######4   | 2263/3500 [09:16<43:35,  2.11s/it, lr: 1.0e-04 loss: 6.133e-01]
my_first_lora_v6:  65%|######4   | 2264/3500 [09:18<43:34,  2.12s/it, lr: 1.0e-04 loss: 7.350e-01]
my_first_lora_v6:  65%|######4   | 2264/3500 [09:18<43:34,  2.12s/it, lr: 1.0e-04 loss: 7.350e-01]
my_first_lora_v6:  65%|######4   | 2265/3500 [09:20<43:33,  2.12s/it, lr: 1.0e-04 loss: 5.370e-01]
my_first_lora_v6:  65%|######4   | 2265/3500 [09:20<43:33,  2.12s/it, lr: 1.0e-04 loss: 5.370e-01]
my_first_lora_v6:  65%|######4   | 2266/3500 [09:23<43:33,  2.12s/it, lr: 1.0e-04 loss: 1.760e-01]
my_first_lora_v6:  65%|######4   | 2266/3500 [09:23<43:33,  2.12s/it, lr: 1.0e-04 loss: 1.760e-01]
my_first_lora_v6:  65%|######4   | 2267/3500 [09:24<43:26,  2.11s/it, lr: 1.0e-04 loss: 4.029e-01]
my_first_lora_v6:  65%|######4   | 2267/3500 [09:24<43:26,  2.11s/it, lr: 1.0e-04 loss: 4.029e-01]
my_first_lora_v6:  65%|######4   | 2268/3500 [09:26<43:22,  2.11s/it, lr: 1.0e-04 loss: 2.706e-01]
my_first_lora_v6:  65%|######4   | 2268/3500 [09:26<43:22,  2.11s/it, lr: 1.0e-04 loss: 2.706e-01]
my_first_lora_v6:  65%|######4   | 2269/3500 [09:28<43:21,  2.11s/it, lr: 1.0e-04 loss: 3.364e-01]
my_first_lora_v6:  65%|######4   | 2269/3500 [09:28<43:21,  2.11s/it, lr: 1.0e-04 loss: 3.364e-01]
my_first_lora_v6:  65%|######4   | 2270/3500 [09:29<43:14,  2.11s/it, lr: 1.0e-04 loss: 8.372e-01]
my_first_lora_v6:  65%|######4   | 2270/3500 [09:29<43:14,  2.11s/it, lr: 1.0e-04 loss: 8.372e-01]
my_first_lora_v6:  65%|######4   | 2271/3500 [09:31<43:11,  2.11s/it, lr: 1.0e-04 loss: 3.000e-01]
my_first_lora_v6:  65%|######4   | 2271/3500 [09:31<43:11,  2.11s/it, lr: 1.0e-04 loss: 3.000e-01]
my_first_lora_v6:  65%|######4   | 2272/3500 [09:32<43:03,  2.10s/it, lr: 1.0e-04 loss: 1.940e-01]
my_first_lora_v6:  65%|######4   | 2272/3500 [09:32<43:03,  2.10s/it, lr: 1.0e-04 loss: 1.940e-01]
my_first_lora_v6:  65%|######4   | 2273/3500 [09:34<43:03,  2.11s/it, lr: 1.0e-04 loss: 7.491e-01]
my_first_lora_v6:  65%|######4   | 2273/3500 [09:34<43:03,  2.11s/it, lr: 1.0e-04 loss: 7.491e-01]
my_first_lora_v6:  65%|######4   | 2274/3500 [09:37<43:03,  2.11s/it, lr: 1.0e-04 loss: 1.960e-01]
my_first_lora_v6:  65%|######4   | 2274/3500 [09:37<43:03,  2.11s/it, lr: 1.0e-04 loss: 1.960e-01]
my_first_lora_v6:  65%|######5   | 2275/3500 [09:39<43:02,  2.11s/it, lr: 1.0e-04 loss: 6.847e-02]
my_first_lora_v6:  65%|######5   | 2275/3500 [09:39<43:02,  2.11s/it, lr: 1.0e-04 loss: 6.847e-02]
my_first_lora_v6:  65%|######5   | 2276/3500 [09:42<43:03,  2.11s/it, lr: 1.0e-04 loss: 1.947e-01]
my_first_lora_v6:  65%|######5   | 2276/3500 [09:42<43:03,  2.11s/it, lr: 1.0e-04 loss: 1.947e-01]
my_first_lora_v6:  65%|######5   | 2277/3500 [09:45<43:03,  2.11s/it, lr: 1.0e-04 loss: 7.836e-01]
my_first_lora_v6:  65%|######5   | 2277/3500 [09:45<43:03,  2.11s/it, lr: 1.0e-04 loss: 7.836e-01]
my_first_lora_v6:  65%|######5   | 2278/3500 [09:47<43:03,  2.11s/it, lr: 1.0e-04 loss: 6.569e-01]
my_first_lora_v6:  65%|######5   | 2278/3500 [09:47<43:03,  2.11s/it, lr: 1.0e-04 loss: 6.569e-01]
my_first_lora_v6:  65%|######5   | 2279/3500 [09:49<43:00,  2.11s/it, lr: 1.0e-04 loss: 3.926e-01]
my_first_lora_v6:  65%|######5   | 2279/3500 [09:49<43:00,  2.11s/it, lr: 1.0e-04 loss: 3.926e-01]
my_first_lora_v6:  65%|######5   | 2280/3500 [09:52<43:00,  2.12s/it, lr: 1.0e-04 loss: 5.522e-01]
my_first_lora_v6:  65%|######5   | 2280/3500 [09:52<43:00,  2.12s/it, lr: 1.0e-04 loss: 5.522e-01]
my_first_lora_v6:  65%|######5   | 2281/3500 [09:53<42:53,  2.11s/it, lr: 1.0e-04 loss: 4.850e-01]
my_first_lora_v6:  65%|######5   | 2281/3500 [09:53<42:53,  2.11s/it, lr: 1.0e-04 loss: 4.850e-01]
my_first_lora_v6:  65%|######5   | 2282/3500 [09:55<42:53,  2.11s/it, lr: 1.0e-04 loss: 1.113e-01]
my_first_lora_v6:  65%|######5   | 2282/3500 [09:55<42:53,  2.11s/it, lr: 1.0e-04 loss: 1.113e-01]
my_first_lora_v6:  65%|######5   | 2283/3500 [09:58<42:52,  2.11s/it, lr: 1.0e-04 loss: 6.274e-01]
my_first_lora_v6:  65%|######5   | 2283/3500 [09:58<42:52,  2.11s/it, lr: 1.0e-04 loss: 6.274e-01]
my_first_lora_v6:  65%|######5   | 2284/3500 [10:00<42:52,  2.12s/it, lr: 1.0e-04 loss: 5.449e-01]
my_first_lora_v6:  65%|######5   | 2284/3500 [10:00<42:52,  2.12s/it, lr: 1.0e-04 loss: 5.449e-01]
my_first_lora_v6:  65%|######5   | 2285/3500 [10:03<42:51,  2.12s/it, lr: 1.0e-04 loss: 3.321e-01]
my_first_lora_v6:  65%|######5   | 2285/3500 [10:03<42:51,  2.12s/it, lr: 1.0e-04 loss: 3.321e-01]
my_first_lora_v6:  65%|######5   | 2286/3500 [10:04<42:44,  2.11s/it, lr: 1.0e-04 loss: 6.356e-01]
my_first_lora_v6:  65%|######5   | 2286/3500 [10:04<42:44,  2.11s/it, lr: 1.0e-04 loss: 6.356e-01]
my_first_lora_v6:  65%|######5   | 2287/3500 [10:05<42:39,  2.11s/it, lr: 1.0e-04 loss: 8.187e-01]
my_first_lora_v6:  65%|######5   | 2287/3500 [10:05<42:39,  2.11s/it, lr: 1.0e-04 loss: 8.187e-01]
my_first_lora_v6:  65%|######5   | 2288/3500 [10:06<42:32,  2.11s/it, lr: 1.0e-04 loss: 6.213e-01]
my_first_lora_v6:  65%|######5   | 2288/3500 [10:06<42:32,  2.11s/it, lr: 1.0e-04 loss: 6.213e-01]
my_first_lora_v6:  65%|######5   | 2289/3500 [10:08<42:29,  2.11s/it, lr: 1.0e-04 loss: 3.590e-01]
my_first_lora_v6:  65%|######5   | 2289/3500 [10:08<42:29,  2.11s/it, lr: 1.0e-04 loss: 3.590e-01]
my_first_lora_v6:  65%|######5   | 2290/3500 [10:10<42:29,  2.11s/it, lr: 1.0e-04 loss: 4.575e-01]
my_first_lora_v6:  65%|######5   | 2290/3500 [10:10<42:29,  2.11s/it, lr: 1.0e-04 loss: 4.575e-01]
my_first_lora_v6:  65%|######5   | 2291/3500 [10:13<42:28,  2.11s/it, lr: 1.0e-04 loss: 2.428e-02]
my_first_lora_v6:  65%|######5   | 2291/3500 [10:13<42:28,  2.11s/it, lr: 1.0e-04 loss: 2.428e-02]
my_first_lora_v6:  65%|######5   | 2292/3500 [10:15<42:26,  2.11s/it, lr: 1.0e-04 loss: 1.291e-01]
my_first_lora_v6:  65%|######5   | 2292/3500 [10:15<42:26,  2.11s/it, lr: 1.0e-04 loss: 1.291e-01]
my_first_lora_v6:  66%|######5   | 2293/3500 [10:18<42:25,  2.11s/it, lr: 1.0e-04 loss: 1.061e-01]
my_first_lora_v6:  66%|######5   | 2293/3500 [10:18<42:25,  2.11s/it, lr: 1.0e-04 loss: 1.061e-01]
my_first_lora_v6:  66%|######5   | 2294/3500 [10:20<42:25,  2.11s/it, lr: 1.0e-04 loss: 7.170e-01]
my_first_lora_v6:  66%|######5   | 2294/3500 [10:20<42:25,  2.11s/it, lr: 1.0e-04 loss: 7.170e-01]
my_first_lora_v6:  66%|######5   | 2295/3500 [10:23<42:25,  2.11s/it, lr: 1.0e-04 loss: 4.313e-01]
my_first_lora_v6:  66%|######5   | 2295/3500 [10:23<42:25,  2.11s/it, lr: 1.0e-04 loss: 4.313e-01]
my_first_lora_v6:  66%|######5   | 2296/3500 [10:24<42:19,  2.11s/it, lr: 1.0e-04 loss: 6.433e-01]
my_first_lora_v6:  66%|######5   | 2296/3500 [10:24<42:19,  2.11s/it, lr: 1.0e-04 loss: 6.433e-01]
my_first_lora_v6:  66%|######5   | 2297/3500 [10:25<42:13,  2.11s/it, lr: 1.0e-04 loss: 4.511e-01]
my_first_lora_v6:  66%|######5   | 2297/3500 [10:25<42:13,  2.11s/it, lr: 1.0e-04 loss: 4.511e-01]
my_first_lora_v6:  66%|######5   | 2298/3500 [10:27<42:12,  2.11s/it, lr: 1.0e-04 loss: 4.616e-01]
my_first_lora_v6:  66%|######5   | 2298/3500 [10:27<42:12,  2.11s/it, lr: 1.0e-04 loss: 4.616e-01]
my_first_lora_v6:  66%|######5   | 2299/3500 [10:29<42:10,  2.11s/it, lr: 1.0e-04 loss: 2.082e-01]
my_first_lora_v6:  66%|######5   | 2299/3500 [10:29<42:10,  2.11s/it, lr: 1.0e-04 loss: 2.082e-01]
my_first_lora_v6:  66%|######5   | 2300/3500 [10:32<42:09,  2.11s/it, lr: 1.0e-04 loss: 5.047e-01]
my_first_lora_v6:  66%|######5   | 2300/3500 [10:32<42:09,  2.11s/it, lr: 1.0e-04 loss: 5.047e-01]
my_first_lora_v6:  66%|######5   | 2301/3500 [10:35<42:09,  2.11s/it, lr: 1.0e-04 loss: 7.615e-01]
my_first_lora_v6:  66%|######5   | 2301/3500 [10:35<42:09,  2.11s/it, lr: 1.0e-04 loss: 7.615e-01]
my_first_lora_v6:  66%|######5   | 2302/3500 [10:37<42:08,  2.11s/it, lr: 1.0e-04 loss: 6.320e-01]
my_first_lora_v6:  66%|######5   | 2302/3500 [10:37<42:08,  2.11s/it, lr: 1.0e-04 loss: 6.320e-01]
my_first_lora_v6:  66%|######5   | 2303/3500 [10:39<42:08,  2.11s/it, lr: 1.0e-04 loss: 6.428e-01]
my_first_lora_v6:  66%|######5   | 2303/3500 [10:39<42:08,  2.11s/it, lr: 1.0e-04 loss: 6.428e-01]
my_first_lora_v6:  66%|######5   | 2304/3500 [10:41<42:04,  2.11s/it, lr: 1.0e-04 loss: 2.901e-01]
my_first_lora_v6:  66%|######5   | 2304/3500 [10:41<42:04,  2.11s/it, lr: 1.0e-04 loss: 2.901e-01]
my_first_lora_v6:  66%|######5   | 2305/3500 [10:44<42:06,  2.11s/it, lr: 1.0e-04 loss: 3.499e-01]
my_first_lora_v6:  66%|######5   | 2305/3500 [10:44<42:06,  2.11s/it, lr: 1.0e-04 loss: 3.499e-01]
my_first_lora_v6:  66%|######5   | 2306/3500 [10:46<42:03,  2.11s/it, lr: 1.0e-04 loss: 8.062e-01]
my_first_lora_v6:  66%|######5   | 2306/3500 [10:46<42:03,  2.11s/it, lr: 1.0e-04 loss: 8.062e-01]
my_first_lora_v6:  66%|######5   | 2307/3500 [10:48<41:58,  2.11s/it, lr: 1.0e-04 loss: 3.192e-01]
my_first_lora_v6:  66%|######5   | 2307/3500 [10:48<41:58,  2.11s/it, lr: 1.0e-04 loss: 3.192e-01]
my_first_lora_v6:  66%|######5   | 2308/3500 [10:50<41:57,  2.11s/it, lr: 1.0e-04 loss: 6.462e-01]
my_first_lora_v6:  66%|######5   | 2308/3500 [10:50<41:57,  2.11s/it, lr: 1.0e-04 loss: 6.462e-01]
my_first_lora_v6:  66%|######5   | 2309/3500 [10:52<41:56,  2.11s/it, lr: 1.0e-04 loss: 6.906e-01]
my_first_lora_v6:  66%|######5   | 2309/3500 [10:52<41:56,  2.11s/it, lr: 1.0e-04 loss: 6.906e-01]
my_first_lora_v6:  66%|######6   | 2310/3500 [10:55<41:55,  2.11s/it, lr: 1.0e-04 loss: 4.034e-01]
my_first_lora_v6:  66%|######6   | 2310/3500 [10:55<41:55,  2.11s/it, lr: 1.0e-04 loss: 4.034e-01]
my_first_lora_v6:  66%|######6   | 2311/3500 [10:57<41:52,  2.11s/it, lr: 1.0e-04 loss: 3.421e-01]
my_first_lora_v6:  66%|######6   | 2311/3500 [10:57<41:52,  2.11s/it, lr: 1.0e-04 loss: 3.421e-01]
my_first_lora_v6:  66%|######6   | 2312/3500 [10:58<41:46,  2.11s/it, lr: 1.0e-04 loss: 7.029e-01]
my_first_lora_v6:  66%|######6   | 2312/3500 [10:58<41:46,  2.11s/it, lr: 1.0e-04 loss: 7.029e-01]
my_first_lora_v6:  66%|######6   | 2313/3500 [11:00<41:45,  2.11s/it, lr: 1.0e-04 loss: 5.588e-01]
my_first_lora_v6:  66%|######6   | 2313/3500 [11:00<41:45,  2.11s/it, lr: 1.0e-04 loss: 5.588e-01]
my_first_lora_v6:  66%|######6   | 2314/3500 [11:03<41:45,  2.11s/it, lr: 1.0e-04 loss: 7.975e-01]
my_first_lora_v6:  66%|######6   | 2314/3500 [11:03<41:45,  2.11s/it, lr: 1.0e-04 loss: 7.975e-01]
my_first_lora_v6:  66%|######6   | 2315/3500 [11:05<41:44,  2.11s/it, lr: 1.0e-04 loss: 5.209e-01]
my_first_lora_v6:  66%|######6   | 2315/3500 [11:05<41:44,  2.11s/it, lr: 1.0e-04 loss: 5.209e-01]
my_first_lora_v6:  66%|######6   | 2316/3500 [11:07<41:42,  2.11s/it, lr: 1.0e-04 loss: 5.796e-01]
my_first_lora_v6:  66%|######6   | 2316/3500 [11:07<41:42,  2.11s/it, lr: 1.0e-04 loss: 5.796e-01]
my_first_lora_v6:  66%|######6   | 2317/3500 [11:08<41:35,  2.11s/it, lr: 1.0e-04 loss: 6.992e-01]
my_first_lora_v6:  66%|######6   | 2317/3500 [11:08<41:35,  2.11s/it, lr: 1.0e-04 loss: 6.992e-01]
my_first_lora_v6:  66%|######6   | 2318/3500 [11:11<41:36,  2.11s/it, lr: 1.0e-04 loss: 5.498e-01]
my_first_lora_v6:  66%|######6   | 2318/3500 [11:11<41:36,  2.11s/it, lr: 1.0e-04 loss: 5.498e-01]
my_first_lora_v6:  66%|######6   | 2319/3500 [11:13<41:35,  2.11s/it, lr: 1.0e-04 loss: 5.976e-01]
my_first_lora_v6:  66%|######6   | 2319/3500 [11:13<41:35,  2.11s/it, lr: 1.0e-04 loss: 5.976e-01]
my_first_lora_v6:  66%|######6   | 2320/3500 [11:16<41:34,  2.11s/it, lr: 1.0e-04 loss: 3.267e-01]
my_first_lora_v6:  66%|######6   | 2320/3500 [11:16<41:34,  2.11s/it, lr: 1.0e-04 loss: 3.267e-01]
my_first_lora_v6:  66%|######6   | 2321/3500 [11:17<41:28,  2.11s/it, lr: 1.0e-04 loss: 4.864e-01]
my_first_lora_v6:  66%|######6   | 2321/3500 [11:17<41:28,  2.11s/it, lr: 1.0e-04 loss: 4.864e-01]
my_first_lora_v6:  66%|######6   | 2322/3500 [11:19<41:26,  2.11s/it, lr: 1.0e-04 loss: 1.426e-01]
my_first_lora_v6:  66%|######6   | 2322/3500 [11:19<41:26,  2.11s/it, lr: 1.0e-04 loss: 1.426e-01]
my_first_lora_v6:  66%|######6   | 2323/3500 [11:21<41:23,  2.11s/it, lr: 1.0e-04 loss: 3.355e-01]
my_first_lora_v6:  66%|######6   | 2323/3500 [11:21<41:23,  2.11s/it, lr: 1.0e-04 loss: 3.355e-01]
my_first_lora_v6:  66%|######6   | 2324/3500 [11:22<41:17,  2.11s/it, lr: 1.0e-04 loss: 5.229e-01]
my_first_lora_v6:  66%|######6   | 2324/3500 [11:22<41:17,  2.11s/it, lr: 1.0e-04 loss: 5.229e-01]
my_first_lora_v6:  66%|######6   | 2325/3500 [11:25<41:17,  2.11s/it, lr: 1.0e-04 loss: 6.907e-01]
my_first_lora_v6:  66%|######6   | 2325/3500 [11:25<41:17,  2.11s/it, lr: 1.0e-04 loss: 6.907e-01]
my_first_lora_v6:  66%|######6   | 2326/3500 [11:27<41:16,  2.11s/it, lr: 1.0e-04 loss: 8.054e-02]
my_first_lora_v6:  66%|######6   | 2326/3500 [11:27<41:16,  2.11s/it, lr: 1.0e-04 loss: 8.054e-02]
my_first_lora_v6:  66%|######6   | 2327/3500 [11:28<41:10,  2.11s/it, lr: 1.0e-04 loss: 7.853e-01]
my_first_lora_v6:  66%|######6   | 2327/3500 [11:28<41:10,  2.11s/it, lr: 1.0e-04 loss: 7.853e-01]
my_first_lora_v6:  67%|######6   | 2328/3500 [11:30<41:07,  2.11s/it, lr: 1.0e-04 loss: 2.116e-01]
my_first_lora_v6:  67%|######6   | 2328/3500 [11:30<41:07,  2.11s/it, lr: 1.0e-04 loss: 2.116e-01]
my_first_lora_v6:  67%|######6   | 2329/3500 [11:33<41:07,  2.11s/it, lr: 1.0e-04 loss: 7.523e-01]
my_first_lora_v6:  67%|######6   | 2329/3500 [11:33<41:07,  2.11s/it, lr: 1.0e-04 loss: 7.523e-01]
my_first_lora_v6:  67%|######6   | 2330/3500 [11:35<41:06,  2.11s/it, lr: 1.0e-04 loss: 7.256e-02]
my_first_lora_v6:  67%|######6   | 2330/3500 [11:35<41:06,  2.11s/it, lr: 1.0e-04 loss: 7.256e-02]
my_first_lora_v6:  67%|######6   | 2331/3500 [11:38<41:05,  2.11s/it, lr: 1.0e-04 loss: 7.050e-01]
my_first_lora_v6:  67%|######6   | 2331/3500 [11:38<41:05,  2.11s/it, lr: 1.0e-04 loss: 7.050e-01]
my_first_lora_v6:  67%|######6   | 2332/3500 [11:40<41:06,  2.11s/it, lr: 1.0e-04 loss: 5.353e-01]
my_first_lora_v6:  67%|######6   | 2332/3500 [11:40<41:06,  2.11s/it, lr: 1.0e-04 loss: 5.353e-01]
my_first_lora_v6:  67%|######6   | 2333/3500 [11:43<41:05,  2.11s/it, lr: 1.0e-04 loss: 5.207e-02]
my_first_lora_v6:  67%|######6   | 2333/3500 [11:43<41:05,  2.11s/it, lr: 1.0e-04 loss: 5.207e-02]
my_first_lora_v6:  67%|######6   | 2334/3500 [11:46<41:05,  2.11s/it, lr: 1.0e-04 loss: 7.181e-01]
my_first_lora_v6:  67%|######6   | 2334/3500 [11:46<41:05,  2.11s/it, lr: 1.0e-04 loss: 7.181e-01]
my_first_lora_v6:  67%|######6   | 2335/3500 [11:48<41:04,  2.12s/it, lr: 1.0e-04 loss: 3.303e-01]
my_first_lora_v6:  67%|######6   | 2335/3500 [11:48<41:04,  2.12s/it, lr: 1.0e-04 loss: 3.303e-01]
my_first_lora_v6:  67%|######6   | 2336/3500 [11:50<41:02,  2.12s/it, lr: 1.0e-04 loss: 7.955e-01]
my_first_lora_v6:  67%|######6   | 2336/3500 [11:50<41:02,  2.12s/it, lr: 1.0e-04 loss: 7.955e-01]
my_first_lora_v6:  67%|######6   | 2337/3500 [11:53<41:01,  2.12s/it, lr: 1.0e-04 loss: 3.489e-01]
my_first_lora_v6:  67%|######6   | 2337/3500 [11:53<41:01,  2.12s/it, lr: 1.0e-04 loss: 3.489e-01]
my_first_lora_v6:  67%|######6   | 2338/3500 [11:54<40:55,  2.11s/it, lr: 1.0e-04 loss: 2.916e-01]
my_first_lora_v6:  67%|######6   | 2338/3500 [11:54<40:55,  2.11s/it, lr: 1.0e-04 loss: 2.916e-01]
my_first_lora_v6:  67%|######6   | 2339/3500 [11:55<40:50,  2.11s/it, lr: 1.0e-04 loss: 7.307e-01]
my_first_lora_v6:  67%|######6   | 2339/3500 [11:55<40:50,  2.11s/it, lr: 1.0e-04 loss: 7.307e-01]
my_first_lora_v6:  67%|######6   | 2340/3500 [11:57<40:46,  2.11s/it, lr: 1.0e-04 loss: 2.478e-01]
my_first_lora_v6:  67%|######6   | 2340/3500 [11:57<40:46,  2.11s/it, lr: 1.0e-04 loss: 2.478e-01]
my_first_lora_v6:  67%|######6   | 2341/3500 [11:58<40:41,  2.11s/it, lr: 1.0e-04 loss: 8.303e-01]
my_first_lora_v6:  67%|######6   | 2341/3500 [11:58<40:41,  2.11s/it, lr: 1.0e-04 loss: 8.303e-01]
my_first_lora_v6:  67%|######6   | 2342/3500 [12:00<40:40,  2.11s/it, lr: 1.0e-04 loss: 2.651e-01]
my_first_lora_v6:  67%|######6   | 2342/3500 [12:00<40:40,  2.11s/it, lr: 1.0e-04 loss: 2.651e-01]
my_first_lora_v6:  67%|######6   | 2343/3500 [12:01<40:35,  2.10s/it, lr: 1.0e-04 loss: 7.442e-01]
my_first_lora_v6:  67%|######6   | 2343/3500 [12:01<40:35,  2.10s/it, lr: 1.0e-04 loss: 7.442e-01]
my_first_lora_v6:  67%|######6   | 2344/3500 [12:03<40:32,  2.10s/it, lr: 1.0e-04 loss: 4.856e-01]
my_first_lora_v6:  67%|######6   | 2344/3500 [12:03<40:32,  2.10s/it, lr: 1.0e-04 loss: 4.856e-01]
my_first_lora_v6:  67%|######7   | 2345/3500 [12:06<40:31,  2.11s/it, lr: 1.0e-04 loss: 1.313e-01]
my_first_lora_v6:  67%|######7   | 2345/3500 [12:06<40:31,  2.11s/it, lr: 1.0e-04 loss: 1.313e-01]
my_first_lora_v6:  67%|######7   | 2346/3500 [12:08<40:28,  2.10s/it, lr: 1.0e-04 loss: 7.035e-01]
my_first_lora_v6:  67%|######7   | 2346/3500 [12:08<40:28,  2.10s/it, lr: 1.0e-04 loss: 7.035e-01]
my_first_lora_v6:  67%|######7   | 2347/3500 [12:10<40:28,  2.11s/it, lr: 1.0e-04 loss: 7.746e-01]
my_first_lora_v6:  67%|######7   | 2347/3500 [12:10<40:28,  2.11s/it, lr: 1.0e-04 loss: 7.746e-01]
my_first_lora_v6:  67%|######7   | 2348/3500 [12:13<40:27,  2.11s/it, lr: 1.0e-04 loss: 4.273e-01]
my_first_lora_v6:  67%|######7   | 2348/3500 [12:13<40:27,  2.11s/it, lr: 1.0e-04 loss: 4.273e-01]
my_first_lora_v6:  67%|######7   | 2349/3500 [12:15<40:27,  2.11s/it, lr: 1.0e-04 loss: 6.526e-01]
my_first_lora_v6:  67%|######7   | 2349/3500 [12:15<40:27,  2.11s/it, lr: 1.0e-04 loss: 6.526e-01]
my_first_lora_v6:  67%|######7   | 2350/3500 [12:17<40:22,  2.11s/it, lr: 1.0e-04 loss: 3.413e-01]
my_first_lora_v6:  67%|######7   | 2350/3500 [12:17<40:22,  2.11s/it, lr: 1.0e-04 loss: 3.413e-01]
my_first_lora_v6:  67%|######7   | 2351/3500 [12:20<40:22,  2.11s/it, lr: 1.0e-04 loss: 3.507e-01]
my_first_lora_v6:  67%|######7   | 2351/3500 [12:20<40:22,  2.11s/it, lr: 1.0e-04 loss: 3.507e-01]
my_first_lora_v6:  67%|######7   | 2352/3500 [12:21<40:16,  2.11s/it, lr: 1.0e-04 loss: 6.415e-01]
my_first_lora_v6:  67%|######7   | 2352/3500 [12:21<40:16,  2.11s/it, lr: 1.0e-04 loss: 6.415e-01]
my_first_lora_v6:  67%|######7   | 2353/3500 [12:23<40:15,  2.11s/it, lr: 1.0e-04 loss: 6.665e-01]
my_first_lora_v6:  67%|######7   | 2353/3500 [12:23<40:15,  2.11s/it, lr: 1.0e-04 loss: 6.665e-01]
my_first_lora_v6:  67%|######7   | 2354/3500 [12:25<40:13,  2.11s/it, lr: 1.0e-04 loss: 6.379e-01]
my_first_lora_v6:  67%|######7   | 2354/3500 [12:25<40:13,  2.11s/it, lr: 1.0e-04 loss: 6.379e-01]
my_first_lora_v6:  67%|######7   | 2355/3500 [12:28<40:12,  2.11s/it, lr: 1.0e-04 loss: 6.336e-01]
my_first_lora_v6:  67%|######7   | 2355/3500 [12:28<40:12,  2.11s/it, lr: 1.0e-04 loss: 6.336e-01]
my_first_lora_v6:  67%|######7   | 2356/3500 [12:30<40:12,  2.11s/it, lr: 1.0e-04 loss: 5.991e-01]
my_first_lora_v6:  67%|######7   | 2356/3500 [12:30<40:12,  2.11s/it, lr: 1.0e-04 loss: 5.991e-01]
my_first_lora_v6:  67%|######7   | 2357/3500 [12:33<40:11,  2.11s/it, lr: 1.0e-04 loss: 1.734e-01]
my_first_lora_v6:  67%|######7   | 2357/3500 [12:33<40:11,  2.11s/it, lr: 1.0e-04 loss: 1.734e-01]
my_first_lora_v6:  67%|######7   | 2358/3500 [12:35<40:08,  2.11s/it, lr: 1.0e-04 loss: 9.979e-02]
my_first_lora_v6:  67%|######7   | 2358/3500 [12:35<40:08,  2.11s/it, lr: 1.0e-04 loss: 9.979e-02]
my_first_lora_v6:  67%|######7   | 2359/3500 [12:37<40:08,  2.11s/it, lr: 1.0e-04 loss: 3.040e-01]
my_first_lora_v6:  67%|######7   | 2359/3500 [12:37<40:08,  2.11s/it, lr: 1.0e-04 loss: 3.040e-01]
my_first_lora_v6:  67%|######7   | 2360/3500 [12:40<40:07,  2.11s/it, lr: 1.0e-04 loss: 4.740e-01]
my_first_lora_v6:  67%|######7   | 2360/3500 [12:40<40:07,  2.11s/it, lr: 1.0e-04 loss: 4.740e-01]
my_first_lora_v6:  67%|######7   | 2361/3500 [12:42<40:04,  2.11s/it, lr: 1.0e-04 loss: 5.894e-02]
my_first_lora_v6:  67%|######7   | 2361/3500 [12:42<40:04,  2.11s/it, lr: 1.0e-04 loss: 5.894e-02]
my_first_lora_v6:  67%|######7   | 2362/3500 [12:44<40:04,  2.11s/it, lr: 1.0e-04 loss: 1.099e-01]
my_first_lora_v6:  67%|######7   | 2362/3500 [12:44<40:04,  2.11s/it, lr: 1.0e-04 loss: 1.099e-01]
my_first_lora_v6:  68%|######7   | 2363/3500 [12:47<40:03,  2.11s/it, lr: 1.0e-04 loss: 1.910e-01]
my_first_lora_v6:  68%|######7   | 2363/3500 [12:47<40:03,  2.11s/it, lr: 1.0e-04 loss: 1.910e-01]
my_first_lora_v6:  68%|######7   | 2364/3500 [12:49<40:01,  2.11s/it, lr: 1.0e-04 loss: 7.479e-01]
my_first_lora_v6:  68%|######7   | 2364/3500 [12:49<40:01,  2.11s/it, lr: 1.0e-04 loss: 7.479e-01]
my_first_lora_v6:  68%|######7   | 2365/3500 [12:50<39:57,  2.11s/it, lr: 1.0e-04 loss: 1.726e-02]
my_first_lora_v6:  68%|######7   | 2365/3500 [12:50<39:57,  2.11s/it, lr: 1.0e-04 loss: 1.726e-02]
my_first_lora_v6:  68%|######7   | 2366/3500 [12:53<39:56,  2.11s/it, lr: 1.0e-04 loss: 6.467e-01]
my_first_lora_v6:  68%|######7   | 2366/3500 [12:53<39:56,  2.11s/it, lr: 1.0e-04 loss: 6.467e-01]
my_first_lora_v6:  68%|######7   | 2367/3500 [12:54<39:50,  2.11s/it, lr: 1.0e-04 loss: 1.051e-01]
my_first_lora_v6:  68%|######7   | 2367/3500 [12:54<39:50,  2.11s/it, lr: 1.0e-04 loss: 1.051e-01]
my_first_lora_v6:  68%|######7   | 2368/3500 [12:57<39:50,  2.11s/it, lr: 1.0e-04 loss: 1.627e-01]
my_first_lora_v6:  68%|######7   | 2368/3500 [12:57<39:50,  2.11s/it, lr: 1.0e-04 loss: 1.627e-01]
my_first_lora_v6:  68%|######7   | 2369/3500 [12:59<39:50,  2.11s/it, lr: 1.0e-04 loss: 3.014e-01]
my_first_lora_v6:  68%|######7   | 2369/3500 [12:59<39:50,  2.11s/it, lr: 1.0e-04 loss: 3.014e-01]
my_first_lora_v6:  68%|######7   | 2370/3500 [13:01<39:47,  2.11s/it, lr: 1.0e-04 loss: 2.073e-01]
my_first_lora_v6:  68%|######7   | 2370/3500 [13:01<39:47,  2.11s/it, lr: 1.0e-04 loss: 2.073e-01]
my_first_lora_v6:  68%|######7   | 2371/3500 [13:02<39:42,  2.11s/it, lr: 1.0e-04 loss: 6.283e-01]
my_first_lora_v6:  68%|######7   | 2371/3500 [13:02<39:42,  2.11s/it, lr: 1.0e-04 loss: 6.283e-01]
my_first_lora_v6:  68%|######7   | 2372/3500 [13:05<39:41,  2.11s/it, lr: 1.0e-04 loss: 3.207e-01]
my_first_lora_v6:  68%|######7   | 2372/3500 [13:05<39:41,  2.11s/it, lr: 1.0e-04 loss: 3.207e-01]
my_first_lora_v6:  68%|######7   | 2373/3500 [13:07<39:40,  2.11s/it, lr: 1.0e-04 loss: 8.183e-01]
my_first_lora_v6:  68%|######7   | 2373/3500 [13:07<39:40,  2.11s/it, lr: 1.0e-04 loss: 8.183e-01]
my_first_lora_v6:  68%|######7   | 2374/3500 [13:09<39:37,  2.11s/it, lr: 1.0e-04 loss: 2.993e-02]
my_first_lora_v6:  68%|######7   | 2374/3500 [13:09<39:37,  2.11s/it, lr: 1.0e-04 loss: 2.993e-02]
my_first_lora_v6:  68%|######7   | 2375/3500 [13:10<39:32,  2.11s/it, lr: 1.0e-04 loss: 4.595e-01]
my_first_lora_v6:  68%|######7   | 2375/3500 [13:10<39:32,  2.11s/it, lr: 1.0e-04 loss: 4.595e-01]
my_first_lora_v6:  68%|######7   | 2376/3500 [13:13<39:31,  2.11s/it, lr: 1.0e-04 loss: 6.871e-01]
my_first_lora_v6:  68%|######7   | 2376/3500 [13:13<39:31,  2.11s/it, lr: 1.0e-04 loss: 6.871e-01]
my_first_lora_v6:  68%|######7   | 2377/3500 [13:15<39:30,  2.11s/it, lr: 1.0e-04 loss: 6.602e-01]
my_first_lora_v6:  68%|######7   | 2377/3500 [13:15<39:30,  2.11s/it, lr: 1.0e-04 loss: 6.602e-01]
my_first_lora_v6:  68%|######7   | 2378/3500 [13:18<39:30,  2.11s/it, lr: 1.0e-04 loss: 6.127e-01]
my_first_lora_v6:  68%|######7   | 2378/3500 [13:18<39:30,  2.11s/it, lr: 1.0e-04 loss: 6.127e-01]
my_first_lora_v6:  68%|######7   | 2379/3500 [13:20<39:29,  2.11s/it, lr: 1.0e-04 loss: 4.717e-01]
my_first_lora_v6:  68%|######7   | 2379/3500 [13:20<39:29,  2.11s/it, lr: 1.0e-04 loss: 4.717e-01]
my_first_lora_v6:  68%|######8   | 2380/3500 [13:22<39:26,  2.11s/it, lr: 1.0e-04 loss: 4.931e-02]
my_first_lora_v6:  68%|######8   | 2380/3500 [13:22<39:26,  2.11s/it, lr: 1.0e-04 loss: 4.931e-02]
my_first_lora_v6:  68%|######8   | 2381/3500 [13:25<39:25,  2.11s/it, lr: 1.0e-04 loss: 8.424e-01]
my_first_lora_v6:  68%|######8   | 2381/3500 [13:25<39:25,  2.11s/it, lr: 1.0e-04 loss: 8.424e-01]
my_first_lora_v6:  68%|######8   | 2382/3500 [13:27<39:24,  2.11s/it, lr: 1.0e-04 loss: 1.230e-01]
my_first_lora_v6:  68%|######8   | 2382/3500 [13:27<39:24,  2.11s/it, lr: 1.0e-04 loss: 1.230e-01]
my_first_lora_v6:  68%|######8   | 2383/3500 [13:28<39:18,  2.11s/it, lr: 1.0e-04 loss: 8.442e-01]
my_first_lora_v6:  68%|######8   | 2383/3500 [13:28<39:18,  2.11s/it, lr: 1.0e-04 loss: 8.442e-01]
my_first_lora_v6:  68%|######8   | 2384/3500 [13:29<39:13,  2.11s/it, lr: 1.0e-04 loss: 5.183e-02]
my_first_lora_v6:  68%|######8   | 2384/3500 [13:29<39:13,  2.11s/it, lr: 1.0e-04 loss: 5.183e-02]
my_first_lora_v6:  68%|######8   | 2385/3500 [13:32<39:12,  2.11s/it, lr: 1.0e-04 loss: 3.839e-01]
my_first_lora_v6:  68%|######8   | 2385/3500 [13:32<39:12,  2.11s/it, lr: 1.0e-04 loss: 3.839e-01]
my_first_lora_v6:  68%|######8   | 2386/3500 [13:35<39:12,  2.11s/it, lr: 1.0e-04 loss: 7.621e-01]
my_first_lora_v6:  68%|######8   | 2386/3500 [13:35<39:12,  2.11s/it, lr: 1.0e-04 loss: 7.621e-01]
my_first_lora_v6:  68%|######8   | 2387/3500 [13:36<39:07,  2.11s/it, lr: 1.0e-04 loss: 6.482e-01]
my_first_lora_v6:  68%|######8   | 2387/3500 [13:36<39:07,  2.11s/it, lr: 1.0e-04 loss: 6.482e-01]
my_first_lora_v6:  68%|######8   | 2388/3500 [13:38<39:06,  2.11s/it, lr: 1.0e-04 loss: 2.026e-01]
my_first_lora_v6:  68%|######8   | 2388/3500 [13:38<39:06,  2.11s/it, lr: 1.0e-04 loss: 2.026e-01]
my_first_lora_v6:  68%|######8   | 2389/3500 [13:41<39:05,  2.11s/it, lr: 1.0e-04 loss: 4.955e-01]
my_first_lora_v6:  68%|######8   | 2389/3500 [13:41<39:05,  2.11s/it, lr: 1.0e-04 loss: 4.955e-01]
my_first_lora_v6:  68%|######8   | 2390/3500 [13:43<39:04,  2.11s/it, lr: 1.0e-04 loss: 1.255e-01]
my_first_lora_v6:  68%|######8   | 2390/3500 [13:43<39:04,  2.11s/it, lr: 1.0e-04 loss: 1.255e-01]
my_first_lora_v6:  68%|######8   | 2391/3500 [13:46<39:03,  2.11s/it, lr: 1.0e-04 loss: 7.191e-01]
my_first_lora_v6:  68%|######8   | 2391/3500 [13:46<39:03,  2.11s/it, lr: 1.0e-04 loss: 7.191e-01]
my_first_lora_v6:  68%|######8   | 2392/3500 [13:47<38:57,  2.11s/it, lr: 1.0e-04 loss: 1.782e-01]
my_first_lora_v6:  68%|######8   | 2392/3500 [13:47<38:57,  2.11s/it, lr: 1.0e-04 loss: 1.782e-01]
my_first_lora_v6:  68%|######8   | 2393/3500 [13:49<38:56,  2.11s/it, lr: 1.0e-04 loss: 5.245e-01]
my_first_lora_v6:  68%|######8   | 2393/3500 [13:49<38:56,  2.11s/it, lr: 1.0e-04 loss: 5.245e-01]
my_first_lora_v6:  68%|######8   | 2394/3500 [13:51<38:53,  2.11s/it, lr: 1.0e-04 loss: 5.247e-01]
my_first_lora_v6:  68%|######8   | 2394/3500 [13:51<38:53,  2.11s/it, lr: 1.0e-04 loss: 5.247e-01]
my_first_lora_v6:  68%|######8   | 2395/3500 [13:53<38:51,  2.11s/it, lr: 1.0e-04 loss: 5.049e-01]
my_first_lora_v6:  68%|######8   | 2395/3500 [13:53<38:51,  2.11s/it, lr: 1.0e-04 loss: 5.049e-01]
my_first_lora_v6:  68%|######8   | 2396/3500 [13:55<38:50,  2.11s/it, lr: 1.0e-04 loss: 5.727e-01]
my_first_lora_v6:  68%|######8   | 2396/3500 [13:55<38:50,  2.11s/it, lr: 1.0e-04 loss: 5.727e-01]
my_first_lora_v6:  68%|######8   | 2397/3500 [13:58<38:48,  2.11s/it, lr: 1.0e-04 loss: 7.858e-01]
my_first_lora_v6:  68%|######8   | 2397/3500 [13:58<38:48,  2.11s/it, lr: 1.0e-04 loss: 7.858e-01]
my_first_lora_v6:  69%|######8   | 2398/3500 [14:00<38:47,  2.11s/it, lr: 1.0e-04 loss: 1.626e-01]
my_first_lora_v6:  69%|######8   | 2398/3500 [14:00<38:47,  2.11s/it, lr: 1.0e-04 loss: 1.626e-01]
my_first_lora_v6:  69%|######8   | 2399/3500 [14:02<38:45,  2.11s/it, lr: 1.0e-04 loss: 4.401e-01]
my_first_lora_v6:  69%|######8   | 2399/3500 [14:02<38:45,  2.11s/it, lr: 1.0e-04 loss: 4.401e-01]
my_first_lora_v6:  69%|######8   | 2400/3500 [14:03<38:40,  2.11s/it, lr: 1.0e-04 loss: 6.934e-01]
my_first_lora_v6:  69%|######8   | 2400/3500 [14:03<38:40,  2.11s/it, lr: 1.0e-04 loss: 6.934e-01]
my_first_lora_v6:  69%|######8   | 2401/3500 [14:06<38:39,  2.11s/it, lr: 1.0e-04 loss: 2.749e-01]
my_first_lora_v6:  69%|######8   | 2401/3500 [14:06<38:39,  2.11s/it, lr: 1.0e-04 loss: 2.749e-01]
my_first_lora_v6:  69%|######8   | 2402/3500 [14:07<38:34,  2.11s/it, lr: 1.0e-04 loss: 8.238e-01]
my_first_lora_v6:  69%|######8   | 2402/3500 [14:07<38:34,  2.11s/it, lr: 1.0e-04 loss: 8.238e-01]
my_first_lora_v6:  69%|######8   | 2403/3500 [14:09<38:33,  2.11s/it, lr: 1.0e-04 loss: 5.412e-01]
my_first_lora_v6:  69%|######8   | 2403/3500 [14:09<38:33,  2.11s/it, lr: 1.0e-04 loss: 5.412e-01]
my_first_lora_v6:  69%|######8   | 2404/3500 [14:11<38:29,  2.11s/it, lr: 1.0e-04 loss: 7.859e-01]
my_first_lora_v6:  69%|######8   | 2404/3500 [14:11<38:29,  2.11s/it, lr: 1.0e-04 loss: 7.859e-01]
my_first_lora_v6:  69%|######8   | 2405/3500 [14:13<38:28,  2.11s/it, lr: 1.0e-04 loss: 6.538e-01]
my_first_lora_v6:  69%|######8   | 2405/3500 [14:13<38:28,  2.11s/it, lr: 1.0e-04 loss: 6.538e-01]
my_first_lora_v6:  69%|######8   | 2406/3500 [14:15<38:25,  2.11s/it, lr: 1.0e-04 loss: 4.273e-01]
my_first_lora_v6:  69%|######8   | 2406/3500 [14:15<38:25,  2.11s/it, lr: 1.0e-04 loss: 4.273e-01]
my_first_lora_v6:  69%|######8   | 2407/3500 [14:17<38:24,  2.11s/it, lr: 1.0e-04 loss: 1.210e-01]
my_first_lora_v6:  69%|######8   | 2407/3500 [14:17<38:24,  2.11s/it, lr: 1.0e-04 loss: 1.210e-01]
my_first_lora_v6:  69%|######8   | 2408/3500 [14:20<38:22,  2.11s/it, lr: 1.0e-04 loss: 6.132e-01]
my_first_lora_v6:  69%|######8   | 2408/3500 [14:20<38:22,  2.11s/it, lr: 1.0e-04 loss: 6.132e-01]
my_first_lora_v6:  69%|######8   | 2409/3500 [14:21<38:17,  2.11s/it, lr: 1.0e-04 loss: 8.327e-01]
my_first_lora_v6:  69%|######8   | 2409/3500 [14:21<38:17,  2.11s/it, lr: 1.0e-04 loss: 8.327e-01]
my_first_lora_v6:  69%|######8   | 2410/3500 [14:23<38:16,  2.11s/it, lr: 1.0e-04 loss: 2.349e-01]
my_first_lora_v6:  69%|######8   | 2410/3500 [14:23<38:16,  2.11s/it, lr: 1.0e-04 loss: 2.349e-01]
my_first_lora_v6:  69%|######8   | 2411/3500 [14:26<38:15,  2.11s/it, lr: 1.0e-04 loss: 1.042e-01]
my_first_lora_v6:  69%|######8   | 2411/3500 [14:26<38:15,  2.11s/it, lr: 1.0e-04 loss: 1.042e-01]
my_first_lora_v6:  69%|######8   | 2412/3500 [14:28<38:14,  2.11s/it, lr: 1.0e-04 loss: 7.565e-01]
my_first_lora_v6:  69%|######8   | 2412/3500 [14:28<38:14,  2.11s/it, lr: 1.0e-04 loss: 7.565e-01]
my_first_lora_v6:  69%|######8   | 2413/3500 [14:31<38:14,  2.11s/it, lr: 1.0e-04 loss: 7.718e-01]
my_first_lora_v6:  69%|######8   | 2413/3500 [14:31<38:14,  2.11s/it, lr: 1.0e-04 loss: 7.718e-01]
my_first_lora_v6:  69%|######8   | 2414/3500 [14:33<38:11,  2.11s/it, lr: 1.0e-04 loss: 5.121e-01]
my_first_lora_v6:  69%|######8   | 2414/3500 [14:33<38:11,  2.11s/it, lr: 1.0e-04 loss: 5.121e-01]
my_first_lora_v6:  69%|######9   | 2415/3500 [14:36<38:10,  2.11s/it, lr: 1.0e-04 loss: 2.675e-01]
my_first_lora_v6:  69%|######9   | 2415/3500 [14:36<38:10,  2.11s/it, lr: 1.0e-04 loss: 2.675e-01]
my_first_lora_v6:  69%|######9   | 2416/3500 [14:37<38:05,  2.11s/it, lr: 1.0e-04 loss: 4.021e-01]
my_first_lora_v6:  69%|######9   | 2416/3500 [14:37<38:05,  2.11s/it, lr: 1.0e-04 loss: 4.021e-01]
my_first_lora_v6:  69%|######9   | 2417/3500 [14:38<38:00,  2.11s/it, lr: 1.0e-04 loss: 3.912e-01]
my_first_lora_v6:  69%|######9   | 2417/3500 [14:38<38:00,  2.11s/it, lr: 1.0e-04 loss: 3.912e-01]
my_first_lora_v6:  69%|######9   | 2418/3500 [14:39<37:57,  2.11s/it, lr: 1.0e-04 loss: 1.462e-01]
my_first_lora_v6:  69%|######9   | 2418/3500 [14:39<37:57,  2.11s/it, lr: 1.0e-04 loss: 1.462e-01]
my_first_lora_v6:  69%|######9   | 2419/3500 [14:42<37:57,  2.11s/it, lr: 1.0e-04 loss: 7.010e-01]
my_first_lora_v6:  69%|######9   | 2419/3500 [14:42<37:57,  2.11s/it, lr: 1.0e-04 loss: 7.010e-01]
my_first_lora_v6:  69%|######9   | 2420/3500 [14:45<37:56,  2.11s/it, lr: 1.0e-04 loss: 6.502e-01]
my_first_lora_v6:  69%|######9   | 2420/3500 [14:45<37:56,  2.11s/it, lr: 1.0e-04 loss: 6.502e-01]
my_first_lora_v6:  69%|######9   | 2421/3500 [14:47<37:55,  2.11s/it, lr: 1.0e-04 loss: 7.118e-01]
my_first_lora_v6:  69%|######9   | 2421/3500 [14:47<37:55,  2.11s/it, lr: 1.0e-04 loss: 7.118e-01]
my_first_lora_v6:  69%|######9   | 2422/3500 [14:50<37:55,  2.11s/it, lr: 1.0e-04 loss: 4.433e-01]
my_first_lora_v6:  69%|######9   | 2422/3500 [14:50<37:55,  2.11s/it, lr: 1.0e-04 loss: 4.433e-01]
my_first_lora_v6:  69%|######9   | 2423/3500 [14:53<37:54,  2.11s/it, lr: 1.0e-04 loss: 5.455e-01]
my_first_lora_v6:  69%|######9   | 2423/3500 [14:53<37:54,  2.11s/it, lr: 1.0e-04 loss: 5.455e-01]
my_first_lora_v6:  69%|######9   | 2424/3500 [14:55<37:53,  2.11s/it, lr: 1.0e-04 loss: 2.103e-01]
my_first_lora_v6:  69%|######9   | 2424/3500 [14:55<37:53,  2.11s/it, lr: 1.0e-04 loss: 2.103e-01]
my_first_lora_v6:  69%|######9   | 2425/3500 [14:57<37:50,  2.11s/it, lr: 1.0e-04 loss: 2.792e-01]
my_first_lora_v6:  69%|######9   | 2425/3500 [14:57<37:50,  2.11s/it, lr: 1.0e-04 loss: 2.792e-01]
my_first_lora_v6:  69%|######9   | 2426/3500 [14:58<37:45,  2.11s/it, lr: 1.0e-04 loss: 3.894e-02]
my_first_lora_v6:  69%|######9   | 2426/3500 [14:58<37:45,  2.11s/it, lr: 1.0e-04 loss: 3.894e-02]
my_first_lora_v6:  69%|######9   | 2427/3500 [15:01<37:44,  2.11s/it, lr: 1.0e-04 loss: 6.111e-01]
my_first_lora_v6:  69%|######9   | 2427/3500 [15:01<37:44,  2.11s/it, lr: 1.0e-04 loss: 6.111e-01]
my_first_lora_v6:  69%|######9   | 2428/3500 [15:03<37:42,  2.11s/it, lr: 1.0e-04 loss: 7.388e-01]
my_first_lora_v6:  69%|######9   | 2428/3500 [15:03<37:42,  2.11s/it, lr: 1.0e-04 loss: 7.388e-01]
my_first_lora_v6:  69%|######9   | 2429/3500 [15:04<37:37,  2.11s/it, lr: 1.0e-04 loss: 1.007e-01]
my_first_lora_v6:  69%|######9   | 2429/3500 [15:04<37:37,  2.11s/it, lr: 1.0e-04 loss: 1.007e-01]
my_first_lora_v6:  69%|######9   | 2430/3500 [15:06<37:36,  2.11s/it, lr: 1.0e-04 loss: 4.285e-02]
my_first_lora_v6:  69%|######9   | 2430/3500 [15:06<37:36,  2.11s/it, lr: 1.0e-04 loss: 4.285e-02]
my_first_lora_v6:  69%|######9   | 2431/3500 [15:09<37:35,  2.11s/it, lr: 1.0e-04 loss: 4.457e-01]
my_first_lora_v6:  69%|######9   | 2431/3500 [15:09<37:35,  2.11s/it, lr: 1.0e-04 loss: 4.457e-01]
my_first_lora_v6:  69%|######9   | 2432/3500 [15:12<37:34,  2.11s/it, lr: 1.0e-04 loss: 6.467e-01]
my_first_lora_v6:  69%|######9   | 2432/3500 [15:12<37:34,  2.11s/it, lr: 1.0e-04 loss: 6.467e-01]
my_first_lora_v6:  70%|######9   | 2433/3500 [15:14<37:33,  2.11s/it, lr: 1.0e-04 loss: 7.165e-01]
my_first_lora_v6:  70%|######9   | 2433/3500 [15:14<37:33,  2.11s/it, lr: 1.0e-04 loss: 7.165e-01]
my_first_lora_v6:  70%|######9   | 2434/3500 [15:16<37:32,  2.11s/it, lr: 1.0e-04 loss: 7.865e-01]
my_first_lora_v6:  70%|######9   | 2434/3500 [15:16<37:32,  2.11s/it, lr: 1.0e-04 loss: 7.865e-01]
my_first_lora_v6:  70%|######9   | 2435/3500 [15:18<37:27,  2.11s/it, lr: 1.0e-04 loss: 5.221e-01]
my_first_lora_v6:  70%|######9   | 2435/3500 [15:18<37:27,  2.11s/it, lr: 1.0e-04 loss: 5.221e-01]
my_first_lora_v6:  70%|######9   | 2436/3500 [15:19<37:22,  2.11s/it, lr: 1.0e-04 loss: 7.457e-01]
my_first_lora_v6:  70%|######9   | 2436/3500 [15:19<37:22,  2.11s/it, lr: 1.0e-04 loss: 7.457e-01]
my_first_lora_v6:  70%|######9   | 2437/3500 [15:21<37:21,  2.11s/it, lr: 1.0e-04 loss: 7.695e-01]
my_first_lora_v6:  70%|######9   | 2437/3500 [15:21<37:21,  2.11s/it, lr: 1.0e-04 loss: 7.695e-01]
my_first_lora_v6:  70%|######9   | 2438/3500 [15:23<37:19,  2.11s/it, lr: 1.0e-04 loss: 6.326e-01]
my_first_lora_v6:  70%|######9   | 2438/3500 [15:23<37:19,  2.11s/it, lr: 1.0e-04 loss: 6.326e-01]
my_first_lora_v6:  70%|######9   | 2439/3500 [15:25<37:17,  2.11s/it, lr: 1.0e-04 loss: 1.226e-01]
my_first_lora_v6:  70%|######9   | 2439/3500 [15:25<37:17,  2.11s/it, lr: 1.0e-04 loss: 1.226e-01]
my_first_lora_v6:  70%|######9   | 2440/3500 [15:28<37:16,  2.11s/it, lr: 1.0e-04 loss: 2.129e-01]
my_first_lora_v6:  70%|######9   | 2440/3500 [15:28<37:16,  2.11s/it, lr: 1.0e-04 loss: 2.129e-01]
my_first_lora_v6:  70%|######9   | 2441/3500 [15:30<37:15,  2.11s/it, lr: 1.0e-04 loss: 4.696e-01]
my_first_lora_v6:  70%|######9   | 2441/3500 [15:30<37:15,  2.11s/it, lr: 1.0e-04 loss: 4.696e-01]
my_first_lora_v6:  70%|######9   | 2442/3500 [15:33<37:14,  2.11s/it, lr: 1.0e-04 loss: 3.327e-01]
my_first_lora_v6:  70%|######9   | 2442/3500 [15:33<37:14,  2.11s/it, lr: 1.0e-04 loss: 3.327e-01]
my_first_lora_v6:  70%|######9   | 2443/3500 [15:35<37:12,  2.11s/it, lr: 1.0e-04 loss: 6.167e-01]
my_first_lora_v6:  70%|######9   | 2443/3500 [15:35<37:12,  2.11s/it, lr: 1.0e-04 loss: 6.167e-01]
my_first_lora_v6:  70%|######9   | 2444/3500 [15:36<37:08,  2.11s/it, lr: 1.0e-04 loss: 3.291e-01]
my_first_lora_v6:  70%|######9   | 2444/3500 [15:36<37:08,  2.11s/it, lr: 1.0e-04 loss: 3.291e-01]
my_first_lora_v6:  70%|######9   | 2445/3500 [15:39<37:07,  2.11s/it, lr: 1.0e-04 loss: 6.358e-01]
my_first_lora_v6:  70%|######9   | 2445/3500 [15:39<37:07,  2.11s/it, lr: 1.0e-04 loss: 6.358e-01]
my_first_lora_v6:  70%|######9   | 2446/3500 [15:40<37:02,  2.11s/it, lr: 1.0e-04 loss: 8.361e-01]
my_first_lora_v6:  70%|######9   | 2446/3500 [15:40<37:02,  2.11s/it, lr: 1.0e-04 loss: 8.361e-01]
my_first_lora_v6:  70%|######9   | 2447/3500 [15:42<37:00,  2.11s/it, lr: 1.0e-04 loss: 8.064e-01]
my_first_lora_v6:  70%|######9   | 2447/3500 [15:42<37:00,  2.11s/it, lr: 1.0e-04 loss: 8.064e-01]
my_first_lora_v6:  70%|######9   | 2448/3500 [15:44<36:57,  2.11s/it, lr: 1.0e-04 loss: 1.979e-01]
my_first_lora_v6:  70%|######9   | 2448/3500 [15:44<36:57,  2.11s/it, lr: 1.0e-04 loss: 1.979e-01]
my_first_lora_v6:  70%|######9   | 2449/3500 [15:46<36:55,  2.11s/it, lr: 1.0e-04 loss: 9.703e-02]
my_first_lora_v6:  70%|######9   | 2449/3500 [15:46<36:55,  2.11s/it, lr: 1.0e-04 loss: 9.703e-02]
my_first_lora_v6:  70%|#######   | 2450/3500 [15:47<36:50,  2.11s/it, lr: 1.0e-04 loss: 4.555e-01]
my_first_lora_v6:  70%|#######   | 2450/3500 [15:47<36:50,  2.11s/it, lr: 1.0e-04 loss: 4.555e-01]
my_first_lora_v6:  70%|#######   | 2451/3500 [15:50<36:50,  2.11s/it, lr: 1.0e-04 loss: 6.451e-01]
my_first_lora_v6:  70%|#######   | 2451/3500 [15:50<36:50,  2.11s/it, lr: 1.0e-04 loss: 6.451e-01]
my_first_lora_v6:  70%|#######   | 2452/3500 [15:53<36:49,  2.11s/it, lr: 1.0e-04 loss: 6.311e-01]
my_first_lora_v6:  70%|#######   | 2452/3500 [15:53<36:49,  2.11s/it, lr: 1.0e-04 loss: 6.311e-01]
my_first_lora_v6:  70%|#######   | 2453/3500 [15:55<36:48,  2.11s/it, lr: 1.0e-04 loss: 8.184e-01]
my_first_lora_v6:  70%|#######   | 2453/3500 [15:55<36:48,  2.11s/it, lr: 1.0e-04 loss: 8.184e-01]
my_first_lora_v6:  70%|#######   | 2454/3500 [15:57<36:47,  2.11s/it, lr: 1.0e-04 loss: 4.962e-01]
my_first_lora_v6:  70%|#######   | 2454/3500 [15:57<36:47,  2.11s/it, lr: 1.0e-04 loss: 4.962e-01]
my_first_lora_v6:  70%|#######   | 2455/3500 [16:00<36:45,  2.11s/it, lr: 1.0e-04 loss: 3.426e-01]
my_first_lora_v6:  70%|#######   | 2455/3500 [16:00<36:45,  2.11s/it, lr: 1.0e-04 loss: 3.426e-01]
my_first_lora_v6:  70%|#######   | 2456/3500 [16:01<36:41,  2.11s/it, lr: 1.0e-04 loss: 7.722e-01]
my_first_lora_v6:  70%|#######   | 2456/3500 [16:01<36:41,  2.11s/it, lr: 1.0e-04 loss: 7.722e-01]
my_first_lora_v6:  70%|#######   | 2457/3500 [16:03<36:38,  2.11s/it, lr: 1.0e-04 loss: 2.684e-01]
my_first_lora_v6:  70%|#######   | 2457/3500 [16:03<36:38,  2.11s/it, lr: 1.0e-04 loss: 2.684e-01]
my_first_lora_v6:  70%|#######   | 2458/3500 [16:06<36:37,  2.11s/it, lr: 1.0e-04 loss: 1.046e-01]
my_first_lora_v6:  70%|#######   | 2458/3500 [16:06<36:37,  2.11s/it, lr: 1.0e-04 loss: 1.046e-01]
my_first_lora_v6:  70%|#######   | 2459/3500 [16:08<36:36,  2.11s/it, lr: 1.0e-04 loss: 5.533e-01]
my_first_lora_v6:  70%|#######   | 2459/3500 [16:08<36:36,  2.11s/it, lr: 1.0e-04 loss: 5.533e-01]
my_first_lora_v6:  70%|#######   | 2460/3500 [16:10<36:35,  2.11s/it, lr: 1.0e-04 loss: 6.801e-01]
my_first_lora_v6:  70%|#######   | 2460/3500 [16:10<36:35,  2.11s/it, lr: 1.0e-04 loss: 6.801e-01]
my_first_lora_v6:  70%|#######   | 2461/3500 [16:12<36:32,  2.11s/it, lr: 1.0e-04 loss: 3.972e-01]
my_first_lora_v6:  70%|#######   | 2461/3500 [16:12<36:32,  2.11s/it, lr: 1.0e-04 loss: 3.972e-01]
my_first_lora_v6:  70%|#######   | 2462/3500 [16:15<36:31,  2.11s/it, lr: 1.0e-04 loss: 7.729e-01]
my_first_lora_v6:  70%|#######   | 2462/3500 [16:15<36:31,  2.11s/it, lr: 1.0e-04 loss: 7.729e-01]
my_first_lora_v6:  70%|#######   | 2463/3500 [16:16<36:27,  2.11s/it, lr: 1.0e-04 loss: 2.585e-01]
my_first_lora_v6:  70%|#######   | 2463/3500 [16:16<36:27,  2.11s/it, lr: 1.0e-04 loss: 2.585e-01]
my_first_lora_v6:  70%|#######   | 2464/3500 [16:17<36:22,  2.11s/it, lr: 1.0e-04 loss: 5.798e-02]
my_first_lora_v6:  70%|#######   | 2464/3500 [16:17<36:22,  2.11s/it, lr: 1.0e-04 loss: 5.798e-02]
my_first_lora_v6:  70%|#######   | 2465/3500 [16:19<36:20,  2.11s/it, lr: 1.0e-04 loss: 3.864e-01]
my_first_lora_v6:  70%|#######   | 2465/3500 [16:19<36:20,  2.11s/it, lr: 1.0e-04 loss: 3.864e-01]
my_first_lora_v6:  70%|#######   | 2466/3500 [16:22<36:19,  2.11s/it, lr: 1.0e-04 loss: 1.702e-01]
my_first_lora_v6:  70%|#######   | 2466/3500 [16:22<36:19,  2.11s/it, lr: 1.0e-04 loss: 1.702e-01]
my_first_lora_v6:  70%|#######   | 2467/3500 [16:24<36:17,  2.11s/it, lr: 1.0e-04 loss: 2.722e-01]
my_first_lora_v6:  70%|#######   | 2467/3500 [16:24<36:17,  2.11s/it, lr: 1.0e-04 loss: 2.722e-01]
my_first_lora_v6:  71%|#######   | 2468/3500 [16:26<36:16,  2.11s/it, lr: 1.0e-04 loss: 4.680e-02]
my_first_lora_v6:  71%|#######   | 2468/3500 [16:26<36:16,  2.11s/it, lr: 1.0e-04 loss: 4.680e-02]
my_first_lora_v6:  71%|#######   | 2469/3500 [16:29<36:15,  2.11s/it, lr: 1.0e-04 loss: 3.647e-01]
my_first_lora_v6:  71%|#######   | 2469/3500 [16:29<36:15,  2.11s/it, lr: 1.0e-04 loss: 3.647e-01]
my_first_lora_v6:  71%|#######   | 2470/3500 [16:30<36:11,  2.11s/it, lr: 1.0e-04 loss: 7.244e-01]
my_first_lora_v6:  71%|#######   | 2470/3500 [16:30<36:11,  2.11s/it, lr: 1.0e-04 loss: 7.244e-01]
my_first_lora_v6:  71%|#######   | 2471/3500 [16:33<36:09,  2.11s/it, lr: 1.0e-04 loss: 4.547e-01]
my_first_lora_v6:  71%|#######   | 2471/3500 [16:33<36:09,  2.11s/it, lr: 1.0e-04 loss: 4.547e-01]
my_first_lora_v6:  71%|#######   | 2472/3500 [16:35<36:08,  2.11s/it, lr: 1.0e-04 loss: 7.274e-01]
my_first_lora_v6:  71%|#######   | 2472/3500 [16:35<36:08,  2.11s/it, lr: 1.0e-04 loss: 7.274e-01]
my_first_lora_v6:  71%|#######   | 2473/3500 [16:36<36:03,  2.11s/it, lr: 1.0e-04 loss: 6.990e-01]
my_first_lora_v6:  71%|#######   | 2473/3500 [16:36<36:03,  2.11s/it, lr: 1.0e-04 loss: 6.990e-01]
my_first_lora_v6:  71%|#######   | 2474/3500 [16:39<36:02,  2.11s/it, lr: 1.0e-04 loss: 5.349e-02]
my_first_lora_v6:  71%|#######   | 2474/3500 [16:39<36:02,  2.11s/it, lr: 1.0e-04 loss: 5.349e-02]
my_first_lora_v6:  71%|#######   | 2475/3500 [16:41<36:00,  2.11s/it, lr: 1.0e-04 loss: 4.645e-01]
my_first_lora_v6:  71%|#######   | 2475/3500 [16:41<36:00,  2.11s/it, lr: 1.0e-04 loss: 4.645e-01]
my_first_lora_v6:  71%|#######   | 2476/3500 [16:44<36:00,  2.11s/it, lr: 1.0e-04 loss: 6.301e-01]
my_first_lora_v6:  71%|#######   | 2476/3500 [16:44<36:00,  2.11s/it, lr: 1.0e-04 loss: 6.301e-01]
my_first_lora_v6:  71%|#######   | 2477/3500 [16:45<35:55,  2.11s/it, lr: 1.0e-04 loss: 1.105e-01]
my_first_lora_v6:  71%|#######   | 2477/3500 [16:45<35:55,  2.11s/it, lr: 1.0e-04 loss: 1.105e-01]
my_first_lora_v6:  71%|#######   | 2478/3500 [16:47<35:53,  2.11s/it, lr: 1.0e-04 loss: 5.102e-01]
my_first_lora_v6:  71%|#######   | 2478/3500 [16:47<35:53,  2.11s/it, lr: 1.0e-04 loss: 5.102e-01]
my_first_lora_v6:  71%|#######   | 2479/3500 [16:49<35:52,  2.11s/it, lr: 1.0e-04 loss: 6.925e-01]
my_first_lora_v6:  71%|#######   | 2479/3500 [16:49<35:52,  2.11s/it, lr: 1.0e-04 loss: 6.925e-01]
my_first_lora_v6:  71%|#######   | 2480/3500 [16:50<35:48,  2.11s/it, lr: 1.0e-04 loss: 1.999e-01]
my_first_lora_v6:  71%|#######   | 2480/3500 [16:50<35:48,  2.11s/it, lr: 1.0e-04 loss: 1.999e-01]
my_first_lora_v6:  71%|#######   | 2481/3500 [16:53<35:46,  2.11s/it, lr: 1.0e-04 loss: 1.250e-01]
my_first_lora_v6:  71%|#######   | 2481/3500 [16:53<35:46,  2.11s/it, lr: 1.0e-04 loss: 1.250e-01]
my_first_lora_v6:  71%|#######   | 2482/3500 [16:55<35:44,  2.11s/it, lr: 1.0e-04 loss: 1.624e-01]
my_first_lora_v6:  71%|#######   | 2482/3500 [16:55<35:44,  2.11s/it, lr: 1.0e-04 loss: 1.624e-01]
my_first_lora_v6:  71%|#######   | 2483/3500 [16:57<35:42,  2.11s/it, lr: 1.0e-04 loss: 7.613e-01]
my_first_lora_v6:  71%|#######   | 2483/3500 [16:57<35:42,  2.11s/it, lr: 1.0e-04 loss: 7.613e-01]
my_first_lora_v6:  71%|#######   | 2484/3500 [17:00<35:41,  2.11s/it, lr: 1.0e-04 loss: 3.054e-01]
my_first_lora_v6:  71%|#######   | 2484/3500 [17:00<35:41,  2.11s/it, lr: 1.0e-04 loss: 3.054e-01]
my_first_lora_v6:  71%|#######1  | 2485/3500 [17:02<35:40,  2.11s/it, lr: 1.0e-04 loss: 7.684e-01]
my_first_lora_v6:  71%|#######1  | 2485/3500 [17:02<35:40,  2.11s/it, lr: 1.0e-04 loss: 7.684e-01]
my_first_lora_v6:  71%|#######1  | 2486/3500 [17:05<35:39,  2.11s/it, lr: 1.0e-04 loss: 3.931e-01]
my_first_lora_v6:  71%|#######1  | 2486/3500 [17:05<35:39,  2.11s/it, lr: 1.0e-04 loss: 3.931e-01]
my_first_lora_v6:  71%|#######1  | 2487/3500 [17:07<35:36,  2.11s/it, lr: 1.0e-04 loss: 3.696e-01]
my_first_lora_v6:  71%|#######1  | 2487/3500 [17:07<35:36,  2.11s/it, lr: 1.0e-04 loss: 3.696e-01]
my_first_lora_v6:  71%|#######1  | 2488/3500 [17:08<35:32,  2.11s/it, lr: 1.0e-04 loss: 1.341e-01]
my_first_lora_v6:  71%|#######1  | 2488/3500 [17:08<35:32,  2.11s/it, lr: 1.0e-04 loss: 1.341e-01]
my_first_lora_v6:  71%|#######1  | 2489/3500 [17:10<35:30,  2.11s/it, lr: 1.0e-04 loss: 7.766e-01]
my_first_lora_v6:  71%|#######1  | 2489/3500 [17:10<35:30,  2.11s/it, lr: 1.0e-04 loss: 7.766e-01]
my_first_lora_v6:  71%|#######1  | 2490/3500 [17:12<35:28,  2.11s/it, lr: 1.0e-04 loss: 3.861e-01]
my_first_lora_v6:  71%|#######1  | 2490/3500 [17:12<35:28,  2.11s/it, lr: 1.0e-04 loss: 3.861e-01]
my_first_lora_v6:  71%|#######1  | 2491/3500 [17:13<35:24,  2.11s/it, lr: 1.0e-04 loss: 1.806e-01]
my_first_lora_v6:  71%|#######1  | 2491/3500 [17:13<35:24,  2.11s/it, lr: 1.0e-04 loss: 1.806e-01]
my_first_lora_v6:  71%|#######1  | 2492/3500 [17:16<35:23,  2.11s/it, lr: 1.0e-04 loss: 7.312e-01]
my_first_lora_v6:  71%|#######1  | 2492/3500 [17:16<35:23,  2.11s/it, lr: 1.0e-04 loss: 7.312e-01]
my_first_lora_v6:  71%|#######1  | 2493/3500 [17:18<35:22,  2.11s/it, lr: 1.0e-04 loss: 6.701e-01]
my_first_lora_v6:  71%|#######1  | 2493/3500 [17:18<35:22,  2.11s/it, lr: 1.0e-04 loss: 6.701e-01]
my_first_lora_v6:  71%|#######1  | 2494/3500 [17:21<35:21,  2.11s/it, lr: 1.0e-04 loss: 2.206e-01]
my_first_lora_v6:  71%|#######1  | 2494/3500 [17:21<35:21,  2.11s/it, lr: 1.0e-04 loss: 2.206e-01]
my_first_lora_v6:  71%|#######1  | 2495/3500 [17:22<35:17,  2.11s/it, lr: 1.0e-04 loss: 7.657e-01]
my_first_lora_v6:  71%|#######1  | 2495/3500 [17:22<35:17,  2.11s/it, lr: 1.0e-04 loss: 7.657e-01]
my_first_lora_v6:  71%|#######1  | 2496/3500 [17:25<35:16,  2.11s/it, lr: 1.0e-04 loss: 4.988e-01]
my_first_lora_v6:  71%|#######1  | 2496/3500 [17:25<35:16,  2.11s/it, lr: 1.0e-04 loss: 4.988e-01]
my_first_lora_v6:  71%|#######1  | 2497/3500 [17:28<35:15,  2.11s/it, lr: 1.0e-04 loss: 1.484e-01]
my_first_lora_v6:  71%|#######1  | 2497/3500 [17:28<35:15,  2.11s/it, lr: 1.0e-04 loss: 1.484e-01]
my_first_lora_v6:  71%|#######1  | 2498/3500 [17:30<35:13,  2.11s/it, lr: 1.0e-04 loss: 4.104e-01]
my_first_lora_v6:  71%|#######1  | 2498/3500 [17:30<35:13,  2.11s/it, lr: 1.0e-04 loss: 4.104e-01]
my_first_lora_v6:  71%|#######1  | 2499/3500 [17:32<35:11,  2.11s/it, lr: 1.0e-04 loss: 2.529e-01]
my_first_lora_v6:  71%|#######1  | 2499/3500 [17:32<35:11,  2.11s/it, lr: 1.0e-04 loss: 2.529e-01]
Saving at step 2500
Saved checkpoint to /teamspace/studios/this_studio/ai-toolkit/output/my_first_lora_v6/my_first_lora_v6_000002500.safetensors
Saved optimizer to /teamspace/studios/this_studio/ai-toolkit/output/my_first_lora_v6/optimizer.pt
Unloading assistant lora



Generating Images:   0%|          | 0/5 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/5 [00:00<?, ?it/s]


Generating Images:  20%|##        | 1/5 [00:07<00:31,  7.97s/it]
Generating Images:  20%|##        | 1/5 [00:07<00:31,  7.97s/it]


Generating Images:  40%|####      | 2/5 [00:15<00:23,  7.90s/it]
Generating Images:  40%|####      | 2/5 [00:15<00:23,  7.90s/it]


Generating Images:  60%|######    | 3/5 [00:23<00:15,  7.79s/it]
Generating Images:  60%|######    | 3/5 [00:23<00:15,  7.79s/it]


Generating Images:  80%|########  | 4/5 [00:31<00:07,  7.82s/it]
Generating Images:  80%|########  | 4/5 [00:31<00:07,  7.82s/it]


Generating Images: 100%|##########| 5/5 [00:39<00:00,  7.87s/it]
Generating Images: 100%|##########| 5/5 [00:39<00:00,  7.87s/it]


                                                                
                                                                Loading assistant lora

my_first_lora_v6:  71%|#######1  | 2500/3500 [17:35<35:10,  2.11s/it, lr: 1.0e-04 loss: 7.688e-01]
my_first_lora_v6:  71%|#######1  | 2500/3500 [17:35<35:10,  2.11s/it, lr: 1.0e-04 loss: 7.688e-01]
my_first_lora_v6:  71%|#######1  | 2501/3500 [17:37<35:08,  2.11s/it, lr: 1.0e-04 loss: 7.284e-01]
my_first_lora_v6:  71%|#######1  | 2501/3500 [17:37<35:08,  2.11s/it, lr: 1.0e-04 loss: 7.284e-01]
my_first_lora_v6:  71%|#######1  | 2502/3500 [17:38<35:04,  2.11s/it, lr: 1.0e-04 loss: 6.569e-01]
my_first_lora_v6:  71%|#######1  | 2502/3500 [17:38<35:04,  2.11s/it, lr: 1.0e-04 loss: 6.569e-01]
my_first_lora_v6:  72%|#######1  | 2503/3500 [17:41<35:03,  2.11s/it, lr: 1.0e-04 loss: 3.554e-01]
my_first_lora_v6:  72%|#######1  | 2503/3500 [17:41<35:03,  2.11s/it, lr: 1.0e-04 loss: 3.554e-01]
my_first_lora_v6:  72%|#######1  | 2504/3500 [17:42<34:59,  2.11s/it, lr: 1.0e-04 loss: 1.305e-01]
my_first_lora_v6:  72%|#######1  | 2504/3500 [17:42<34:59,  2.11s/it, lr: 1.0e-04 loss: 1.305e-01]
my_first_lora_v6:  72%|#######1  | 2505/3500 [17:44<34:58,  2.11s/it, lr: 1.0e-04 loss: 8.392e-02]
my_first_lora_v6:  72%|#######1  | 2505/3500 [17:44<34:58,  2.11s/it, lr: 1.0e-04 loss: 8.392e-02]
my_first_lora_v6:  72%|#######1  | 2506/3500 [17:47<34:57,  2.11s/it, lr: 1.0e-04 loss: 5.096e-01]
my_first_lora_v6:  72%|#######1  | 2506/3500 [17:47<34:57,  2.11s/it, lr: 1.0e-04 loss: 5.096e-01]
my_first_lora_v6:  72%|#######1  | 2507/3500 [17:50<34:55,  2.11s/it, lr: 1.0e-04 loss: 2.830e-01]
my_first_lora_v6:  72%|#######1  | 2507/3500 [17:50<34:55,  2.11s/it, lr: 1.0e-04 loss: 2.830e-01]
my_first_lora_v6:  72%|#######1  | 2508/3500 [17:52<34:53,  2.11s/it, lr: 1.0e-04 loss: 7.512e-01]
my_first_lora_v6:  72%|#######1  | 2508/3500 [17:52<34:53,  2.11s/it, lr: 1.0e-04 loss: 7.512e-01]
my_first_lora_v6:  72%|#######1  | 2509/3500 [17:53<34:50,  2.11s/it, lr: 1.0e-04 loss: 3.890e-01]
my_first_lora_v6:  72%|#######1  | 2509/3500 [17:53<34:50,  2.11s/it, lr: 1.0e-04 loss: 3.890e-01]
my_first_lora_v6:  72%|#######1  | 2510/3500 [17:54<34:46,  2.11s/it, lr: 1.0e-04 loss: 8.018e-01]
my_first_lora_v6:  72%|#######1  | 2510/3500 [17:54<34:46,  2.11s/it, lr: 1.0e-04 loss: 8.018e-01]
my_first_lora_v6:  72%|#######1  | 2511/3500 [17:57<34:45,  2.11s/it, lr: 1.0e-04 loss: 1.850e-01]
my_first_lora_v6:  72%|#######1  | 2511/3500 [17:57<34:45,  2.11s/it, lr: 1.0e-04 loss: 1.850e-01]
my_first_lora_v6:  72%|#######1  | 2512/3500 [17:59<34:44,  2.11s/it, lr: 1.0e-04 loss: 7.107e-01]
my_first_lora_v6:  72%|#######1  | 2512/3500 [17:59<34:44,  2.11s/it, lr: 1.0e-04 loss: 7.107e-01]
my_first_lora_v6:  72%|#######1  | 2513/3500 [18:01<34:41,  2.11s/it, lr: 1.0e-04 loss: 5.050e-01]
my_first_lora_v6:  72%|#######1  | 2513/3500 [18:01<34:41,  2.11s/it, lr: 1.0e-04 loss: 5.050e-01]
my_first_lora_v6:  72%|#######1  | 2514/3500 [18:03<34:38,  2.11s/it, lr: 1.0e-04 loss: 7.950e-01]
my_first_lora_v6:  72%|#######1  | 2514/3500 [18:03<34:38,  2.11s/it, lr: 1.0e-04 loss: 7.950e-01]
my_first_lora_v6:  72%|#######1  | 2515/3500 [18:05<34:36,  2.11s/it, lr: 1.0e-04 loss: 5.606e-01]
my_first_lora_v6:  72%|#######1  | 2515/3500 [18:05<34:36,  2.11s/it, lr: 1.0e-04 loss: 5.606e-01]
my_first_lora_v6:  72%|#######1  | 2516/3500 [18:07<34:33,  2.11s/it, lr: 1.0e-04 loss: 3.992e-01]
my_first_lora_v6:  72%|#######1  | 2516/3500 [18:07<34:33,  2.11s/it, lr: 1.0e-04 loss: 3.992e-01]
my_first_lora_v6:  72%|#######1  | 2517/3500 [18:10<34:32,  2.11s/it, lr: 1.0e-04 loss: 6.056e-01]
my_first_lora_v6:  72%|#######1  | 2517/3500 [18:10<34:32,  2.11s/it, lr: 1.0e-04 loss: 6.056e-01]
my_first_lora_v6:  72%|#######1  | 2518/3500 [18:12<34:31,  2.11s/it, lr: 1.0e-04 loss: 6.192e-01]
my_first_lora_v6:  72%|#######1  | 2518/3500 [18:12<34:31,  2.11s/it, lr: 1.0e-04 loss: 6.192e-01]
my_first_lora_v6:  72%|#######1  | 2519/3500 [18:15<34:30,  2.11s/it, lr: 1.0e-04 loss: 7.686e-01]
my_first_lora_v6:  72%|#######1  | 2519/3500 [18:15<34:30,  2.11s/it, lr: 1.0e-04 loss: 7.686e-01]
my_first_lora_v6:  72%|#######2  | 2520/3500 [18:16<34:25,  2.11s/it, lr: 1.0e-04 loss: 4.808e-01]
my_first_lora_v6:  72%|#######2  | 2520/3500 [18:16<34:25,  2.11s/it, lr: 1.0e-04 loss: 4.808e-01]
my_first_lora_v6:  72%|#######2  | 2521/3500 [18:18<34:23,  2.11s/it, lr: 1.0e-04 loss: 4.314e-02]
my_first_lora_v6:  72%|#######2  | 2521/3500 [18:18<34:23,  2.11s/it, lr: 1.0e-04 loss: 4.314e-02]
my_first_lora_v6:  72%|#######2  | 2522/3500 [18:19<34:19,  2.11s/it, lr: 1.0e-04 loss: 2.300e-01]
my_first_lora_v6:  72%|#######2  | 2522/3500 [18:19<34:19,  2.11s/it, lr: 1.0e-04 loss: 2.300e-01]
my_first_lora_v6:  72%|#######2  | 2523/3500 [18:20<34:15,  2.10s/it, lr: 1.0e-04 loss: 8.258e-01]
my_first_lora_v6:  72%|#######2  | 2523/3500 [18:20<34:15,  2.10s/it, lr: 1.0e-04 loss: 8.258e-01]
my_first_lora_v6:  72%|#######2  | 2524/3500 [18:22<34:13,  2.10s/it, lr: 1.0e-04 loss: 3.891e-01]
my_first_lora_v6:  72%|#######2  | 2524/3500 [18:22<34:13,  2.10s/it, lr: 1.0e-04 loss: 3.891e-01]
my_first_lora_v6:  72%|#######2  | 2525/3500 [18:24<34:11,  2.10s/it, lr: 1.0e-04 loss: 2.746e-01]
my_first_lora_v6:  72%|#######2  | 2525/3500 [18:24<34:11,  2.10s/it, lr: 1.0e-04 loss: 2.746e-01]
my_first_lora_v6:  72%|#######2  | 2526/3500 [18:26<34:09,  2.10s/it, lr: 1.0e-04 loss: 2.100e-01]
my_first_lora_v6:  72%|#######2  | 2526/3500 [18:26<34:09,  2.10s/it, lr: 1.0e-04 loss: 2.100e-01]
my_first_lora_v6:  72%|#######2  | 2527/3500 [18:29<34:08,  2.11s/it, lr: 1.0e-04 loss: 6.291e-01]
my_first_lora_v6:  72%|#######2  | 2527/3500 [18:29<34:08,  2.11s/it, lr: 1.0e-04 loss: 6.291e-01]
my_first_lora_v6:  72%|#######2  | 2528/3500 [18:32<34:07,  2.11s/it, lr: 1.0e-04 loss: 4.689e-01]
my_first_lora_v6:  72%|#######2  | 2528/3500 [18:32<34:07,  2.11s/it, lr: 1.0e-04 loss: 4.689e-01]
my_first_lora_v6:  72%|#######2  | 2529/3500 [18:34<34:06,  2.11s/it, lr: 1.0e-04 loss: 7.248e-01]
my_first_lora_v6:  72%|#######2  | 2529/3500 [18:34<34:06,  2.11s/it, lr: 1.0e-04 loss: 7.248e-01]
my_first_lora_v6:  72%|#######2  | 2530/3500 [18:36<34:02,  2.11s/it, lr: 1.0e-04 loss: 4.157e-01]
my_first_lora_v6:  72%|#######2  | 2530/3500 [18:36<34:02,  2.11s/it, lr: 1.0e-04 loss: 4.157e-01]
my_first_lora_v6:  72%|#######2  | 2531/3500 [18:38<34:01,  2.11s/it, lr: 1.0e-04 loss: 6.282e-01]
my_first_lora_v6:  72%|#######2  | 2531/3500 [18:38<34:01,  2.11s/it, lr: 1.0e-04 loss: 6.282e-01]
my_first_lora_v6:  72%|#######2  | 2532/3500 [18:40<33:58,  2.11s/it, lr: 1.0e-04 loss: 2.338e-01]
my_first_lora_v6:  72%|#######2  | 2532/3500 [18:40<33:58,  2.11s/it, lr: 1.0e-04 loss: 2.338e-01]
my_first_lora_v6:  72%|#######2  | 2533/3500 [18:43<33:57,  2.11s/it, lr: 1.0e-04 loss: 1.890e-01]
my_first_lora_v6:  72%|#######2  | 2533/3500 [18:43<33:57,  2.11s/it, lr: 1.0e-04 loss: 1.890e-01]
my_first_lora_v6:  72%|#######2  | 2534/3500 [18:45<33:55,  2.11s/it, lr: 1.0e-04 loss: 5.872e-01]
my_first_lora_v6:  72%|#######2  | 2534/3500 [18:45<33:55,  2.11s/it, lr: 1.0e-04 loss: 5.872e-01]
my_first_lora_v6:  72%|#######2  | 2535/3500 [18:47<33:54,  2.11s/it, lr: 1.0e-04 loss: 6.788e-01]
my_first_lora_v6:  72%|#######2  | 2535/3500 [18:47<33:54,  2.11s/it, lr: 1.0e-04 loss: 6.788e-01]
my_first_lora_v6:  72%|#######2  | 2536/3500 [18:49<33:52,  2.11s/it, lr: 1.0e-04 loss: 8.087e-01]
my_first_lora_v6:  72%|#######2  | 2536/3500 [18:49<33:52,  2.11s/it, lr: 1.0e-04 loss: 8.087e-01]
my_first_lora_v6:  72%|#######2  | 2537/3500 [18:52<33:50,  2.11s/it, lr: 1.0e-04 loss: 7.641e-01]
my_first_lora_v6:  72%|#######2  | 2537/3500 [18:52<33:50,  2.11s/it, lr: 1.0e-04 loss: 7.641e-01]
my_first_lora_v6:  73%|#######2  | 2538/3500 [18:53<33:46,  2.11s/it, lr: 1.0e-04 loss: 4.424e-01]
my_first_lora_v6:  73%|#######2  | 2538/3500 [18:53<33:46,  2.11s/it, lr: 1.0e-04 loss: 4.424e-01]
my_first_lora_v6:  73%|#######2  | 2539/3500 [18:55<33:45,  2.11s/it, lr: 1.0e-04 loss: 4.242e-01]
my_first_lora_v6:  73%|#######2  | 2539/3500 [18:55<33:45,  2.11s/it, lr: 1.0e-04 loss: 4.242e-01]
my_first_lora_v6:  73%|#######2  | 2540/3500 [18:57<33:42,  2.11s/it, lr: 1.0e-04 loss: 4.565e-01]
my_first_lora_v6:  73%|#######2  | 2540/3500 [18:57<33:42,  2.11s/it, lr: 1.0e-04 loss: 4.565e-01]
my_first_lora_v6:  73%|#######2  | 2541/3500 [18:58<33:38,  2.11s/it, lr: 1.0e-04 loss: 2.300e-01]
my_first_lora_v6:  73%|#######2  | 2541/3500 [18:58<33:38,  2.11s/it, lr: 1.0e-04 loss: 2.300e-01]
my_first_lora_v6:  73%|#######2  | 2542/3500 [19:01<33:38,  2.11s/it, lr: 1.0e-04 loss: 5.982e-01]
my_first_lora_v6:  73%|#######2  | 2542/3500 [19:01<33:38,  2.11s/it, lr: 1.0e-04 loss: 5.982e-01]
my_first_lora_v6:  73%|#######2  | 2543/3500 [19:04<33:36,  2.11s/it, lr: 1.0e-04 loss: 5.814e-01]
my_first_lora_v6:  73%|#######2  | 2543/3500 [19:04<33:36,  2.11s/it, lr: 1.0e-04 loss: 5.814e-01]
my_first_lora_v6:  73%|#######2  | 2544/3500 [19:05<33:32,  2.11s/it, lr: 1.0e-04 loss: 7.343e-02]
my_first_lora_v6:  73%|#######2  | 2544/3500 [19:05<33:32,  2.11s/it, lr: 1.0e-04 loss: 7.343e-02]
my_first_lora_v6:  73%|#######2  | 2545/3500 [19:07<33:31,  2.11s/it, lr: 1.0e-04 loss: 1.945e-01]
my_first_lora_v6:  73%|#######2  | 2545/3500 [19:07<33:31,  2.11s/it, lr: 1.0e-04 loss: 1.945e-01]
my_first_lora_v6:  73%|#######2  | 2546/3500 [19:10<33:29,  2.11s/it, lr: 1.0e-04 loss: 4.859e-01]
my_first_lora_v6:  73%|#######2  | 2546/3500 [19:10<33:29,  2.11s/it, lr: 1.0e-04 loss: 4.859e-01]
my_first_lora_v6:  73%|#######2  | 2547/3500 [19:11<33:26,  2.11s/it, lr: 1.0e-04 loss: 5.265e-01]
my_first_lora_v6:  73%|#######2  | 2547/3500 [19:11<33:26,  2.11s/it, lr: 1.0e-04 loss: 5.265e-01]
my_first_lora_v6:  73%|#######2  | 2548/3500 [19:13<33:23,  2.10s/it, lr: 1.0e-04 loss: 1.515e-01]
my_first_lora_v6:  73%|#######2  | 2548/3500 [19:13<33:23,  2.10s/it, lr: 1.0e-04 loss: 1.515e-01]
my_first_lora_v6:  73%|#######2  | 2549/3500 [19:15<33:21,  2.10s/it, lr: 1.0e-04 loss: 5.054e-02]
my_first_lora_v6:  73%|#######2  | 2549/3500 [19:15<33:21,  2.10s/it, lr: 1.0e-04 loss: 5.054e-02]
my_first_lora_v6:  73%|#######2  | 2550/3500 [19:18<33:20,  2.11s/it, lr: 1.0e-04 loss: 3.678e-01]
my_first_lora_v6:  73%|#######2  | 2550/3500 [19:18<33:20,  2.11s/it, lr: 1.0e-04 loss: 3.678e-01]
my_first_lora_v6:  73%|#######2  | 2551/3500 [19:20<33:19,  2.11s/it, lr: 1.0e-04 loss: 2.532e-01]
my_first_lora_v6:  73%|#######2  | 2551/3500 [19:20<33:19,  2.11s/it, lr: 1.0e-04 loss: 2.532e-01]
my_first_lora_v6:  73%|#######2  | 2552/3500 [19:22<33:16,  2.11s/it, lr: 1.0e-04 loss: 4.032e-01]
my_first_lora_v6:  73%|#######2  | 2552/3500 [19:22<33:16,  2.11s/it, lr: 1.0e-04 loss: 4.032e-01]
my_first_lora_v6:  73%|#######2  | 2553/3500 [19:24<33:14,  2.11s/it, lr: 1.0e-04 loss: 1.796e-01]
my_first_lora_v6:  73%|#######2  | 2553/3500 [19:24<33:14,  2.11s/it, lr: 1.0e-04 loss: 1.796e-01]
my_first_lora_v6:  73%|#######2  | 2554/3500 [19:26<33:12,  2.11s/it, lr: 1.0e-04 loss: 5.526e-01]
my_first_lora_v6:  73%|#######2  | 2554/3500 [19:26<33:12,  2.11s/it, lr: 1.0e-04 loss: 5.526e-01]
my_first_lora_v6:  73%|#######3  | 2555/3500 [19:27<33:08,  2.10s/it, lr: 1.0e-04 loss: 7.591e-01]
my_first_lora_v6:  73%|#######3  | 2555/3500 [19:27<33:08,  2.10s/it, lr: 1.0e-04 loss: 7.591e-01]
my_first_lora_v6:  73%|#######3  | 2556/3500 [19:30<33:06,  2.10s/it, lr: 1.0e-04 loss: 1.897e-01]
my_first_lora_v6:  73%|#######3  | 2556/3500 [19:30<33:06,  2.10s/it, lr: 1.0e-04 loss: 1.897e-01]
my_first_lora_v6:  73%|#######3  | 2557/3500 [19:33<33:06,  2.11s/it, lr: 1.0e-04 loss: 4.416e-01]
my_first_lora_v6:  73%|#######3  | 2557/3500 [19:33<33:06,  2.11s/it, lr: 1.0e-04 loss: 4.416e-01]
my_first_lora_v6:  73%|#######3  | 2558/3500 [19:35<33:03,  2.11s/it, lr: 1.0e-04 loss: 4.796e-02]
my_first_lora_v6:  73%|#######3  | 2558/3500 [19:35<33:03,  2.11s/it, lr: 1.0e-04 loss: 4.796e-02]
my_first_lora_v6:  73%|#######3  | 2559/3500 [19:37<33:02,  2.11s/it, lr: 1.0e-04 loss: 7.382e-01]
my_first_lora_v6:  73%|#######3  | 2559/3500 [19:37<33:02,  2.11s/it, lr: 1.0e-04 loss: 7.382e-01]
my_first_lora_v6:  73%|#######3  | 2560/3500 [19:39<33:00,  2.11s/it, lr: 1.0e-04 loss: 3.424e-01]
my_first_lora_v6:  73%|#######3  | 2560/3500 [19:39<33:00,  2.11s/it, lr: 1.0e-04 loss: 3.424e-01]
my_first_lora_v6:  73%|#######3  | 2561/3500 [19:42<32:58,  2.11s/it, lr: 1.0e-04 loss: 3.922e-02]
my_first_lora_v6:  73%|#######3  | 2561/3500 [19:42<32:58,  2.11s/it, lr: 1.0e-04 loss: 3.922e-02]
my_first_lora_v6:  73%|#######3  | 2562/3500 [19:43<32:54,  2.11s/it, lr: 1.0e-04 loss: 3.481e-01]
my_first_lora_v6:  73%|#######3  | 2562/3500 [19:43<32:54,  2.11s/it, lr: 1.0e-04 loss: 3.481e-01]
my_first_lora_v6:  73%|#######3  | 2563/3500 [19:45<32:53,  2.11s/it, lr: 1.0e-04 loss: 1.139e-01]
my_first_lora_v6:  73%|#######3  | 2563/3500 [19:45<32:53,  2.11s/it, lr: 1.0e-04 loss: 1.139e-01]
my_first_lora_v6:  73%|#######3  | 2564/3500 [19:47<32:51,  2.11s/it, lr: 1.0e-04 loss: 8.570e-02]
my_first_lora_v6:  73%|#######3  | 2564/3500 [19:47<32:51,  2.11s/it, lr: 1.0e-04 loss: 8.570e-02]
my_first_lora_v6:  73%|#######3  | 2565/3500 [19:48<32:47,  2.10s/it, lr: 1.0e-04 loss: 2.262e-02]
my_first_lora_v6:  73%|#######3  | 2565/3500 [19:48<32:47,  2.10s/it, lr: 1.0e-04 loss: 2.262e-02]
my_first_lora_v6:  73%|#######3  | 2566/3500 [19:51<32:46,  2.11s/it, lr: 1.0e-04 loss: 7.540e-01]
my_first_lora_v6:  73%|#######3  | 2566/3500 [19:51<32:46,  2.11s/it, lr: 1.0e-04 loss: 7.540e-01]
my_first_lora_v6:  73%|#######3  | 2567/3500 [19:53<32:44,  2.11s/it, lr: 1.0e-04 loss: 7.160e-01]
my_first_lora_v6:  73%|#######3  | 2567/3500 [19:53<32:44,  2.11s/it, lr: 1.0e-04 loss: 7.160e-01]
my_first_lora_v6:  73%|#######3  | 2568/3500 [19:56<32:42,  2.11s/it, lr: 1.0e-04 loss: 5.966e-01]
my_first_lora_v6:  73%|#######3  | 2568/3500 [19:56<32:42,  2.11s/it, lr: 1.0e-04 loss: 5.966e-01]
my_first_lora_v6:  73%|#######3  | 2569/3500 [19:57<32:38,  2.10s/it, lr: 1.0e-04 loss: 7.184e-01]
my_first_lora_v6:  73%|#######3  | 2569/3500 [19:57<32:38,  2.10s/it, lr: 1.0e-04 loss: 7.184e-01]
my_first_lora_v6:  73%|#######3  | 2570/3500 [19:59<32:37,  2.10s/it, lr: 1.0e-04 loss: 3.103e-01]
my_first_lora_v6:  73%|#######3  | 2570/3500 [19:59<32:37,  2.10s/it, lr: 1.0e-04 loss: 3.103e-01]
my_first_lora_v6:  73%|#######3  | 2571/3500 [20:02<32:35,  2.11s/it, lr: 1.0e-04 loss: 3.483e-01]
my_first_lora_v6:  73%|#######3  | 2571/3500 [20:02<32:35,  2.11s/it, lr: 1.0e-04 loss: 3.483e-01]
my_first_lora_v6:  73%|#######3  | 2572/3500 [20:04<32:34,  2.11s/it, lr: 1.0e-04 loss: 6.882e-01]
my_first_lora_v6:  73%|#######3  | 2572/3500 [20:04<32:34,  2.11s/it, lr: 1.0e-04 loss: 6.882e-01]
my_first_lora_v6:  74%|#######3  | 2573/3500 [20:06<32:32,  2.11s/it, lr: 1.0e-04 loss: 5.261e-01]
my_first_lora_v6:  74%|#######3  | 2573/3500 [20:06<32:32,  2.11s/it, lr: 1.0e-04 loss: 5.261e-01]
my_first_lora_v6:  74%|#######3  | 2574/3500 [20:07<32:28,  2.10s/it, lr: 1.0e-04 loss: 6.650e-01]
my_first_lora_v6:  74%|#######3  | 2574/3500 [20:07<32:28,  2.10s/it, lr: 1.0e-04 loss: 6.650e-01]
my_first_lora_v6:  74%|#######3  | 2575/3500 [20:08<32:24,  2.10s/it, lr: 1.0e-04 loss: 8.325e-01]
my_first_lora_v6:  74%|#######3  | 2575/3500 [20:08<32:24,  2.10s/it, lr: 1.0e-04 loss: 8.325e-01]
my_first_lora_v6:  74%|#######3  | 2576/3500 [20:10<32:22,  2.10s/it, lr: 1.0e-04 loss: 1.936e-01]
my_first_lora_v6:  74%|#######3  | 2576/3500 [20:10<32:22,  2.10s/it, lr: 1.0e-04 loss: 1.936e-01]
my_first_lora_v6:  74%|#######3  | 2577/3500 [20:13<32:21,  2.10s/it, lr: 1.0e-04 loss: 2.659e-01]
my_first_lora_v6:  74%|#######3  | 2577/3500 [20:13<32:21,  2.10s/it, lr: 1.0e-04 loss: 2.659e-01]
my_first_lora_v6:  74%|#######3  | 2578/3500 [20:15<32:18,  2.10s/it, lr: 1.0e-04 loss: 1.434e-01]
my_first_lora_v6:  74%|#######3  | 2578/3500 [20:15<32:18,  2.10s/it, lr: 1.0e-04 loss: 1.434e-01]
my_first_lora_v6:  74%|#######3  | 2579/3500 [20:17<32:17,  2.10s/it, lr: 1.0e-04 loss: 6.130e-01]
my_first_lora_v6:  74%|#######3  | 2579/3500 [20:17<32:17,  2.10s/it, lr: 1.0e-04 loss: 6.130e-01]
my_first_lora_v6:  74%|#######3  | 2580/3500 [20:20<32:15,  2.10s/it, lr: 1.0e-04 loss: 8.371e-01]
my_first_lora_v6:  74%|#######3  | 2580/3500 [20:20<32:15,  2.10s/it, lr: 1.0e-04 loss: 8.371e-01]
my_first_lora_v6:  74%|#######3  | 2581/3500 [20:22<32:13,  2.10s/it, lr: 1.0e-04 loss: 7.831e-02]
my_first_lora_v6:  74%|#######3  | 2581/3500 [20:22<32:13,  2.10s/it, lr: 1.0e-04 loss: 7.831e-02]
my_first_lora_v6:  74%|#######3  | 2582/3500 [20:25<32:12,  2.10s/it, lr: 1.0e-04 loss: 1.328e-01]
my_first_lora_v6:  74%|#######3  | 2582/3500 [20:25<32:12,  2.10s/it, lr: 1.0e-04 loss: 1.328e-01]
my_first_lora_v6:  74%|#######3  | 2583/3500 [20:26<32:08,  2.10s/it, lr: 1.0e-04 loss: 5.581e-01]
my_first_lora_v6:  74%|#######3  | 2583/3500 [20:26<32:08,  2.10s/it, lr: 1.0e-04 loss: 5.581e-01]
my_first_lora_v6:  74%|#######3  | 2584/3500 [20:28<32:06,  2.10s/it, lr: 1.0e-04 loss: 3.934e-01]
my_first_lora_v6:  74%|#######3  | 2584/3500 [20:28<32:06,  2.10s/it, lr: 1.0e-04 loss: 3.934e-01]
my_first_lora_v6:  74%|#######3  | 2585/3500 [20:30<32:05,  2.10s/it, lr: 1.0e-04 loss: 1.214e-01]
my_first_lora_v6:  74%|#######3  | 2585/3500 [20:30<32:05,  2.10s/it, lr: 1.0e-04 loss: 1.214e-01]
my_first_lora_v6:  74%|#######3  | 2586/3500 [20:33<32:04,  2.11s/it, lr: 1.0e-04 loss: 3.242e-01]
my_first_lora_v6:  74%|#######3  | 2586/3500 [20:33<32:04,  2.11s/it, lr: 1.0e-04 loss: 3.242e-01]
my_first_lora_v6:  74%|#######3  | 2587/3500 [20:34<32:00,  2.10s/it, lr: 1.0e-04 loss: 7.885e-02]
my_first_lora_v6:  74%|#######3  | 2587/3500 [20:34<32:00,  2.10s/it, lr: 1.0e-04 loss: 7.885e-02]
my_first_lora_v6:  74%|#######3  | 2588/3500 [20:37<31:58,  2.10s/it, lr: 1.0e-04 loss: 7.509e-01]
my_first_lora_v6:  74%|#######3  | 2588/3500 [20:37<31:58,  2.10s/it, lr: 1.0e-04 loss: 7.509e-01]
my_first_lora_v6:  74%|#######3  | 2589/3500 [20:38<31:56,  2.10s/it, lr: 1.0e-04 loss: 5.128e-01]
my_first_lora_v6:  74%|#######3  | 2589/3500 [20:38<31:56,  2.10s/it, lr: 1.0e-04 loss: 5.128e-01]
my_first_lora_v6:  74%|#######4  | 2590/3500 [20:41<31:54,  2.10s/it, lr: 1.0e-04 loss: 6.753e-01]
my_first_lora_v6:  74%|#######4  | 2590/3500 [20:41<31:54,  2.10s/it, lr: 1.0e-04 loss: 6.753e-01]
my_first_lora_v6:  74%|#######4  | 2591/3500 [20:43<31:53,  2.10s/it, lr: 1.0e-04 loss: 7.135e-01]
my_first_lora_v6:  74%|#######4  | 2591/3500 [20:43<31:53,  2.10s/it, lr: 1.0e-04 loss: 7.135e-01]
my_first_lora_v6:  74%|#######4  | 2592/3500 [20:44<31:49,  2.10s/it, lr: 1.0e-04 loss: 5.546e-01]
my_first_lora_v6:  74%|#######4  | 2592/3500 [20:44<31:49,  2.10s/it, lr: 1.0e-04 loss: 5.546e-01]
my_first_lora_v6:  74%|#######4  | 2593/3500 [20:47<31:47,  2.10s/it, lr: 1.0e-04 loss: 2.705e-01]
my_first_lora_v6:  74%|#######4  | 2593/3500 [20:47<31:47,  2.10s/it, lr: 1.0e-04 loss: 2.705e-01]
my_first_lora_v6:  74%|#######4  | 2594/3500 [20:49<31:45,  2.10s/it, lr: 1.0e-04 loss: 1.824e-01]
my_first_lora_v6:  74%|#######4  | 2594/3500 [20:49<31:45,  2.10s/it, lr: 1.0e-04 loss: 1.824e-01]
my_first_lora_v6:  74%|#######4  | 2595/3500 [20:50<31:41,  2.10s/it, lr: 1.0e-04 loss: 3.332e-01]
my_first_lora_v6:  74%|#######4  | 2595/3500 [20:50<31:41,  2.10s/it, lr: 1.0e-04 loss: 3.332e-01]
my_first_lora_v6:  74%|#######4  | 2596/3500 [20:51<31:37,  2.10s/it, lr: 1.0e-04 loss: 4.248e-01]
my_first_lora_v6:  74%|#######4  | 2596/3500 [20:51<31:37,  2.10s/it, lr: 1.0e-04 loss: 4.248e-01]
my_first_lora_v6:  74%|#######4  | 2597/3500 [20:53<31:35,  2.10s/it, lr: 1.0e-04 loss: 3.684e-01]
my_first_lora_v6:  74%|#######4  | 2597/3500 [20:53<31:35,  2.10s/it, lr: 1.0e-04 loss: 3.684e-01]
my_first_lora_v6:  74%|#######4  | 2598/3500 [20:55<31:34,  2.10s/it, lr: 1.0e-04 loss: 7.707e-01]
my_first_lora_v6:  74%|#######4  | 2598/3500 [20:55<31:34,  2.10s/it, lr: 1.0e-04 loss: 7.707e-01]
my_first_lora_v6:  74%|#######4  | 2599/3500 [20:58<31:32,  2.10s/it, lr: 1.0e-04 loss: 5.670e-01]
my_first_lora_v6:  74%|#######4  | 2599/3500 [20:58<31:32,  2.10s/it, lr: 1.0e-04 loss: 5.670e-01]
my_first_lora_v6:  74%|#######4  | 2600/3500 [21:00<31:31,  2.10s/it, lr: 1.0e-04 loss: 2.605e-01]
my_first_lora_v6:  74%|#######4  | 2600/3500 [21:00<31:31,  2.10s/it, lr: 1.0e-04 loss: 2.605e-01]
my_first_lora_v6:  74%|#######4  | 2601/3500 [21:03<31:30,  2.10s/it, lr: 1.0e-04 loss: 3.880e-01]
my_first_lora_v6:  74%|#######4  | 2601/3500 [21:03<31:30,  2.10s/it, lr: 1.0e-04 loss: 3.880e-01]
my_first_lora_v6:  74%|#######4  | 2602/3500 [21:04<31:26,  2.10s/it, lr: 1.0e-04 loss: 6.383e-01]
my_first_lora_v6:  74%|#######4  | 2602/3500 [21:04<31:26,  2.10s/it, lr: 1.0e-04 loss: 6.383e-01]
my_first_lora_v6:  74%|#######4  | 2603/3500 [21:06<31:24,  2.10s/it, lr: 1.0e-04 loss: 2.189e-01]
my_first_lora_v6:  74%|#######4  | 2603/3500 [21:06<31:24,  2.10s/it, lr: 1.0e-04 loss: 2.189e-01]
my_first_lora_v6:  74%|#######4  | 2604/3500 [21:09<31:22,  2.10s/it, lr: 1.0e-04 loss: 5.137e-01]
my_first_lora_v6:  74%|#######4  | 2604/3500 [21:09<31:22,  2.10s/it, lr: 1.0e-04 loss: 5.137e-01]
my_first_lora_v6:  74%|#######4  | 2605/3500 [21:11<31:20,  2.10s/it, lr: 1.0e-04 loss: 4.739e-02]
my_first_lora_v6:  74%|#######4  | 2605/3500 [21:11<31:20,  2.10s/it, lr: 1.0e-04 loss: 4.739e-02]
my_first_lora_v6:  74%|#######4  | 2606/3500 [21:13<31:19,  2.10s/it, lr: 1.0e-04 loss: 2.789e-01]
my_first_lora_v6:  74%|#######4  | 2606/3500 [21:13<31:19,  2.10s/it, lr: 1.0e-04 loss: 2.789e-01]
my_first_lora_v6:  74%|#######4  | 2607/3500 [21:14<31:15,  2.10s/it, lr: 1.0e-04 loss: 7.124e-01]
my_first_lora_v6:  74%|#######4  | 2607/3500 [21:14<31:15,  2.10s/it, lr: 1.0e-04 loss: 7.124e-01]
my_first_lora_v6:  75%|#######4  | 2608/3500 [21:16<31:13,  2.10s/it, lr: 1.0e-04 loss: 5.844e-01]
my_first_lora_v6:  75%|#######4  | 2608/3500 [21:16<31:13,  2.10s/it, lr: 1.0e-04 loss: 5.844e-01]
my_first_lora_v6:  75%|#######4  | 2609/3500 [21:19<31:12,  2.10s/it, lr: 1.0e-04 loss: 7.491e-01]
my_first_lora_v6:  75%|#######4  | 2609/3500 [21:19<31:12,  2.10s/it, lr: 1.0e-04 loss: 7.491e-01]
my_first_lora_v6:  75%|#######4  | 2610/3500 [21:22<31:10,  2.10s/it, lr: 1.0e-04 loss: 3.934e-01]
my_first_lora_v6:  75%|#######4  | 2610/3500 [21:22<31:10,  2.10s/it, lr: 1.0e-04 loss: 3.934e-01]
my_first_lora_v6:  75%|#######4  | 2611/3500 [21:24<31:09,  2.10s/it, lr: 1.0e-04 loss: 4.573e-01]
my_first_lora_v6:  75%|#######4  | 2611/3500 [21:24<31:09,  2.10s/it, lr: 1.0e-04 loss: 4.573e-01]
my_first_lora_v6:  75%|#######4  | 2612/3500 [21:27<31:08,  2.10s/it, lr: 1.0e-04 loss: 1.147e-01]
my_first_lora_v6:  75%|#######4  | 2612/3500 [21:27<31:08,  2.10s/it, lr: 1.0e-04 loss: 1.147e-01]
my_first_lora_v6:  75%|#######4  | 2613/3500 [21:29<31:05,  2.10s/it, lr: 1.0e-04 loss: 4.988e-02]
my_first_lora_v6:  75%|#######4  | 2613/3500 [21:29<31:05,  2.10s/it, lr: 1.0e-04 loss: 4.988e-02]
my_first_lora_v6:  75%|#######4  | 2614/3500 [21:31<31:03,  2.10s/it, lr: 1.0e-04 loss: 5.143e-01]
my_first_lora_v6:  75%|#######4  | 2614/3500 [21:31<31:03,  2.10s/it, lr: 1.0e-04 loss: 5.143e-01]
my_first_lora_v6:  75%|#######4  | 2615/3500 [21:33<31:00,  2.10s/it, lr: 1.0e-04 loss: 2.122e-02]
my_first_lora_v6:  75%|#######4  | 2615/3500 [21:33<31:00,  2.10s/it, lr: 1.0e-04 loss: 2.122e-02]
my_first_lora_v6:  75%|#######4  | 2616/3500 [21:34<30:57,  2.10s/it, lr: 1.0e-04 loss: 7.642e-02]
my_first_lora_v6:  75%|#######4  | 2616/3500 [21:34<30:57,  2.10s/it, lr: 1.0e-04 loss: 7.642e-02]
my_first_lora_v6:  75%|#######4  | 2617/3500 [21:36<30:55,  2.10s/it, lr: 1.0e-04 loss: 5.185e-01]
my_first_lora_v6:  75%|#######4  | 2617/3500 [21:36<30:55,  2.10s/it, lr: 1.0e-04 loss: 5.185e-01]
my_first_lora_v6:  75%|#######4  | 2618/3500 [21:38<30:53,  2.10s/it, lr: 1.0e-04 loss: 8.286e-02]
my_first_lora_v6:  75%|#######4  | 2618/3500 [21:38<30:53,  2.10s/it, lr: 1.0e-04 loss: 8.286e-02]
my_first_lora_v6:  75%|#######4  | 2619/3500 [21:40<30:51,  2.10s/it, lr: 1.0e-04 loss: 3.062e-01]
my_first_lora_v6:  75%|#######4  | 2619/3500 [21:40<30:51,  2.10s/it, lr: 1.0e-04 loss: 3.062e-01]
my_first_lora_v6:  75%|#######4  | 2620/3500 [21:42<30:48,  2.10s/it, lr: 1.0e-04 loss: 6.932e-01]
my_first_lora_v6:  75%|#######4  | 2620/3500 [21:42<30:48,  2.10s/it, lr: 1.0e-04 loss: 6.932e-01]
my_first_lora_v6:  75%|#######4  | 2621/3500 [21:44<30:45,  2.10s/it, lr: 1.0e-04 loss: 7.865e-01]
my_first_lora_v6:  75%|#######4  | 2621/3500 [21:44<30:45,  2.10s/it, lr: 1.0e-04 loss: 7.865e-01]
my_first_lora_v6:  75%|#######4  | 2622/3500 [21:46<30:44,  2.10s/it, lr: 1.0e-04 loss: 2.962e-01]
my_first_lora_v6:  75%|#######4  | 2622/3500 [21:46<30:44,  2.10s/it, lr: 1.0e-04 loss: 2.962e-01]
my_first_lora_v6:  75%|#######4  | 2623/3500 [21:49<30:43,  2.10s/it, lr: 1.0e-04 loss: 5.212e-01]
my_first_lora_v6:  75%|#######4  | 2623/3500 [21:49<30:43,  2.10s/it, lr: 1.0e-04 loss: 5.212e-01]
my_first_lora_v6:  75%|#######4  | 2624/3500 [21:51<30:41,  2.10s/it, lr: 1.0e-04 loss: 5.930e-01]
my_first_lora_v6:  75%|#######4  | 2624/3500 [21:51<30:41,  2.10s/it, lr: 1.0e-04 loss: 5.930e-01]
my_first_lora_v6:  75%|#######5  | 2625/3500 [21:52<30:37,  2.10s/it, lr: 1.0e-04 loss: 7.183e-01]
my_first_lora_v6:  75%|#######5  | 2625/3500 [21:52<30:37,  2.10s/it, lr: 1.0e-04 loss: 7.183e-01]
my_first_lora_v6:  75%|#######5  | 2626/3500 [21:55<30:36,  2.10s/it, lr: 1.0e-04 loss: 3.994e-01]
my_first_lora_v6:  75%|#######5  | 2626/3500 [21:55<30:36,  2.10s/it, lr: 1.0e-04 loss: 3.994e-01]
my_first_lora_v6:  75%|#######5  | 2627/3500 [21:57<30:34,  2.10s/it, lr: 1.0e-04 loss: 6.817e-01]
my_first_lora_v6:  75%|#######5  | 2627/3500 [21:57<30:34,  2.10s/it, lr: 1.0e-04 loss: 6.817e-01]
my_first_lora_v6:  75%|#######5  | 2628/3500 [21:59<30:32,  2.10s/it, lr: 1.0e-04 loss: 3.048e-01]
my_first_lora_v6:  75%|#######5  | 2628/3500 [21:59<30:32,  2.10s/it, lr: 1.0e-04 loss: 3.048e-01]
my_first_lora_v6:  75%|#######5  | 2629/3500 [22:02<30:31,  2.10s/it, lr: 1.0e-04 loss: 6.115e-01]
my_first_lora_v6:  75%|#######5  | 2629/3500 [22:02<30:31,  2.10s/it, lr: 1.0e-04 loss: 6.115e-01]
my_first_lora_v6:  75%|#######5  | 2630/3500 [22:03<30:27,  2.10s/it, lr: 1.0e-04 loss: 7.467e-01]
my_first_lora_v6:  75%|#######5  | 2630/3500 [22:03<30:27,  2.10s/it, lr: 1.0e-04 loss: 7.467e-01]
my_first_lora_v6:  75%|#######5  | 2631/3500 [22:04<30:23,  2.10s/it, lr: 1.0e-04 loss: 3.454e-01]
my_first_lora_v6:  75%|#######5  | 2631/3500 [22:04<30:23,  2.10s/it, lr: 1.0e-04 loss: 3.454e-01]
my_first_lora_v6:  75%|#######5  | 2632/3500 [22:06<30:22,  2.10s/it, lr: 1.0e-04 loss: 6.025e-01]
my_first_lora_v6:  75%|#######5  | 2632/3500 [22:06<30:22,  2.10s/it, lr: 1.0e-04 loss: 6.025e-01]
my_first_lora_v6:  75%|#######5  | 2633/3500 [22:09<30:20,  2.10s/it, lr: 1.0e-04 loss: 1.236e-01]
my_first_lora_v6:  75%|#######5  | 2633/3500 [22:09<30:20,  2.10s/it, lr: 1.0e-04 loss: 1.236e-01]
my_first_lora_v6:  75%|#######5  | 2634/3500 [22:11<30:19,  2.10s/it, lr: 1.0e-04 loss: 5.781e-01]
my_first_lora_v6:  75%|#######5  | 2634/3500 [22:11<30:19,  2.10s/it, lr: 1.0e-04 loss: 5.781e-01]
my_first_lora_v6:  75%|#######5  | 2635/3500 [22:13<30:16,  2.10s/it, lr: 1.0e-04 loss: 5.593e-01]
my_first_lora_v6:  75%|#######5  | 2635/3500 [22:13<30:16,  2.10s/it, lr: 1.0e-04 loss: 5.593e-01]
my_first_lora_v6:  75%|#######5  | 2636/3500 [22:16<30:15,  2.10s/it, lr: 1.0e-04 loss: 4.740e-01]
my_first_lora_v6:  75%|#######5  | 2636/3500 [22:16<30:15,  2.10s/it, lr: 1.0e-04 loss: 4.740e-01]
my_first_lora_v6:  75%|#######5  | 2637/3500 [22:18<30:13,  2.10s/it, lr: 1.0e-04 loss: 2.370e-01]
my_first_lora_v6:  75%|#######5  | 2637/3500 [22:18<30:13,  2.10s/it, lr: 1.0e-04 loss: 2.370e-01]
my_first_lora_v6:  75%|#######5  | 2638/3500 [22:20<30:10,  2.10s/it, lr: 1.0e-04 loss: 1.723e-01]
my_first_lora_v6:  75%|#######5  | 2638/3500 [22:20<30:10,  2.10s/it, lr: 1.0e-04 loss: 1.723e-01]
my_first_lora_v6:  75%|#######5  | 2639/3500 [22:21<30:07,  2.10s/it, lr: 1.0e-04 loss: 7.604e-01]
my_first_lora_v6:  75%|#######5  | 2639/3500 [22:21<30:07,  2.10s/it, lr: 1.0e-04 loss: 7.604e-01]
my_first_lora_v6:  75%|#######5  | 2640/3500 [22:23<30:05,  2.10s/it, lr: 1.0e-04 loss: 3.693e-01]
my_first_lora_v6:  75%|#######5  | 2640/3500 [22:23<30:05,  2.10s/it, lr: 1.0e-04 loss: 3.693e-01]
my_first_lora_v6:  75%|#######5  | 2641/3500 [22:25<30:03,  2.10s/it, lr: 1.0e-04 loss: 3.491e-01]
my_first_lora_v6:  75%|#######5  | 2641/3500 [22:25<30:03,  2.10s/it, lr: 1.0e-04 loss: 3.491e-01]
my_first_lora_v6:  75%|#######5  | 2642/3500 [22:28<30:02,  2.10s/it, lr: 1.0e-04 loss: 3.968e-01]
my_first_lora_v6:  75%|#######5  | 2642/3500 [22:28<30:02,  2.10s/it, lr: 1.0e-04 loss: 3.968e-01]
my_first_lora_v6:  76%|#######5  | 2643/3500 [22:31<30:00,  2.10s/it, lr: 1.0e-04 loss: 3.156e-03]
my_first_lora_v6:  76%|#######5  | 2643/3500 [22:31<30:00,  2.10s/it, lr: 1.0e-04 loss: 3.156e-03]
my_first_lora_v6:  76%|#######5  | 2644/3500 [22:33<29:59,  2.10s/it, lr: 1.0e-04 loss: 3.240e-01]
my_first_lora_v6:  76%|#######5  | 2644/3500 [22:33<29:59,  2.10s/it, lr: 1.0e-04 loss: 3.240e-01]
my_first_lora_v6:  76%|#######5  | 2645/3500 [22:34<29:55,  2.10s/it, lr: 1.0e-04 loss: 2.068e-01]
my_first_lora_v6:  76%|#######5  | 2645/3500 [22:34<29:55,  2.10s/it, lr: 1.0e-04 loss: 2.068e-01]
my_first_lora_v6:  76%|#######5  | 2646/3500 [22:37<29:54,  2.10s/it, lr: 1.0e-04 loss: 6.672e-01]
my_first_lora_v6:  76%|#######5  | 2646/3500 [22:37<29:54,  2.10s/it, lr: 1.0e-04 loss: 6.672e-01]
my_first_lora_v6:  76%|#######5  | 2647/3500 [22:40<29:53,  2.10s/it, lr: 1.0e-04 loss: 6.615e-01]
my_first_lora_v6:  76%|#######5  | 2647/3500 [22:40<29:53,  2.10s/it, lr: 1.0e-04 loss: 6.615e-01]
my_first_lora_v6:  76%|#######5  | 2648/3500 [22:42<29:51,  2.10s/it, lr: 1.0e-04 loss: 8.274e-01]
my_first_lora_v6:  76%|#######5  | 2648/3500 [22:42<29:51,  2.10s/it, lr: 1.0e-04 loss: 8.274e-01]
my_first_lora_v6:  76%|#######5  | 2649/3500 [22:43<29:47,  2.10s/it, lr: 1.0e-04 loss: 8.047e-01]
my_first_lora_v6:  76%|#######5  | 2649/3500 [22:43<29:47,  2.10s/it, lr: 1.0e-04 loss: 8.047e-01]
my_first_lora_v6:  76%|#######5  | 2650/3500 [22:45<29:45,  2.10s/it, lr: 1.0e-04 loss: 8.222e-01]
my_first_lora_v6:  76%|#######5  | 2650/3500 [22:45<29:45,  2.10s/it, lr: 1.0e-04 loss: 8.222e-01]
my_first_lora_v6:  76%|#######5  | 2651/3500 [22:48<29:44,  2.10s/it, lr: 1.0e-04 loss: 4.918e-01]
my_first_lora_v6:  76%|#######5  | 2651/3500 [22:48<29:44,  2.10s/it, lr: 1.0e-04 loss: 4.918e-01]
my_first_lora_v6:  76%|#######5  | 2652/3500 [22:49<29:40,  2.10s/it, lr: 1.0e-04 loss: 7.942e-01]
my_first_lora_v6:  76%|#######5  | 2652/3500 [22:49<29:40,  2.10s/it, lr: 1.0e-04 loss: 7.942e-01]
my_first_lora_v6:  76%|#######5  | 2653/3500 [22:51<29:39,  2.10s/it, lr: 1.0e-04 loss: 6.930e-01]
my_first_lora_v6:  76%|#######5  | 2653/3500 [22:51<29:39,  2.10s/it, lr: 1.0e-04 loss: 6.930e-01]
my_first_lora_v6:  76%|#######5  | 2654/3500 [22:53<29:36,  2.10s/it, lr: 1.0e-04 loss: 4.636e-01]
my_first_lora_v6:  76%|#######5  | 2654/3500 [22:53<29:36,  2.10s/it, lr: 1.0e-04 loss: 4.636e-01]
my_first_lora_v6:  76%|#######5  | 2655/3500 [22:56<29:35,  2.10s/it, lr: 1.0e-04 loss: 7.365e-01]
my_first_lora_v6:  76%|#######5  | 2655/3500 [22:56<29:35,  2.10s/it, lr: 1.0e-04 loss: 7.365e-01]
my_first_lora_v6:  76%|#######5  | 2656/3500 [22:58<29:33,  2.10s/it, lr: 1.0e-04 loss: 7.872e-01]
my_first_lora_v6:  76%|#######5  | 2656/3500 [22:58<29:33,  2.10s/it, lr: 1.0e-04 loss: 7.872e-01]
my_first_lora_v6:  76%|#######5  | 2657/3500 [22:59<29:30,  2.10s/it, lr: 1.0e-04 loss: 6.527e-01]
my_first_lora_v6:  76%|#######5  | 2657/3500 [22:59<29:30,  2.10s/it, lr: 1.0e-04 loss: 6.527e-01]
my_first_lora_v6:  76%|#######5  | 2658/3500 [23:02<29:28,  2.10s/it, lr: 1.0e-04 loss: 5.229e-01]
my_first_lora_v6:  76%|#######5  | 2658/3500 [23:02<29:28,  2.10s/it, lr: 1.0e-04 loss: 5.229e-01]
my_first_lora_v6:  76%|#######5  | 2659/3500 [23:04<29:27,  2.10s/it, lr: 1.0e-04 loss: 4.769e-01]
my_first_lora_v6:  76%|#######5  | 2659/3500 [23:04<29:27,  2.10s/it, lr: 1.0e-04 loss: 4.769e-01]
my_first_lora_v6:  76%|#######6  | 2660/3500 [23:05<29:23,  2.10s/it, lr: 1.0e-04 loss: 2.385e-01]
my_first_lora_v6:  76%|#######6  | 2660/3500 [23:05<29:23,  2.10s/it, lr: 1.0e-04 loss: 2.385e-01]
my_first_lora_v6:  76%|#######6  | 2661/3500 [23:07<29:21,  2.10s/it, lr: 1.0e-04 loss: 3.652e-02]
my_first_lora_v6:  76%|#######6  | 2661/3500 [23:07<29:21,  2.10s/it, lr: 1.0e-04 loss: 3.652e-02]
my_first_lora_v6:  76%|#######6  | 2662/3500 [23:10<29:19,  2.10s/it, lr: 1.0e-04 loss: 1.278e-01]
my_first_lora_v6:  76%|#######6  | 2662/3500 [23:10<29:19,  2.10s/it, lr: 1.0e-04 loss: 1.278e-01]
my_first_lora_v6:  76%|#######6  | 2663/3500 [23:12<29:18,  2.10s/it, lr: 1.0e-04 loss: 4.187e-01]
my_first_lora_v6:  76%|#######6  | 2663/3500 [23:12<29:18,  2.10s/it, lr: 1.0e-04 loss: 4.187e-01]
my_first_lora_v6:  76%|#######6  | 2664/3500 [23:15<29:16,  2.10s/it, lr: 1.0e-04 loss: 3.032e-01]
my_first_lora_v6:  76%|#######6  | 2664/3500 [23:15<29:16,  2.10s/it, lr: 1.0e-04 loss: 3.032e-01]
my_first_lora_v6:  76%|#######6  | 2665/3500 [23:17<29:15,  2.10s/it, lr: 1.0e-04 loss: 2.142e-01]
my_first_lora_v6:  76%|#######6  | 2665/3500 [23:17<29:15,  2.10s/it, lr: 1.0e-04 loss: 2.142e-01]
my_first_lora_v6:  76%|#######6  | 2666/3500 [23:20<29:13,  2.10s/it, lr: 1.0e-04 loss: 8.196e-01]
my_first_lora_v6:  76%|#######6  | 2666/3500 [23:20<29:13,  2.10s/it, lr: 1.0e-04 loss: 8.196e-01]
my_first_lora_v6:  76%|#######6  | 2667/3500 [23:22<29:11,  2.10s/it, lr: 1.0e-04 loss: 7.551e-01]
my_first_lora_v6:  76%|#######6  | 2667/3500 [23:22<29:11,  2.10s/it, lr: 1.0e-04 loss: 7.551e-01]
my_first_lora_v6:  76%|#######6  | 2668/3500 [23:24<29:09,  2.10s/it, lr: 1.0e-04 loss: 3.689e-01]
my_first_lora_v6:  76%|#######6  | 2668/3500 [23:24<29:09,  2.10s/it, lr: 1.0e-04 loss: 3.689e-01]
my_first_lora_v6:  76%|#######6  | 2669/3500 [23:26<29:07,  2.10s/it, lr: 1.0e-04 loss: 3.344e-01]
my_first_lora_v6:  76%|#######6  | 2669/3500 [23:26<29:07,  2.10s/it, lr: 1.0e-04 loss: 3.344e-01]
my_first_lora_v6:  76%|#######6  | 2670/3500 [23:27<29:03,  2.10s/it, lr: 1.0e-04 loss: 1.380e-01]
my_first_lora_v6:  76%|#######6  | 2670/3500 [23:27<29:03,  2.10s/it, lr: 1.0e-04 loss: 1.380e-01]
my_first_lora_v6:  76%|#######6  | 2671/3500 [23:29<29:01,  2.10s/it, lr: 1.0e-04 loss: 1.399e-01]
my_first_lora_v6:  76%|#######6  | 2671/3500 [23:29<29:01,  2.10s/it, lr: 1.0e-04 loss: 1.399e-01]
my_first_lora_v6:  76%|#######6  | 2672/3500 [23:31<28:58,  2.10s/it, lr: 1.0e-04 loss: 7.356e-02]
my_first_lora_v6:  76%|#######6  | 2672/3500 [23:31<28:58,  2.10s/it, lr: 1.0e-04 loss: 7.356e-02]
my_first_lora_v6:  76%|#######6  | 2673/3500 [23:34<28:57,  2.10s/it, lr: 1.0e-04 loss: 3.004e-01]
my_first_lora_v6:  76%|#######6  | 2673/3500 [23:34<28:57,  2.10s/it, lr: 1.0e-04 loss: 3.004e-01]
my_first_lora_v6:  76%|#######6  | 2674/3500 [23:36<28:56,  2.10s/it, lr: 1.0e-04 loss: 2.699e-01]
my_first_lora_v6:  76%|#######6  | 2674/3500 [23:36<28:56,  2.10s/it, lr: 1.0e-04 loss: 2.699e-01]
my_first_lora_v6:  76%|#######6  | 2675/3500 [23:39<28:54,  2.10s/it, lr: 1.0e-04 loss: 7.393e-01]
my_first_lora_v6:  76%|#######6  | 2675/3500 [23:39<28:54,  2.10s/it, lr: 1.0e-04 loss: 7.393e-01]
my_first_lora_v6:  76%|#######6  | 2676/3500 [23:41<28:53,  2.10s/it, lr: 1.0e-04 loss: 3.015e-01]
my_first_lora_v6:  76%|#######6  | 2676/3500 [23:41<28:53,  2.10s/it, lr: 1.0e-04 loss: 3.015e-01]
my_first_lora_v6:  76%|#######6  | 2677/3500 [23:44<28:51,  2.10s/it, lr: 1.0e-04 loss: 6.406e-01]
my_first_lora_v6:  76%|#######6  | 2677/3500 [23:44<28:51,  2.10s/it, lr: 1.0e-04 loss: 6.406e-01]
my_first_lora_v6:  77%|#######6  | 2678/3500 [23:45<28:48,  2.10s/it, lr: 1.0e-04 loss: 8.255e-01]
my_first_lora_v6:  77%|#######6  | 2678/3500 [23:45<28:48,  2.10s/it, lr: 1.0e-04 loss: 8.255e-01]
my_first_lora_v6:  77%|#######6  | 2679/3500 [23:46<28:44,  2.10s/it, lr: 1.0e-04 loss: 1.881e-01]
my_first_lora_v6:  77%|#######6  | 2679/3500 [23:46<28:44,  2.10s/it, lr: 1.0e-04 loss: 1.881e-01]
my_first_lora_v6:  77%|#######6  | 2680/3500 [23:48<28:42,  2.10s/it, lr: 1.0e-04 loss: 1.739e-01]
my_first_lora_v6:  77%|#######6  | 2680/3500 [23:48<28:42,  2.10s/it, lr: 1.0e-04 loss: 1.739e-01]
my_first_lora_v6:  77%|#######6  | 2681/3500 [23:50<28:40,  2.10s/it, lr: 1.0e-04 loss: 2.916e-01]
my_first_lora_v6:  77%|#######6  | 2681/3500 [23:50<28:40,  2.10s/it, lr: 1.0e-04 loss: 2.916e-01]
my_first_lora_v6:  77%|#######6  | 2682/3500 [23:52<28:38,  2.10s/it, lr: 1.0e-04 loss: 8.689e-02]
my_first_lora_v6:  77%|#######6  | 2682/3500 [23:52<28:38,  2.10s/it, lr: 1.0e-04 loss: 8.689e-02]
my_first_lora_v6:  77%|#######6  | 2683/3500 [23:55<28:36,  2.10s/it, lr: 1.0e-04 loss: 5.961e-01]
my_first_lora_v6:  77%|#######6  | 2683/3500 [23:55<28:36,  2.10s/it, lr: 1.0e-04 loss: 5.961e-01]
my_first_lora_v6:  77%|#######6  | 2684/3500 [23:57<28:35,  2.10s/it, lr: 1.0e-04 loss: 7.031e-01]
my_first_lora_v6:  77%|#######6  | 2684/3500 [23:57<28:35,  2.10s/it, lr: 1.0e-04 loss: 7.031e-01]
my_first_lora_v6:  77%|#######6  | 2685/3500 [23:59<28:32,  2.10s/it, lr: 1.0e-04 loss: 3.246e-01]
my_first_lora_v6:  77%|#######6  | 2685/3500 [23:59<28:32,  2.10s/it, lr: 1.0e-04 loss: 3.246e-01]
my_first_lora_v6:  77%|#######6  | 2686/3500 [24:01<28:30,  2.10s/it, lr: 1.0e-04 loss: 4.336e-01]
my_first_lora_v6:  77%|#######6  | 2686/3500 [24:01<28:30,  2.10s/it, lr: 1.0e-04 loss: 4.336e-01]
my_first_lora_v6:  77%|#######6  | 2687/3500 [24:02<28:27,  2.10s/it, lr: 1.0e-04 loss: 3.596e-01]
my_first_lora_v6:  77%|#######6  | 2687/3500 [24:02<28:27,  2.10s/it, lr: 1.0e-04 loss: 3.596e-01]
my_first_lora_v6:  77%|#######6  | 2688/3500 [24:05<28:25,  2.10s/it, lr: 1.0e-04 loss: 6.822e-01]
my_first_lora_v6:  77%|#######6  | 2688/3500 [24:05<28:25,  2.10s/it, lr: 1.0e-04 loss: 6.822e-01]
my_first_lora_v6:  77%|#######6  | 2689/3500 [24:07<28:24,  2.10s/it, lr: 1.0e-04 loss: 4.537e-01]
my_first_lora_v6:  77%|#######6  | 2689/3500 [24:07<28:24,  2.10s/it, lr: 1.0e-04 loss: 4.537e-01]
my_first_lora_v6:  77%|#######6  | 2690/3500 [24:10<28:22,  2.10s/it, lr: 1.0e-04 loss: 3.622e-01]
my_first_lora_v6:  77%|#######6  | 2690/3500 [24:10<28:22,  2.10s/it, lr: 1.0e-04 loss: 3.622e-01]
my_first_lora_v6:  77%|#######6  | 2691/3500 [24:11<28:19,  2.10s/it, lr: 1.0e-04 loss: 8.026e-01]
my_first_lora_v6:  77%|#######6  | 2691/3500 [24:11<28:19,  2.10s/it, lr: 1.0e-04 loss: 8.026e-01]
my_first_lora_v6:  77%|#######6  | 2692/3500 [24:14<28:17,  2.10s/it, lr: 1.0e-04 loss: 1.696e-02]
my_first_lora_v6:  77%|#######6  | 2692/3500 [24:14<28:17,  2.10s/it, lr: 1.0e-04 loss: 1.696e-02]
my_first_lora_v6:  77%|#######6  | 2693/3500 [24:16<28:16,  2.10s/it, lr: 1.0e-04 loss: 7.931e-01]
my_first_lora_v6:  77%|#######6  | 2693/3500 [24:16<28:16,  2.10s/it, lr: 1.0e-04 loss: 7.931e-01]
my_first_lora_v6:  77%|#######6  | 2694/3500 [24:17<28:12,  2.10s/it, lr: 1.0e-04 loss: 6.616e-01]
my_first_lora_v6:  77%|#######6  | 2694/3500 [24:17<28:12,  2.10s/it, lr: 1.0e-04 loss: 6.616e-01]
my_first_lora_v6:  77%|#######7  | 2695/3500 [24:19<28:10,  2.10s/it, lr: 1.0e-04 loss: 1.277e-01]
my_first_lora_v6:  77%|#######7  | 2695/3500 [24:19<28:10,  2.10s/it, lr: 1.0e-04 loss: 1.277e-01]
my_first_lora_v6:  77%|#######7  | 2696/3500 [24:21<28:08,  2.10s/it, lr: 1.0e-04 loss: 5.456e-01]
my_first_lora_v6:  77%|#######7  | 2696/3500 [24:21<28:08,  2.10s/it, lr: 1.0e-04 loss: 5.456e-01]
my_first_lora_v6:  77%|#######7  | 2697/3500 [24:23<28:06,  2.10s/it, lr: 1.0e-04 loss: 6.573e-01]
my_first_lora_v6:  77%|#######7  | 2697/3500 [24:23<28:06,  2.10s/it, lr: 1.0e-04 loss: 6.573e-01]
my_first_lora_v6:  77%|#######7  | 2698/3500 [24:26<28:05,  2.10s/it, lr: 1.0e-04 loss: 4.004e-01]
my_first_lora_v6:  77%|#######7  | 2698/3500 [24:26<28:05,  2.10s/it, lr: 1.0e-04 loss: 4.004e-01]
my_first_lora_v6:  77%|#######7  | 2699/3500 [24:29<28:03,  2.10s/it, lr: 1.0e-04 loss: 1.961e-01]
my_first_lora_v6:  77%|#######7  | 2699/3500 [24:29<28:03,  2.10s/it, lr: 1.0e-04 loss: 1.961e-01]
my_first_lora_v6:  77%|#######7  | 2700/3500 [24:30<28:00,  2.10s/it, lr: 1.0e-04 loss: 7.245e-01]
my_first_lora_v6:  77%|#######7  | 2700/3500 [24:30<28:00,  2.10s/it, lr: 1.0e-04 loss: 7.245e-01]
my_first_lora_v6:  77%|#######7  | 2701/3500 [24:31<27:57,  2.10s/it, lr: 1.0e-04 loss: 9.729e-02]
my_first_lora_v6:  77%|#######7  | 2701/3500 [24:31<27:57,  2.10s/it, lr: 1.0e-04 loss: 9.729e-02]
my_first_lora_v6:  77%|#######7  | 2702/3500 [24:34<27:55,  2.10s/it, lr: 1.0e-04 loss: 5.734e-01]
my_first_lora_v6:  77%|#######7  | 2702/3500 [24:34<27:55,  2.10s/it, lr: 1.0e-04 loss: 5.734e-01]
my_first_lora_v6:  77%|#######7  | 2703/3500 [24:36<27:53,  2.10s/it, lr: 1.0e-04 loss: 3.968e-01]
my_first_lora_v6:  77%|#######7  | 2703/3500 [24:36<27:53,  2.10s/it, lr: 1.0e-04 loss: 3.968e-01]
my_first_lora_v6:  77%|#######7  | 2704/3500 [24:39<27:52,  2.10s/it, lr: 1.0e-04 loss: 2.929e-01]
my_first_lora_v6:  77%|#######7  | 2704/3500 [24:39<27:52,  2.10s/it, lr: 1.0e-04 loss: 2.929e-01]
my_first_lora_v6:  77%|#######7  | 2705/3500 [24:41<27:50,  2.10s/it, lr: 1.0e-04 loss: 3.022e-01]
my_first_lora_v6:  77%|#######7  | 2705/3500 [24:41<27:50,  2.10s/it, lr: 1.0e-04 loss: 3.022e-01]
my_first_lora_v6:  77%|#######7  | 2706/3500 [24:44<27:49,  2.10s/it, lr: 1.0e-04 loss: 3.019e-02]
my_first_lora_v6:  77%|#######7  | 2706/3500 [24:44<27:49,  2.10s/it, lr: 1.0e-04 loss: 3.019e-02]
my_first_lora_v6:  77%|#######7  | 2707/3500 [24:45<27:45,  2.10s/it, lr: 1.0e-04 loss: 4.015e-02]
my_first_lora_v6:  77%|#######7  | 2707/3500 [24:45<27:45,  2.10s/it, lr: 1.0e-04 loss: 4.015e-02]
my_first_lora_v6:  77%|#######7  | 2708/3500 [24:47<27:43,  2.10s/it, lr: 1.0e-04 loss: 3.989e-02]
my_first_lora_v6:  77%|#######7  | 2708/3500 [24:47<27:43,  2.10s/it, lr: 1.0e-04 loss: 3.989e-02]
my_first_lora_v6:  77%|#######7  | 2709/3500 [24:49<27:41,  2.10s/it, lr: 1.0e-04 loss: 7.243e-01]
my_first_lora_v6:  77%|#######7  | 2709/3500 [24:49<27:41,  2.10s/it, lr: 1.0e-04 loss: 7.243e-01]
my_first_lora_v6:  77%|#######7  | 2710/3500 [24:51<27:39,  2.10s/it, lr: 1.0e-04 loss: 4.973e-01]
my_first_lora_v6:  77%|#######7  | 2710/3500 [24:51<27:39,  2.10s/it, lr: 1.0e-04 loss: 4.973e-01]
my_first_lora_v6:  77%|#######7  | 2711/3500 [24:53<27:37,  2.10s/it, lr: 1.0e-04 loss: 3.868e-01]
my_first_lora_v6:  77%|#######7  | 2711/3500 [24:53<27:37,  2.10s/it, lr: 1.0e-04 loss: 3.868e-01]
my_first_lora_v6:  77%|#######7  | 2712/3500 [24:55<27:35,  2.10s/it, lr: 1.0e-04 loss: 5.074e-01]
my_first_lora_v6:  77%|#######7  | 2712/3500 [24:55<27:35,  2.10s/it, lr: 1.0e-04 loss: 5.074e-01]
my_first_lora_v6:  78%|#######7  | 2713/3500 [24:56<27:31,  2.10s/it, lr: 1.0e-04 loss: 6.932e-02]
my_first_lora_v6:  78%|#######7  | 2713/3500 [24:56<27:31,  2.10s/it, lr: 1.0e-04 loss: 6.932e-02]
my_first_lora_v6:  78%|#######7  | 2714/3500 [24:59<27:30,  2.10s/it, lr: 1.0e-04 loss: 7.610e-01]
my_first_lora_v6:  78%|#######7  | 2714/3500 [24:59<27:30,  2.10s/it, lr: 1.0e-04 loss: 7.610e-01]
my_first_lora_v6:  78%|#######7  | 2715/3500 [25:02<27:29,  2.10s/it, lr: 1.0e-04 loss: 1.727e-01]
my_first_lora_v6:  78%|#######7  | 2715/3500 [25:02<27:29,  2.10s/it, lr: 1.0e-04 loss: 1.727e-01]
my_first_lora_v6:  78%|#######7  | 2716/3500 [25:04<27:27,  2.10s/it, lr: 1.0e-04 loss: 7.335e-01]
my_first_lora_v6:  78%|#######7  | 2716/3500 [25:04<27:27,  2.10s/it, lr: 1.0e-04 loss: 7.335e-01]
my_first_lora_v6:  78%|#######7  | 2717/3500 [25:07<27:25,  2.10s/it, lr: 1.0e-04 loss: 2.528e-01]
my_first_lora_v6:  78%|#######7  | 2717/3500 [25:07<27:25,  2.10s/it, lr: 1.0e-04 loss: 2.528e-01]
my_first_lora_v6:  78%|#######7  | 2718/3500 [25:08<27:22,  2.10s/it, lr: 1.0e-04 loss: 2.816e-01]
my_first_lora_v6:  78%|#######7  | 2718/3500 [25:08<27:22,  2.10s/it, lr: 1.0e-04 loss: 2.816e-01]
my_first_lora_v6:  78%|#######7  | 2719/3500 [25:10<27:20,  2.10s/it, lr: 1.0e-04 loss: 4.951e-01]
my_first_lora_v6:  78%|#######7  | 2719/3500 [25:10<27:20,  2.10s/it, lr: 1.0e-04 loss: 4.951e-01]
my_first_lora_v6:  78%|#######7  | 2720/3500 [25:13<27:19,  2.10s/it, lr: 1.0e-04 loss: 6.747e-01]
my_first_lora_v6:  78%|#######7  | 2720/3500 [25:13<27:19,  2.10s/it, lr: 1.0e-04 loss: 6.747e-01]
my_first_lora_v6:  78%|#######7  | 2721/3500 [25:14<27:16,  2.10s/it, lr: 1.0e-04 loss: 1.694e-01]
my_first_lora_v6:  78%|#######7  | 2721/3500 [25:14<27:16,  2.10s/it, lr: 1.0e-04 loss: 1.694e-01]
my_first_lora_v6:  78%|#######7  | 2722/3500 [25:17<27:15,  2.10s/it, lr: 1.0e-04 loss: 3.400e-01]
my_first_lora_v6:  78%|#######7  | 2722/3500 [25:17<27:15,  2.10s/it, lr: 1.0e-04 loss: 3.400e-01]
my_first_lora_v6:  78%|#######7  | 2723/3500 [25:18<27:11,  2.10s/it, lr: 1.0e-04 loss: 7.372e-01]
my_first_lora_v6:  78%|#######7  | 2723/3500 [25:18<27:11,  2.10s/it, lr: 1.0e-04 loss: 7.372e-01]
my_first_lora_v6:  78%|#######7  | 2724/3500 [25:19<27:08,  2.10s/it, lr: 1.0e-04 loss: 7.581e-01]
my_first_lora_v6:  78%|#######7  | 2724/3500 [25:19<27:08,  2.10s/it, lr: 1.0e-04 loss: 7.581e-01]
my_first_lora_v6:  78%|#######7  | 2725/3500 [25:21<27:06,  2.10s/it, lr: 1.0e-04 loss: 3.888e-01]
my_first_lora_v6:  78%|#######7  | 2725/3500 [25:21<27:06,  2.10s/it, lr: 1.0e-04 loss: 3.888e-01]
my_first_lora_v6:  78%|#######7  | 2726/3500 [25:24<27:05,  2.10s/it, lr: 1.0e-04 loss: 1.341e-01]
my_first_lora_v6:  78%|#######7  | 2726/3500 [25:24<27:05,  2.10s/it, lr: 1.0e-04 loss: 1.341e-01]
my_first_lora_v6:  78%|#######7  | 2727/3500 [25:27<27:03,  2.10s/it, lr: 1.0e-04 loss: 7.615e-01]
my_first_lora_v6:  78%|#######7  | 2727/3500 [25:27<27:03,  2.10s/it, lr: 1.0e-04 loss: 7.615e-01]
my_first_lora_v6:  78%|#######7  | 2728/3500 [25:29<27:02,  2.10s/it, lr: 1.0e-04 loss: 7.434e-01]
my_first_lora_v6:  78%|#######7  | 2728/3500 [25:29<27:02,  2.10s/it, lr: 1.0e-04 loss: 7.434e-01]
my_first_lora_v6:  78%|#######7  | 2729/3500 [25:32<27:00,  2.10s/it, lr: 1.0e-04 loss: 1.956e-01]
my_first_lora_v6:  78%|#######7  | 2729/3500 [25:32<27:00,  2.10s/it, lr: 1.0e-04 loss: 1.956e-01]
my_first_lora_v6:  78%|#######8  | 2730/3500 [25:35<26:59,  2.10s/it, lr: 1.0e-04 loss: 5.476e-01]
my_first_lora_v6:  78%|#######8  | 2730/3500 [25:35<26:59,  2.10s/it, lr: 1.0e-04 loss: 5.476e-01]
my_first_lora_v6:  78%|#######8  | 2731/3500 [25:36<26:56,  2.10s/it, lr: 1.0e-04 loss: 8.701e-02]
my_first_lora_v6:  78%|#######8  | 2731/3500 [25:36<26:56,  2.10s/it, lr: 1.0e-04 loss: 8.701e-02]
my_first_lora_v6:  78%|#######8  | 2732/3500 [25:38<26:54,  2.10s/it, lr: 1.0e-04 loss: 8.397e-01]
my_first_lora_v6:  78%|#######8  | 2732/3500 [25:38<26:54,  2.10s/it, lr: 1.0e-04 loss: 8.397e-01]
my_first_lora_v6:  78%|#######8  | 2733/3500 [25:41<26:52,  2.10s/it, lr: 1.0e-04 loss: 7.292e-01]
my_first_lora_v6:  78%|#######8  | 2733/3500 [25:41<26:52,  2.10s/it, lr: 1.0e-04 loss: 7.292e-01]
my_first_lora_v6:  78%|#######8  | 2734/3500 [25:43<26:50,  2.10s/it, lr: 1.0e-04 loss: 4.134e-01]
my_first_lora_v6:  78%|#######8  | 2734/3500 [25:43<26:50,  2.10s/it, lr: 1.0e-04 loss: 4.134e-01]
my_first_lora_v6:  78%|#######8  | 2735/3500 [25:44<26:47,  2.10s/it, lr: 1.0e-04 loss: 1.563e-01]
my_first_lora_v6:  78%|#######8  | 2735/3500 [25:44<26:47,  2.10s/it, lr: 1.0e-04 loss: 1.563e-01]
my_first_lora_v6:  78%|#######8  | 2736/3500 [25:46<26:44,  2.10s/it, lr: 1.0e-04 loss: 1.652e-01]
my_first_lora_v6:  78%|#######8  | 2736/3500 [25:46<26:44,  2.10s/it, lr: 1.0e-04 loss: 1.652e-01]
my_first_lora_v6:  78%|#######8  | 2737/3500 [25:48<26:42,  2.10s/it, lr: 1.0e-04 loss: 7.735e-01]
my_first_lora_v6:  78%|#######8  | 2737/3500 [25:48<26:42,  2.10s/it, lr: 1.0e-04 loss: 7.735e-01]
my_first_lora_v6:  78%|#######8  | 2738/3500 [25:50<26:41,  2.10s/it, lr: 1.0e-04 loss: 3.001e-01]
my_first_lora_v6:  78%|#######8  | 2738/3500 [25:50<26:41,  2.10s/it, lr: 1.0e-04 loss: 3.001e-01]
my_first_lora_v6:  78%|#######8  | 2739/3500 [25:53<26:39,  2.10s/it, lr: 1.0e-04 loss: 5.657e-01]
my_first_lora_v6:  78%|#######8  | 2739/3500 [25:53<26:39,  2.10s/it, lr: 1.0e-04 loss: 5.657e-01]
my_first_lora_v6:  78%|#######8  | 2740/3500 [25:55<26:37,  2.10s/it, lr: 1.0e-04 loss: 6.879e-02]
my_first_lora_v6:  78%|#######8  | 2740/3500 [25:55<26:37,  2.10s/it, lr: 1.0e-04 loss: 6.879e-02]
my_first_lora_v6:  78%|#######8  | 2741/3500 [25:57<26:35,  2.10s/it, lr: 1.0e-04 loss: 7.267e-01]
my_first_lora_v6:  78%|#######8  | 2741/3500 [25:57<26:35,  2.10s/it, lr: 1.0e-04 loss: 7.267e-01]
my_first_lora_v6:  78%|#######8  | 2742/3500 [26:00<26:33,  2.10s/it, lr: 1.0e-04 loss: 1.989e-01]
my_first_lora_v6:  78%|#######8  | 2742/3500 [26:00<26:33,  2.10s/it, lr: 1.0e-04 loss: 1.989e-01]
my_first_lora_v6:  78%|#######8  | 2743/3500 [26:01<26:30,  2.10s/it, lr: 1.0e-04 loss: 2.477e-01]
my_first_lora_v6:  78%|#######8  | 2743/3500 [26:01<26:30,  2.10s/it, lr: 1.0e-04 loss: 2.477e-01]
my_first_lora_v6:  78%|#######8  | 2744/3500 [26:03<26:29,  2.10s/it, lr: 1.0e-04 loss: 2.796e-02]
my_first_lora_v6:  78%|#######8  | 2744/3500 [26:03<26:29,  2.10s/it, lr: 1.0e-04 loss: 2.796e-02]
my_first_lora_v6:  78%|#######8  | 2745/3500 [26:05<26:26,  2.10s/it, lr: 1.0e-04 loss: 8.177e-01]
my_first_lora_v6:  78%|#######8  | 2745/3500 [26:05<26:26,  2.10s/it, lr: 1.0e-04 loss: 8.177e-01]
my_first_lora_v6:  78%|#######8  | 2746/3500 [26:07<26:24,  2.10s/it, lr: 1.0e-04 loss: 6.420e-01]
my_first_lora_v6:  78%|#######8  | 2746/3500 [26:07<26:24,  2.10s/it, lr: 1.0e-04 loss: 6.420e-01]
my_first_lora_v6:  78%|#######8  | 2747/3500 [26:10<26:23,  2.10s/it, lr: 1.0e-04 loss: 2.424e-01]
my_first_lora_v6:  78%|#######8  | 2747/3500 [26:10<26:23,  2.10s/it, lr: 1.0e-04 loss: 2.424e-01]
my_first_lora_v6:  79%|#######8  | 2748/3500 [26:13<26:21,  2.10s/it, lr: 1.0e-04 loss: 5.417e-01]
my_first_lora_v6:  79%|#######8  | 2748/3500 [26:13<26:21,  2.10s/it, lr: 1.0e-04 loss: 5.417e-01]
my_first_lora_v6:  79%|#######8  | 2749/3500 [26:14<26:18,  2.10s/it, lr: 1.0e-04 loss: 5.529e-01]
my_first_lora_v6:  79%|#######8  | 2749/3500 [26:14<26:18,  2.10s/it, lr: 1.0e-04 loss: 5.529e-01]Unloading assistant lora



Generating Images:   0%|          | 0/5 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/5 [00:00<?, ?it/s]


Generating Images:  20%|##        | 1/5 [00:07<00:31,  7.94s/it]
Generating Images:  20%|##        | 1/5 [00:07<00:31,  7.94s/it]


Generating Images:  40%|####      | 2/5 [00:15<00:23,  7.85s/it]
Generating Images:  40%|####      | 2/5 [00:15<00:23,  7.85s/it]


Generating Images:  60%|######    | 3/5 [00:23<00:15,  7.76s/it]
Generating Images:  60%|######    | 3/5 [00:23<00:15,  7.76s/it]


Generating Images:  80%|########  | 4/5 [00:31<00:07,  7.76s/it]
Generating Images:  80%|########  | 4/5 [00:31<00:07,  7.76s/it]


Generating Images: 100%|##########| 5/5 [00:39<00:00,  7.80s/it]
Generating Images: 100%|##########| 5/5 [00:39<00:00,  7.80s/it]


                                                                
                                                                Loading assistant lora

my_first_lora_v6:  79%|#######8  | 2750/3500 [26:16<26:16,  2.10s/it, lr: 1.0e-04 loss: 6.839e-01]
my_first_lora_v6:  79%|#######8  | 2750/3500 [26:16<26:16,  2.10s/it, lr: 1.0e-04 loss: 6.839e-01]
my_first_lora_v6:  79%|#######8  | 2751/3500 [26:18<26:14,  2.10s/it, lr: 1.0e-04 loss: 6.387e-02]
my_first_lora_v6:  79%|#######8  | 2751/3500 [26:18<26:14,  2.10s/it, lr: 1.0e-04 loss: 6.387e-02]
my_first_lora_v6:  79%|#######8  | 2752/3500 [26:20<26:12,  2.10s/it, lr: 1.0e-04 loss: 1.283e-01]
my_first_lora_v6:  79%|#######8  | 2752/3500 [26:20<26:12,  2.10s/it, lr: 1.0e-04 loss: 1.283e-01]
my_first_lora_v6:  79%|#######8  | 2753/3500 [26:21<26:09,  2.10s/it, lr: 1.0e-04 loss: 3.424e-01]
my_first_lora_v6:  79%|#######8  | 2753/3500 [26:21<26:09,  2.10s/it, lr: 1.0e-04 loss: 3.424e-01]
my_first_lora_v6:  79%|#######8  | 2754/3500 [26:23<26:07,  2.10s/it, lr: 1.0e-04 loss: 9.154e-02]
my_first_lora_v6:  79%|#######8  | 2754/3500 [26:23<26:07,  2.10s/it, lr: 1.0e-04 loss: 9.154e-02]
my_first_lora_v6:  79%|#######8  | 2755/3500 [26:26<26:05,  2.10s/it, lr: 1.0e-04 loss: 8.307e-01]
my_first_lora_v6:  79%|#######8  | 2755/3500 [26:26<26:05,  2.10s/it, lr: 1.0e-04 loss: 8.307e-01]
my_first_lora_v6:  79%|#######8  | 2756/3500 [26:29<26:04,  2.10s/it, lr: 1.0e-04 loss: 3.255e-01]
my_first_lora_v6:  79%|#######8  | 2756/3500 [26:29<26:04,  2.10s/it, lr: 1.0e-04 loss: 3.255e-01]
my_first_lora_v6:  79%|#######8  | 2757/3500 [26:31<26:02,  2.10s/it, lr: 1.0e-04 loss: 2.294e-01]
my_first_lora_v6:  79%|#######8  | 2757/3500 [26:31<26:02,  2.10s/it, lr: 1.0e-04 loss: 2.294e-01]
my_first_lora_v6:  79%|#######8  | 2758/3500 [26:33<26:00,  2.10s/it, lr: 1.0e-04 loss: 3.307e-01]
my_first_lora_v6:  79%|#######8  | 2758/3500 [26:33<26:00,  2.10s/it, lr: 1.0e-04 loss: 3.307e-01]
my_first_lora_v6:  79%|#######8  | 2759/3500 [26:34<25:56,  2.10s/it, lr: 1.0e-04 loss: 1.563e-01]
my_first_lora_v6:  79%|#######8  | 2759/3500 [26:34<25:56,  2.10s/it, lr: 1.0e-04 loss: 1.563e-01]
my_first_lora_v6:  79%|#######8  | 2760/3500 [26:37<25:55,  2.10s/it, lr: 1.0e-04 loss: 5.704e-01]
my_first_lora_v6:  79%|#######8  | 2760/3500 [26:37<25:55,  2.10s/it, lr: 1.0e-04 loss: 5.704e-01]
my_first_lora_v6:  79%|#######8  | 2761/3500 [26:39<25:53,  2.10s/it, lr: 1.0e-04 loss: 6.307e-01]
my_first_lora_v6:  79%|#######8  | 2761/3500 [26:39<25:53,  2.10s/it, lr: 1.0e-04 loss: 6.307e-01]
my_first_lora_v6:  79%|#######8  | 2762/3500 [26:41<25:51,  2.10s/it, lr: 1.0e-04 loss: 2.501e-01]
my_first_lora_v6:  79%|#######8  | 2762/3500 [26:41<25:51,  2.10s/it, lr: 1.0e-04 loss: 2.501e-01]
my_first_lora_v6:  79%|#######8  | 2763/3500 [26:42<25:48,  2.10s/it, lr: 1.0e-04 loss: 7.780e-02]
my_first_lora_v6:  79%|#######8  | 2763/3500 [26:42<25:48,  2.10s/it, lr: 1.0e-04 loss: 7.780e-02]
my_first_lora_v6:  79%|#######8  | 2764/3500 [26:45<25:46,  2.10s/it, lr: 1.0e-04 loss: 5.245e-01]
my_first_lora_v6:  79%|#######8  | 2764/3500 [26:45<25:46,  2.10s/it, lr: 1.0e-04 loss: 5.245e-01]
my_first_lora_v6:  79%|#######9  | 2765/3500 [26:47<25:44,  2.10s/it, lr: 1.0e-04 loss: 4.688e-01]
my_first_lora_v6:  79%|#######9  | 2765/3500 [26:47<25:44,  2.10s/it, lr: 1.0e-04 loss: 4.688e-01]
my_first_lora_v6:  79%|#######9  | 2766/3500 [26:48<25:41,  2.10s/it, lr: 1.0e-04 loss: 1.097e-01]
my_first_lora_v6:  79%|#######9  | 2766/3500 [26:48<25:41,  2.10s/it, lr: 1.0e-04 loss: 1.097e-01]
my_first_lora_v6:  79%|#######9  | 2767/3500 [26:49<25:38,  2.10s/it, lr: 1.0e-04 loss: 1.590e-01]
my_first_lora_v6:  79%|#######9  | 2767/3500 [26:49<25:38,  2.10s/it, lr: 1.0e-04 loss: 1.590e-01]
my_first_lora_v6:  79%|#######9  | 2768/3500 [26:52<25:36,  2.10s/it, lr: 1.0e-04 loss: 4.288e-01]
my_first_lora_v6:  79%|#######9  | 2768/3500 [26:52<25:36,  2.10s/it, lr: 1.0e-04 loss: 4.288e-01]
my_first_lora_v6:  79%|#######9  | 2769/3500 [26:54<25:34,  2.10s/it, lr: 1.0e-04 loss: 1.018e-01]
my_first_lora_v6:  79%|#######9  | 2769/3500 [26:54<25:34,  2.10s/it, lr: 1.0e-04 loss: 1.018e-01]
my_first_lora_v6:  79%|#######9  | 2770/3500 [26:56<25:32,  2.10s/it, lr: 1.0e-04 loss: 7.214e-01]
my_first_lora_v6:  79%|#######9  | 2770/3500 [26:56<25:32,  2.10s/it, lr: 1.0e-04 loss: 7.214e-01]
my_first_lora_v6:  79%|#######9  | 2771/3500 [26:59<25:31,  2.10s/it, lr: 1.0e-04 loss: 7.063e-01]
my_first_lora_v6:  79%|#######9  | 2771/3500 [26:59<25:31,  2.10s/it, lr: 1.0e-04 loss: 7.063e-01]
my_first_lora_v6:  79%|#######9  | 2772/3500 [27:01<25:29,  2.10s/it, lr: 1.0e-04 loss: 7.687e-01]
my_first_lora_v6:  79%|#######9  | 2772/3500 [27:01<25:29,  2.10s/it, lr: 1.0e-04 loss: 7.687e-01]
my_first_lora_v6:  79%|#######9  | 2773/3500 [27:04<25:27,  2.10s/it, lr: 1.0e-04 loss: 1.903e-01]
my_first_lora_v6:  79%|#######9  | 2773/3500 [27:04<25:27,  2.10s/it, lr: 1.0e-04 loss: 1.903e-01]
my_first_lora_v6:  79%|#######9  | 2774/3500 [27:07<25:26,  2.10s/it, lr: 1.0e-04 loss: 1.570e-01]
my_first_lora_v6:  79%|#######9  | 2774/3500 [27:07<25:26,  2.10s/it, lr: 1.0e-04 loss: 1.570e-01]
my_first_lora_v6:  79%|#######9  | 2775/3500 [27:09<25:24,  2.10s/it, lr: 1.0e-04 loss: 5.718e-01]
my_first_lora_v6:  79%|#######9  | 2775/3500 [27:09<25:24,  2.10s/it, lr: 1.0e-04 loss: 5.718e-01]
my_first_lora_v6:  79%|#######9  | 2776/3500 [27:11<25:22,  2.10s/it, lr: 1.0e-04 loss: 3.335e-01]
my_first_lora_v6:  79%|#######9  | 2776/3500 [27:11<25:22,  2.10s/it, lr: 1.0e-04 loss: 3.335e-01]
my_first_lora_v6:  79%|#######9  | 2777/3500 [27:13<25:20,  2.10s/it, lr: 1.0e-04 loss: 4.206e-01]
my_first_lora_v6:  79%|#######9  | 2777/3500 [27:13<25:20,  2.10s/it, lr: 1.0e-04 loss: 4.206e-01]
my_first_lora_v6:  79%|#######9  | 2778/3500 [27:15<25:17,  2.10s/it, lr: 1.0e-04 loss: 8.275e-01]
my_first_lora_v6:  79%|#######9  | 2778/3500 [27:15<25:17,  2.10s/it, lr: 1.0e-04 loss: 8.275e-01]
my_first_lora_v6:  79%|#######9  | 2779/3500 [27:17<25:15,  2.10s/it, lr: 1.0e-04 loss: 7.903e-01]
my_first_lora_v6:  79%|#######9  | 2779/3500 [27:17<25:15,  2.10s/it, lr: 1.0e-04 loss: 7.903e-01]
my_first_lora_v6:  79%|#######9  | 2780/3500 [27:20<25:13,  2.10s/it, lr: 1.0e-04 loss: 5.148e-02]
my_first_lora_v6:  79%|#######9  | 2780/3500 [27:20<25:13,  2.10s/it, lr: 1.0e-04 loss: 5.148e-02]
my_first_lora_v6:  79%|#######9  | 2781/3500 [27:21<25:10,  2.10s/it, lr: 1.0e-04 loss: 3.593e-01]
my_first_lora_v6:  79%|#######9  | 2781/3500 [27:21<25:10,  2.10s/it, lr: 1.0e-04 loss: 3.593e-01]
my_first_lora_v6:  79%|#######9  | 2782/3500 [27:22<25:08,  2.10s/it, lr: 1.0e-04 loss: 4.383e-01]
my_first_lora_v6:  79%|#######9  | 2782/3500 [27:22<25:08,  2.10s/it, lr: 1.0e-04 loss: 4.383e-01]
my_first_lora_v6:  80%|#######9  | 2783/3500 [27:24<25:06,  2.10s/it, lr: 1.0e-04 loss: 5.320e-01]
my_first_lora_v6:  80%|#######9  | 2783/3500 [27:24<25:06,  2.10s/it, lr: 1.0e-04 loss: 5.320e-01]
my_first_lora_v6:  80%|#######9  | 2784/3500 [27:26<25:04,  2.10s/it, lr: 1.0e-04 loss: 6.320e-01]
my_first_lora_v6:  80%|#######9  | 2784/3500 [27:26<25:04,  2.10s/it, lr: 1.0e-04 loss: 6.320e-01]
my_first_lora_v6:  80%|#######9  | 2785/3500 [27:29<25:02,  2.10s/it, lr: 1.0e-04 loss: 4.016e-01]
my_first_lora_v6:  80%|#######9  | 2785/3500 [27:29<25:02,  2.10s/it, lr: 1.0e-04 loss: 4.016e-01]
my_first_lora_v6:  80%|#######9  | 2786/3500 [27:32<25:00,  2.10s/it, lr: 1.0e-04 loss: 1.948e-01]
my_first_lora_v6:  80%|#######9  | 2786/3500 [27:32<25:00,  2.10s/it, lr: 1.0e-04 loss: 1.948e-01]
my_first_lora_v6:  80%|#######9  | 2787/3500 [27:33<24:57,  2.10s/it, lr: 1.0e-04 loss: 7.961e-01]
my_first_lora_v6:  80%|#######9  | 2787/3500 [27:33<24:57,  2.10s/it, lr: 1.0e-04 loss: 7.961e-01]
my_first_lora_v6:  80%|#######9  | 2788/3500 [27:35<24:55,  2.10s/it, lr: 1.0e-04 loss: 3.558e-01]
my_first_lora_v6:  80%|#######9  | 2788/3500 [27:35<24:55,  2.10s/it, lr: 1.0e-04 loss: 3.558e-01]
my_first_lora_v6:  80%|#######9  | 2789/3500 [27:37<24:53,  2.10s/it, lr: 1.0e-04 loss: 5.174e-01]
my_first_lora_v6:  80%|#######9  | 2789/3500 [27:37<24:53,  2.10s/it, lr: 1.0e-04 loss: 5.174e-01]
my_first_lora_v6:  80%|#######9  | 2790/3500 [27:40<24:51,  2.10s/it, lr: 1.0e-04 loss: 2.341e-01]
my_first_lora_v6:  80%|#######9  | 2790/3500 [27:40<24:51,  2.10s/it, lr: 1.0e-04 loss: 2.341e-01]
my_first_lora_v6:  80%|#######9  | 2791/3500 [27:43<24:50,  2.10s/it, lr: 1.0e-04 loss: 8.095e-02]
my_first_lora_v6:  80%|#######9  | 2791/3500 [27:43<24:50,  2.10s/it, lr: 1.0e-04 loss: 8.095e-02]
my_first_lora_v6:  80%|#######9  | 2792/3500 [27:44<24:47,  2.10s/it, lr: 1.0e-04 loss: 2.625e-01]
my_first_lora_v6:  80%|#######9  | 2792/3500 [27:44<24:47,  2.10s/it, lr: 1.0e-04 loss: 2.625e-01]
my_first_lora_v6:  80%|#######9  | 2793/3500 [27:45<24:44,  2.10s/it, lr: 1.0e-04 loss: 5.247e-01]
my_first_lora_v6:  80%|#######9  | 2793/3500 [27:45<24:44,  2.10s/it, lr: 1.0e-04 loss: 5.247e-01]
my_first_lora_v6:  80%|#######9  | 2794/3500 [27:47<24:42,  2.10s/it, lr: 1.0e-04 loss: 6.889e-02]
my_first_lora_v6:  80%|#######9  | 2794/3500 [27:47<24:42,  2.10s/it, lr: 1.0e-04 loss: 6.889e-02]
my_first_lora_v6:  80%|#######9  | 2795/3500 [27:49<24:40,  2.10s/it, lr: 1.0e-04 loss: 1.972e-01]
my_first_lora_v6:  80%|#######9  | 2795/3500 [27:49<24:40,  2.10s/it, lr: 1.0e-04 loss: 1.972e-01]
my_first_lora_v6:  80%|#######9  | 2796/3500 [27:52<24:39,  2.10s/it, lr: 1.0e-04 loss: 1.430e-01]
my_first_lora_v6:  80%|#######9  | 2796/3500 [27:52<24:39,  2.10s/it, lr: 1.0e-04 loss: 1.430e-01]
my_first_lora_v6:  80%|#######9  | 2797/3500 [27:54<24:37,  2.10s/it, lr: 1.0e-04 loss: 8.234e-01]
my_first_lora_v6:  80%|#######9  | 2797/3500 [27:54<24:37,  2.10s/it, lr: 1.0e-04 loss: 8.234e-01]
my_first_lora_v6:  80%|#######9  | 2798/3500 [27:57<24:35,  2.10s/it, lr: 1.0e-04 loss: 2.089e-01]
my_first_lora_v6:  80%|#######9  | 2798/3500 [27:57<24:35,  2.10s/it, lr: 1.0e-04 loss: 2.089e-01]
my_first_lora_v6:  80%|#######9  | 2799/3500 [27:59<24:33,  2.10s/it, lr: 1.0e-04 loss: 5.224e-01]
my_first_lora_v6:  80%|#######9  | 2799/3500 [27:59<24:33,  2.10s/it, lr: 1.0e-04 loss: 5.224e-01]
my_first_lora_v6:  80%|########  | 2800/3500 [28:00<24:30,  2.10s/it, lr: 1.0e-04 loss: 7.482e-02]
my_first_lora_v6:  80%|########  | 2800/3500 [28:00<24:30,  2.10s/it, lr: 1.0e-04 loss: 7.482e-02]
my_first_lora_v6:  80%|########  | 2801/3500 [28:01<24:27,  2.10s/it, lr: 1.0e-04 loss: 8.153e-01]
my_first_lora_v6:  80%|########  | 2801/3500 [28:01<24:27,  2.10s/it, lr: 1.0e-04 loss: 8.153e-01]
my_first_lora_v6:  80%|########  | 2802/3500 [28:03<24:25,  2.10s/it, lr: 1.0e-04 loss: 2.317e-01]
my_first_lora_v6:  80%|########  | 2802/3500 [28:03<24:25,  2.10s/it, lr: 1.0e-04 loss: 2.317e-01]
my_first_lora_v6:  80%|########  | 2803/3500 [28:05<24:23,  2.10s/it, lr: 1.0e-04 loss: 3.206e-01]
my_first_lora_v6:  80%|########  | 2803/3500 [28:05<24:23,  2.10s/it, lr: 1.0e-04 loss: 3.206e-01]
my_first_lora_v6:  80%|########  | 2804/3500 [28:08<24:21,  2.10s/it, lr: 1.0e-04 loss: 8.303e-01]
my_first_lora_v6:  80%|########  | 2804/3500 [28:08<24:21,  2.10s/it, lr: 1.0e-04 loss: 8.303e-01]
my_first_lora_v6:  80%|########  | 2805/3500 [28:10<24:19,  2.10s/it, lr: 1.0e-04 loss: 5.856e-01]
my_first_lora_v6:  80%|########  | 2805/3500 [28:10<24:19,  2.10s/it, lr: 1.0e-04 loss: 5.856e-01]
my_first_lora_v6:  80%|########  | 2806/3500 [28:13<24:18,  2.10s/it, lr: 1.0e-04 loss: 7.587e-01]
my_first_lora_v6:  80%|########  | 2806/3500 [28:13<24:18,  2.10s/it, lr: 1.0e-04 loss: 7.587e-01]
my_first_lora_v6:  80%|########  | 2807/3500 [28:16<24:16,  2.10s/it, lr: 1.0e-04 loss: 3.985e-02]
my_first_lora_v6:  80%|########  | 2807/3500 [28:16<24:16,  2.10s/it, lr: 1.0e-04 loss: 3.985e-02]
my_first_lora_v6:  80%|########  | 2808/3500 [28:18<24:14,  2.10s/it, lr: 1.0e-04 loss: 7.790e-01]
my_first_lora_v6:  80%|########  | 2808/3500 [28:18<24:14,  2.10s/it, lr: 1.0e-04 loss: 7.790e-01]
my_first_lora_v6:  80%|########  | 2809/3500 [28:20<24:12,  2.10s/it, lr: 1.0e-04 loss: 7.641e-01]
my_first_lora_v6:  80%|########  | 2809/3500 [28:20<24:12,  2.10s/it, lr: 1.0e-04 loss: 7.641e-01]
my_first_lora_v6:  80%|########  | 2810/3500 [28:23<24:11,  2.10s/it, lr: 1.0e-04 loss: 7.879e-01]
my_first_lora_v6:  80%|########  | 2810/3500 [28:23<24:11,  2.10s/it, lr: 1.0e-04 loss: 7.879e-01]
my_first_lora_v6:  80%|########  | 2811/3500 [28:26<24:09,  2.10s/it, lr: 1.0e-04 loss: 5.814e-01]
my_first_lora_v6:  80%|########  | 2811/3500 [28:26<24:09,  2.10s/it, lr: 1.0e-04 loss: 5.814e-01]
my_first_lora_v6:  80%|########  | 2812/3500 [28:28<24:07,  2.10s/it, lr: 1.0e-04 loss: 1.005e-01]
my_first_lora_v6:  80%|########  | 2812/3500 [28:28<24:07,  2.10s/it, lr: 1.0e-04 loss: 1.005e-01]
my_first_lora_v6:  80%|########  | 2813/3500 [28:30<24:05,  2.10s/it, lr: 1.0e-04 loss: 5.150e-02]
my_first_lora_v6:  80%|########  | 2813/3500 [28:30<24:05,  2.10s/it, lr: 1.0e-04 loss: 5.150e-02]
my_first_lora_v6:  80%|########  | 2814/3500 [28:32<24:03,  2.10s/it, lr: 1.0e-04 loss: 5.195e-01]
my_first_lora_v6:  80%|########  | 2814/3500 [28:32<24:03,  2.10s/it, lr: 1.0e-04 loss: 5.195e-01]
my_first_lora_v6:  80%|########  | 2815/3500 [28:33<24:00,  2.10s/it, lr: 1.0e-04 loss: 9.160e-02]
my_first_lora_v6:  80%|########  | 2815/3500 [28:33<24:00,  2.10s/it, lr: 1.0e-04 loss: 9.160e-02]
my_first_lora_v6:  80%|########  | 2816/3500 [28:34<23:57,  2.10s/it, lr: 1.0e-04 loss: 3.304e-01]
my_first_lora_v6:  80%|########  | 2816/3500 [28:34<23:57,  2.10s/it, lr: 1.0e-04 loss: 3.304e-01]
my_first_lora_v6:  80%|########  | 2817/3500 [28:36<23:55,  2.10s/it, lr: 1.0e-04 loss: 5.453e-01]
my_first_lora_v6:  80%|########  | 2817/3500 [28:36<23:55,  2.10s/it, lr: 1.0e-04 loss: 5.453e-01]
my_first_lora_v6:  81%|########  | 2818/3500 [28:39<23:53,  2.10s/it, lr: 1.0e-04 loss: 4.435e-01]
my_first_lora_v6:  81%|########  | 2818/3500 [28:39<23:53,  2.10s/it, lr: 1.0e-04 loss: 4.435e-01]
my_first_lora_v6:  81%|########  | 2819/3500 [28:42<23:51,  2.10s/it, lr: 1.0e-04 loss: 3.677e-01]
my_first_lora_v6:  81%|########  | 2819/3500 [28:42<23:51,  2.10s/it, lr: 1.0e-04 loss: 3.677e-01]
my_first_lora_v6:  81%|########  | 2820/3500 [28:43<23:48,  2.10s/it, lr: 1.0e-04 loss: 6.126e-01]
my_first_lora_v6:  81%|########  | 2820/3500 [28:43<23:48,  2.10s/it, lr: 1.0e-04 loss: 6.126e-01]
my_first_lora_v6:  81%|########  | 2821/3500 [28:44<23:46,  2.10s/it, lr: 1.0e-04 loss: 3.140e-01]
my_first_lora_v6:  81%|########  | 2821/3500 [28:44<23:46,  2.10s/it, lr: 1.0e-04 loss: 3.140e-01]
my_first_lora_v6:  81%|########  | 2822/3500 [28:47<23:44,  2.10s/it, lr: 1.0e-04 loss: 6.652e-01]
my_first_lora_v6:  81%|########  | 2822/3500 [28:47<23:44,  2.10s/it, lr: 1.0e-04 loss: 6.652e-01]
my_first_lora_v6:  81%|########  | 2823/3500 [28:49<23:42,  2.10s/it, lr: 1.0e-04 loss: 8.020e-01]
my_first_lora_v6:  81%|########  | 2823/3500 [28:49<23:42,  2.10s/it, lr: 1.0e-04 loss: 8.020e-01]
my_first_lora_v6:  81%|########  | 2824/3500 [28:52<23:41,  2.10s/it, lr: 1.0e-04 loss: 2.001e-01]
my_first_lora_v6:  81%|########  | 2824/3500 [28:52<23:41,  2.10s/it, lr: 1.0e-04 loss: 2.001e-01]
my_first_lora_v6:  81%|########  | 2825/3500 [28:54<23:39,  2.10s/it, lr: 1.0e-04 loss: 2.922e-01]
my_first_lora_v6:  81%|########  | 2825/3500 [28:54<23:39,  2.10s/it, lr: 1.0e-04 loss: 2.922e-01]
my_first_lora_v6:  81%|########  | 2826/3500 [28:55<23:36,  2.10s/it, lr: 1.0e-04 loss: 7.600e-01]
my_first_lora_v6:  81%|########  | 2826/3500 [28:55<23:36,  2.10s/it, lr: 1.0e-04 loss: 7.600e-01]
my_first_lora_v6:  81%|########  | 2827/3500 [28:58<23:34,  2.10s/it, lr: 1.0e-04 loss: 2.096e-01]
my_first_lora_v6:  81%|########  | 2827/3500 [28:58<23:34,  2.10s/it, lr: 1.0e-04 loss: 2.096e-01]
my_first_lora_v6:  81%|########  | 2828/3500 [29:01<23:33,  2.10s/it, lr: 1.0e-04 loss: 6.217e-01]
my_first_lora_v6:  81%|########  | 2828/3500 [29:01<23:33,  2.10s/it, lr: 1.0e-04 loss: 6.217e-01]
my_first_lora_v6:  81%|########  | 2829/3500 [29:02<23:30,  2.10s/it, lr: 1.0e-04 loss: 1.167e-01]
my_first_lora_v6:  81%|########  | 2829/3500 [29:02<23:30,  2.10s/it, lr: 1.0e-04 loss: 1.167e-01]
my_first_lora_v6:  81%|########  | 2830/3500 [29:04<23:28,  2.10s/it, lr: 1.0e-04 loss: 3.044e-01]
my_first_lora_v6:  81%|########  | 2830/3500 [29:04<23:28,  2.10s/it, lr: 1.0e-04 loss: 3.044e-01]
my_first_lora_v6:  81%|########  | 2831/3500 [29:05<23:25,  2.10s/it, lr: 1.0e-04 loss: 4.934e-01]
my_first_lora_v6:  81%|########  | 2831/3500 [29:05<23:25,  2.10s/it, lr: 1.0e-04 loss: 4.934e-01]
my_first_lora_v6:  81%|########  | 2832/3500 [29:07<23:23,  2.10s/it, lr: 1.0e-04 loss: 4.755e-01]
my_first_lora_v6:  81%|########  | 2832/3500 [29:07<23:23,  2.10s/it, lr: 1.0e-04 loss: 4.755e-01]
my_first_lora_v6:  81%|########  | 2833/3500 [29:10<23:21,  2.10s/it, lr: 1.0e-04 loss: 3.818e-01]
my_first_lora_v6:  81%|########  | 2833/3500 [29:10<23:21,  2.10s/it, lr: 1.0e-04 loss: 3.818e-01]
my_first_lora_v6:  81%|########  | 2834/3500 [29:12<23:19,  2.10s/it, lr: 1.0e-04 loss: 2.307e-01]
my_first_lora_v6:  81%|########  | 2834/3500 [29:12<23:19,  2.10s/it, lr: 1.0e-04 loss: 2.307e-01]
my_first_lora_v6:  81%|########1 | 2835/3500 [29:14<23:17,  2.10s/it, lr: 1.0e-04 loss: 5.754e-02]
my_first_lora_v6:  81%|########1 | 2835/3500 [29:14<23:17,  2.10s/it, lr: 1.0e-04 loss: 5.754e-02]
my_first_lora_v6:  81%|########1 | 2836/3500 [29:17<23:15,  2.10s/it, lr: 1.0e-04 loss: 1.545e-01]
my_first_lora_v6:  81%|########1 | 2836/3500 [29:17<23:15,  2.10s/it, lr: 1.0e-04 loss: 1.545e-01]
my_first_lora_v6:  81%|########1 | 2837/3500 [29:19<23:13,  2.10s/it, lr: 1.0e-04 loss: 1.057e-01]
my_first_lora_v6:  81%|########1 | 2837/3500 [29:19<23:13,  2.10s/it, lr: 1.0e-04 loss: 1.057e-01]
my_first_lora_v6:  81%|########1 | 2838/3500 [29:20<23:10,  2.10s/it, lr: 1.0e-04 loss: 6.659e-01]
my_first_lora_v6:  81%|########1 | 2838/3500 [29:20<23:10,  2.10s/it, lr: 1.0e-04 loss: 6.659e-01]
my_first_lora_v6:  81%|########1 | 2839/3500 [29:22<23:08,  2.10s/it, lr: 1.0e-04 loss: 1.232e-01]
my_first_lora_v6:  81%|########1 | 2839/3500 [29:22<23:08,  2.10s/it, lr: 1.0e-04 loss: 1.232e-01]
my_first_lora_v6:  81%|########1 | 2840/3500 [29:24<23:06,  2.10s/it, lr: 1.0e-04 loss: 8.387e-01]
my_first_lora_v6:  81%|########1 | 2840/3500 [29:24<23:06,  2.10s/it, lr: 1.0e-04 loss: 8.387e-01]
my_first_lora_v6:  81%|########1 | 2841/3500 [29:25<23:03,  2.10s/it, lr: 1.0e-04 loss: 7.127e-01]
my_first_lora_v6:  81%|########1 | 2841/3500 [29:25<23:03,  2.10s/it, lr: 1.0e-04 loss: 7.127e-01]
my_first_lora_v6:  81%|########1 | 2842/3500 [29:28<23:01,  2.10s/it, lr: 1.0e-04 loss: 7.660e-01]
my_first_lora_v6:  81%|########1 | 2842/3500 [29:28<23:01,  2.10s/it, lr: 1.0e-04 loss: 7.660e-01]
my_first_lora_v6:  81%|########1 | 2843/3500 [29:31<23:00,  2.10s/it, lr: 1.0e-04 loss: 1.077e-02]
my_first_lora_v6:  81%|########1 | 2843/3500 [29:31<23:00,  2.10s/it, lr: 1.0e-04 loss: 1.077e-02]
my_first_lora_v6:  81%|########1 | 2844/3500 [29:33<22:58,  2.10s/it, lr: 1.0e-04 loss: 7.969e-01]
my_first_lora_v6:  81%|########1 | 2844/3500 [29:33<22:58,  2.10s/it, lr: 1.0e-04 loss: 7.969e-01]
my_first_lora_v6:  81%|########1 | 2845/3500 [29:34<22:55,  2.10s/it, lr: 1.0e-04 loss: 6.088e-01]
my_first_lora_v6:  81%|########1 | 2845/3500 [29:34<22:55,  2.10s/it, lr: 1.0e-04 loss: 6.088e-01]
my_first_lora_v6:  81%|########1 | 2846/3500 [29:37<22:54,  2.10s/it, lr: 1.0e-04 loss: 9.306e-02]
my_first_lora_v6:  81%|########1 | 2846/3500 [29:37<22:54,  2.10s/it, lr: 1.0e-04 loss: 9.306e-02]
my_first_lora_v6:  81%|########1 | 2847/3500 [29:39<22:51,  2.10s/it, lr: 1.0e-04 loss: 6.450e-01]
my_first_lora_v6:  81%|########1 | 2847/3500 [29:39<22:51,  2.10s/it, lr: 1.0e-04 loss: 6.450e-01]
my_first_lora_v6:  81%|########1 | 2848/3500 [29:41<22:50,  2.10s/it, lr: 1.0e-04 loss: 3.992e-01]
my_first_lora_v6:  81%|########1 | 2848/3500 [29:41<22:50,  2.10s/it, lr: 1.0e-04 loss: 3.992e-01]
my_first_lora_v6:  81%|########1 | 2849/3500 [29:44<22:48,  2.10s/it, lr: 1.0e-04 loss: 7.923e-01]
my_first_lora_v6:  81%|########1 | 2849/3500 [29:44<22:48,  2.10s/it, lr: 1.0e-04 loss: 7.923e-01]
my_first_lora_v6:  81%|########1 | 2850/3500 [29:45<22:45,  2.10s/it, lr: 1.0e-04 loss: 7.976e-01]
my_first_lora_v6:  81%|########1 | 2850/3500 [29:45<22:45,  2.10s/it, lr: 1.0e-04 loss: 7.976e-01]
my_first_lora_v6:  81%|########1 | 2851/3500 [29:48<22:43,  2.10s/it, lr: 1.0e-04 loss: 2.654e-01]
my_first_lora_v6:  81%|########1 | 2851/3500 [29:48<22:43,  2.10s/it, lr: 1.0e-04 loss: 2.654e-01]
my_first_lora_v6:  81%|########1 | 2852/3500 [29:50<22:41,  2.10s/it, lr: 1.0e-04 loss: 3.797e-01]
my_first_lora_v6:  81%|########1 | 2852/3500 [29:50<22:41,  2.10s/it, lr: 1.0e-04 loss: 3.797e-01]
my_first_lora_v6:  82%|########1 | 2853/3500 [29:52<22:39,  2.10s/it, lr: 1.0e-04 loss: 7.309e-01]
my_first_lora_v6:  82%|########1 | 2853/3500 [29:52<22:39,  2.10s/it, lr: 1.0e-04 loss: 7.309e-01]
my_first_lora_v6:  82%|########1 | 2854/3500 [29:55<22:38,  2.10s/it, lr: 1.0e-04 loss: 1.869e-02]
my_first_lora_v6:  82%|########1 | 2854/3500 [29:55<22:38,  2.10s/it, lr: 1.0e-04 loss: 1.869e-02]
my_first_lora_v6:  82%|########1 | 2855/3500 [29:56<22:35,  2.10s/it, lr: 1.0e-04 loss: 1.565e-01]
my_first_lora_v6:  82%|########1 | 2855/3500 [29:56<22:35,  2.10s/it, lr: 1.0e-04 loss: 1.565e-01]
my_first_lora_v6:  82%|########1 | 2856/3500 [29:59<22:33,  2.10s/it, lr: 1.0e-04 loss: 1.790e-01]
my_first_lora_v6:  82%|########1 | 2856/3500 [29:59<22:33,  2.10s/it, lr: 1.0e-04 loss: 1.790e-01]
my_first_lora_v6:  82%|########1 | 2857/3500 [30:01<22:31,  2.10s/it, lr: 1.0e-04 loss: 6.147e-01]
my_first_lora_v6:  82%|########1 | 2857/3500 [30:01<22:31,  2.10s/it, lr: 1.0e-04 loss: 6.147e-01]
my_first_lora_v6:  82%|########1 | 2858/3500 [30:02<22:28,  2.10s/it, lr: 1.0e-04 loss: 2.075e-01]
my_first_lora_v6:  82%|########1 | 2858/3500 [30:02<22:28,  2.10s/it, lr: 1.0e-04 loss: 2.075e-01]
my_first_lora_v6:  82%|########1 | 2859/3500 [30:05<22:27,  2.10s/it, lr: 1.0e-04 loss: 7.699e-02]
my_first_lora_v6:  82%|########1 | 2859/3500 [30:05<22:27,  2.10s/it, lr: 1.0e-04 loss: 7.699e-02]
my_first_lora_v6:  82%|########1 | 2860/3500 [30:07<22:24,  2.10s/it, lr: 1.0e-04 loss: 5.235e-01]
my_first_lora_v6:  82%|########1 | 2860/3500 [30:07<22:24,  2.10s/it, lr: 1.0e-04 loss: 5.235e-01]
my_first_lora_v6:  82%|########1 | 2861/3500 [30:09<22:22,  2.10s/it, lr: 1.0e-04 loss: 6.576e-01]
my_first_lora_v6:  82%|########1 | 2861/3500 [30:09<22:22,  2.10s/it, lr: 1.0e-04 loss: 6.576e-01]
my_first_lora_v6:  82%|########1 | 2862/3500 [30:11<22:20,  2.10s/it, lr: 1.0e-04 loss: 3.283e-01]
my_first_lora_v6:  82%|########1 | 2862/3500 [30:11<22:20,  2.10s/it, lr: 1.0e-04 loss: 3.283e-01]
my_first_lora_v6:  82%|########1 | 2863/3500 [30:12<22:18,  2.10s/it, lr: 1.0e-04 loss: 7.769e-01]
my_first_lora_v6:  82%|########1 | 2863/3500 [30:12<22:18,  2.10s/it, lr: 1.0e-04 loss: 7.769e-01]
my_first_lora_v6:  82%|########1 | 2864/3500 [30:15<22:16,  2.10s/it, lr: 1.0e-04 loss: 2.236e-01]
my_first_lora_v6:  82%|########1 | 2864/3500 [30:15<22:16,  2.10s/it, lr: 1.0e-04 loss: 2.236e-01]
my_first_lora_v6:  82%|########1 | 2865/3500 [30:18<22:14,  2.10s/it, lr: 1.0e-04 loss: 3.666e-01]
my_first_lora_v6:  82%|########1 | 2865/3500 [30:18<22:14,  2.10s/it, lr: 1.0e-04 loss: 3.666e-01]
my_first_lora_v6:  82%|########1 | 2866/3500 [30:20<22:12,  2.10s/it, lr: 1.0e-04 loss: 8.070e-01]
my_first_lora_v6:  82%|########1 | 2866/3500 [30:20<22:12,  2.10s/it, lr: 1.0e-04 loss: 8.070e-01]
my_first_lora_v6:  82%|########1 | 2867/3500 [30:23<22:11,  2.10s/it, lr: 1.0e-04 loss: 4.007e-01]
my_first_lora_v6:  82%|########1 | 2867/3500 [30:23<22:11,  2.10s/it, lr: 1.0e-04 loss: 4.007e-01]
my_first_lora_v6:  82%|########1 | 2868/3500 [30:25<22:08,  2.10s/it, lr: 1.0e-04 loss: 7.814e-01]
my_first_lora_v6:  82%|########1 | 2868/3500 [30:25<22:08,  2.10s/it, lr: 1.0e-04 loss: 7.814e-01]
my_first_lora_v6:  82%|########1 | 2869/3500 [30:26<22:06,  2.10s/it, lr: 1.0e-04 loss: 7.268e-01]
my_first_lora_v6:  82%|########1 | 2869/3500 [30:26<22:06,  2.10s/it, lr: 1.0e-04 loss: 7.268e-01]
my_first_lora_v6:  82%|########2 | 2870/3500 [30:28<22:04,  2.10s/it, lr: 1.0e-04 loss: 7.598e-02]
my_first_lora_v6:  82%|########2 | 2870/3500 [30:28<22:04,  2.10s/it, lr: 1.0e-04 loss: 7.598e-02]
my_first_lora_v6:  82%|########2 | 2871/3500 [30:30<22:01,  2.10s/it, lr: 1.0e-04 loss: 1.450e-01]
my_first_lora_v6:  82%|########2 | 2871/3500 [30:30<22:01,  2.10s/it, lr: 1.0e-04 loss: 1.450e-01]
my_first_lora_v6:  82%|########2 | 2872/3500 [30:33<22:00,  2.10s/it, lr: 1.0e-04 loss: 7.859e-01]
my_first_lora_v6:  82%|########2 | 2872/3500 [30:33<22:00,  2.10s/it, lr: 1.0e-04 loss: 7.859e-01]
my_first_lora_v6:  82%|########2 | 2873/3500 [30:35<21:58,  2.10s/it, lr: 1.0e-04 loss: 7.920e-01]
my_first_lora_v6:  82%|########2 | 2873/3500 [30:35<21:58,  2.10s/it, lr: 1.0e-04 loss: 7.920e-01]
my_first_lora_v6:  82%|########2 | 2874/3500 [30:36<21:55,  2.10s/it, lr: 1.0e-04 loss: 3.491e-02]
my_first_lora_v6:  82%|########2 | 2874/3500 [30:36<21:55,  2.10s/it, lr: 1.0e-04 loss: 3.491e-02]
my_first_lora_v6:  82%|########2 | 2875/3500 [30:39<21:53,  2.10s/it, lr: 1.0e-04 loss: 1.520e-01]
my_first_lora_v6:  82%|########2 | 2875/3500 [30:39<21:53,  2.10s/it, lr: 1.0e-04 loss: 1.520e-01]
my_first_lora_v6:  82%|########2 | 2876/3500 [30:41<21:51,  2.10s/it, lr: 1.0e-04 loss: 2.754e-01]
my_first_lora_v6:  82%|########2 | 2876/3500 [30:41<21:51,  2.10s/it, lr: 1.0e-04 loss: 2.754e-01]
my_first_lora_v6:  82%|########2 | 2877/3500 [30:43<21:49,  2.10s/it, lr: 1.0e-04 loss: 5.996e-01]
my_first_lora_v6:  82%|########2 | 2877/3500 [30:43<21:49,  2.10s/it, lr: 1.0e-04 loss: 5.996e-01]
my_first_lora_v6:  82%|########2 | 2878/3500 [30:46<21:47,  2.10s/it, lr: 1.0e-04 loss: 6.307e-01]
my_first_lora_v6:  82%|########2 | 2878/3500 [30:46<21:47,  2.10s/it, lr: 1.0e-04 loss: 6.307e-01]
my_first_lora_v6:  82%|########2 | 2879/3500 [30:48<21:46,  2.10s/it, lr: 1.0e-04 loss: 7.559e-01]
my_first_lora_v6:  82%|########2 | 2879/3500 [30:48<21:46,  2.10s/it, lr: 1.0e-04 loss: 7.559e-01]
my_first_lora_v6:  82%|########2 | 2880/3500 [30:49<21:43,  2.10s/it, lr: 1.0e-04 loss: 5.770e-01]
my_first_lora_v6:  82%|########2 | 2880/3500 [30:49<21:43,  2.10s/it, lr: 1.0e-04 loss: 5.770e-01]
my_first_lora_v6:  82%|########2 | 2881/3500 [30:51<21:41,  2.10s/it, lr: 1.0e-04 loss: 2.707e-01]
my_first_lora_v6:  82%|########2 | 2881/3500 [30:51<21:41,  2.10s/it, lr: 1.0e-04 loss: 2.707e-01]
my_first_lora_v6:  82%|########2 | 2882/3500 [30:53<21:38,  2.10s/it, lr: 1.0e-04 loss: 7.268e-01]
my_first_lora_v6:  82%|########2 | 2882/3500 [30:53<21:38,  2.10s/it, lr: 1.0e-04 loss: 7.268e-01]
my_first_lora_v6:  82%|########2 | 2883/3500 [30:56<21:37,  2.10s/it, lr: 1.0e-04 loss: 4.408e-01]
my_first_lora_v6:  82%|########2 | 2883/3500 [30:56<21:37,  2.10s/it, lr: 1.0e-04 loss: 4.408e-01]
my_first_lora_v6:  82%|########2 | 2884/3500 [30:57<21:34,  2.10s/it, lr: 1.0e-04 loss: 3.361e-01]
my_first_lora_v6:  82%|########2 | 2884/3500 [30:57<21:34,  2.10s/it, lr: 1.0e-04 loss: 3.361e-01]
my_first_lora_v6:  82%|########2 | 2885/3500 [30:58<21:31,  2.10s/it, lr: 1.0e-04 loss: 2.384e-01]
my_first_lora_v6:  82%|########2 | 2885/3500 [30:58<21:31,  2.10s/it, lr: 1.0e-04 loss: 2.384e-01]
my_first_lora_v6:  82%|########2 | 2886/3500 [31:00<21:29,  2.10s/it, lr: 1.0e-04 loss: 2.710e-01]
my_first_lora_v6:  82%|########2 | 2886/3500 [31:00<21:29,  2.10s/it, lr: 1.0e-04 loss: 2.710e-01]
my_first_lora_v6:  82%|########2 | 2887/3500 [31:03<21:27,  2.10s/it, lr: 1.0e-04 loss: 6.007e-01]
my_first_lora_v6:  82%|########2 | 2887/3500 [31:03<21:27,  2.10s/it, lr: 1.0e-04 loss: 6.007e-01]
my_first_lora_v6:  83%|########2 | 2888/3500 [31:05<21:25,  2.10s/it, lr: 1.0e-04 loss: 7.004e-01]
my_first_lora_v6:  83%|########2 | 2888/3500 [31:05<21:25,  2.10s/it, lr: 1.0e-04 loss: 7.004e-01]
my_first_lora_v6:  83%|########2 | 2889/3500 [31:08<21:24,  2.10s/it, lr: 1.0e-04 loss: 6.531e-02]
my_first_lora_v6:  83%|########2 | 2889/3500 [31:08<21:24,  2.10s/it, lr: 1.0e-04 loss: 6.531e-02]
my_first_lora_v6:  83%|########2 | 2890/3500 [31:11<21:22,  2.10s/it, lr: 1.0e-04 loss: 6.838e-01]
my_first_lora_v6:  83%|########2 | 2890/3500 [31:11<21:22,  2.10s/it, lr: 1.0e-04 loss: 6.838e-01]
my_first_lora_v6:  83%|########2 | 2891/3500 [31:12<21:19,  2.10s/it, lr: 1.0e-04 loss: 2.400e-01]
my_first_lora_v6:  83%|########2 | 2891/3500 [31:12<21:19,  2.10s/it, lr: 1.0e-04 loss: 2.400e-01]
my_first_lora_v6:  83%|########2 | 2892/3500 [31:15<21:18,  2.10s/it, lr: 1.0e-04 loss: 4.533e-01]
my_first_lora_v6:  83%|########2 | 2892/3500 [31:15<21:18,  2.10s/it, lr: 1.0e-04 loss: 4.533e-01]
my_first_lora_v6:  83%|########2 | 2893/3500 [31:17<21:16,  2.10s/it, lr: 1.0e-04 loss: 7.261e-01]
my_first_lora_v6:  83%|########2 | 2893/3500 [31:17<21:16,  2.10s/it, lr: 1.0e-04 loss: 7.261e-01]
my_first_lora_v6:  83%|########2 | 2894/3500 [31:18<21:13,  2.10s/it, lr: 1.0e-04 loss: 6.931e-01]
my_first_lora_v6:  83%|########2 | 2894/3500 [31:18<21:13,  2.10s/it, lr: 1.0e-04 loss: 6.931e-01]
my_first_lora_v6:  83%|########2 | 2895/3500 [31:21<21:11,  2.10s/it, lr: 1.0e-04 loss: 7.927e-01]
my_first_lora_v6:  83%|########2 | 2895/3500 [31:21<21:11,  2.10s/it, lr: 1.0e-04 loss: 7.927e-01]
my_first_lora_v6:  83%|########2 | 2896/3500 [31:23<21:09,  2.10s/it, lr: 1.0e-04 loss: 6.347e-01]
my_first_lora_v6:  83%|########2 | 2896/3500 [31:23<21:09,  2.10s/it, lr: 1.0e-04 loss: 6.347e-01]
my_first_lora_v6:  83%|########2 | 2897/3500 [31:25<21:07,  2.10s/it, lr: 1.0e-04 loss: 6.649e-01]
my_first_lora_v6:  83%|########2 | 2897/3500 [31:25<21:07,  2.10s/it, lr: 1.0e-04 loss: 6.649e-01]
my_first_lora_v6:  83%|########2 | 2898/3500 [31:27<21:05,  2.10s/it, lr: 1.0e-04 loss: 5.436e-02]
my_first_lora_v6:  83%|########2 | 2898/3500 [31:27<21:05,  2.10s/it, lr: 1.0e-04 loss: 5.436e-02]
my_first_lora_v6:  83%|########2 | 2899/3500 [31:30<21:03,  2.10s/it, lr: 1.0e-04 loss: 2.356e-01]
my_first_lora_v6:  83%|########2 | 2899/3500 [31:30<21:03,  2.10s/it, lr: 1.0e-04 loss: 2.356e-01]
my_first_lora_v6:  83%|########2 | 2900/3500 [31:32<21:01,  2.10s/it, lr: 1.0e-04 loss: 4.011e-01]
my_first_lora_v6:  83%|########2 | 2900/3500 [31:32<21:01,  2.10s/it, lr: 1.0e-04 loss: 4.011e-01]
my_first_lora_v6:  83%|########2 | 2901/3500 [31:34<20:59,  2.10s/it, lr: 1.0e-04 loss: 2.408e-01]
my_first_lora_v6:  83%|########2 | 2901/3500 [31:34<20:59,  2.10s/it, lr: 1.0e-04 loss: 2.408e-01]
my_first_lora_v6:  83%|########2 | 2902/3500 [31:36<20:57,  2.10s/it, lr: 1.0e-04 loss: 5.504e-01]
my_first_lora_v6:  83%|########2 | 2902/3500 [31:36<20:57,  2.10s/it, lr: 1.0e-04 loss: 5.504e-01]
my_first_lora_v6:  83%|########2 | 2903/3500 [31:39<20:55,  2.10s/it, lr: 1.0e-04 loss: 5.407e-01]
my_first_lora_v6:  83%|########2 | 2903/3500 [31:39<20:55,  2.10s/it, lr: 1.0e-04 loss: 5.407e-01]
my_first_lora_v6:  83%|########2 | 2904/3500 [31:40<20:52,  2.10s/it, lr: 1.0e-04 loss: 2.765e-01]
my_first_lora_v6:  83%|########2 | 2904/3500 [31:40<20:52,  2.10s/it, lr: 1.0e-04 loss: 2.765e-01]
my_first_lora_v6:  83%|########2 | 2905/3500 [31:41<20:50,  2.10s/it, lr: 1.0e-04 loss: 5.096e-01]
my_first_lora_v6:  83%|########2 | 2905/3500 [31:41<20:50,  2.10s/it, lr: 1.0e-04 loss: 5.096e-01]
my_first_lora_v6:  83%|########3 | 2906/3500 [31:43<20:48,  2.10s/it, lr: 1.0e-04 loss: 3.972e-01]
my_first_lora_v6:  83%|########3 | 2906/3500 [31:43<20:48,  2.10s/it, lr: 1.0e-04 loss: 3.972e-01]
my_first_lora_v6:  83%|########3 | 2907/3500 [31:46<20:46,  2.10s/it, lr: 1.0e-04 loss: 2.560e-01]
my_first_lora_v6:  83%|########3 | 2907/3500 [31:46<20:46,  2.10s/it, lr: 1.0e-04 loss: 2.560e-01]
my_first_lora_v6:  83%|########3 | 2908/3500 [31:47<20:43,  2.10s/it, lr: 1.0e-04 loss: 1.006e-01]
my_first_lora_v6:  83%|########3 | 2908/3500 [31:47<20:43,  2.10s/it, lr: 1.0e-04 loss: 1.006e-01]
my_first_lora_v6:  83%|########3 | 2909/3500 [31:49<20:41,  2.10s/it, lr: 1.0e-04 loss: 6.866e-02]
my_first_lora_v6:  83%|########3 | 2909/3500 [31:49<20:41,  2.10s/it, lr: 1.0e-04 loss: 6.866e-02]
my_first_lora_v6:  83%|########3 | 2910/3500 [31:51<20:39,  2.10s/it, lr: 1.0e-04 loss: 2.219e-01]
my_first_lora_v6:  83%|########3 | 2910/3500 [31:51<20:39,  2.10s/it, lr: 1.0e-04 loss: 2.219e-01]
my_first_lora_v6:  83%|########3 | 2911/3500 [31:54<20:37,  2.10s/it, lr: 1.0e-04 loss: 2.926e-01]
my_first_lora_v6:  83%|########3 | 2911/3500 [31:54<20:37,  2.10s/it, lr: 1.0e-04 loss: 2.926e-01]
my_first_lora_v6:  83%|########3 | 2912/3500 [31:56<20:35,  2.10s/it, lr: 1.0e-04 loss: 6.405e-01]
my_first_lora_v6:  83%|########3 | 2912/3500 [31:56<20:35,  2.10s/it, lr: 1.0e-04 loss: 6.405e-01]
my_first_lora_v6:  83%|########3 | 2913/3500 [31:58<20:33,  2.10s/it, lr: 1.0e-04 loss: 4.815e-02]
my_first_lora_v6:  83%|########3 | 2913/3500 [31:58<20:33,  2.10s/it, lr: 1.0e-04 loss: 4.815e-02]
my_first_lora_v6:  83%|########3 | 2914/3500 [32:01<20:31,  2.10s/it, lr: 1.0e-04 loss: 7.104e-01]
my_first_lora_v6:  83%|########3 | 2914/3500 [32:01<20:31,  2.10s/it, lr: 1.0e-04 loss: 7.104e-01]
my_first_lora_v6:  83%|########3 | 2915/3500 [32:03<20:30,  2.10s/it, lr: 1.0e-04 loss: 1.706e-01]
my_first_lora_v6:  83%|########3 | 2915/3500 [32:03<20:30,  2.10s/it, lr: 1.0e-04 loss: 1.706e-01]
my_first_lora_v6:  83%|########3 | 2916/3500 [32:05<20:27,  2.10s/it, lr: 1.0e-04 loss: 1.442e-01]
my_first_lora_v6:  83%|########3 | 2916/3500 [32:05<20:27,  2.10s/it, lr: 1.0e-04 loss: 1.442e-01]
my_first_lora_v6:  83%|########3 | 2917/3500 [32:08<20:26,  2.10s/it, lr: 1.0e-04 loss: 2.059e-01]
my_first_lora_v6:  83%|########3 | 2917/3500 [32:08<20:26,  2.10s/it, lr: 1.0e-04 loss: 2.059e-01]
my_first_lora_v6:  83%|########3 | 2918/3500 [32:10<20:24,  2.10s/it, lr: 1.0e-04 loss: 1.730e-01]
my_first_lora_v6:  83%|########3 | 2918/3500 [32:10<20:24,  2.10s/it, lr: 1.0e-04 loss: 1.730e-01]
my_first_lora_v6:  83%|########3 | 2919/3500 [32:11<20:21,  2.10s/it, lr: 1.0e-04 loss: 3.505e-01]
my_first_lora_v6:  83%|########3 | 2919/3500 [32:11<20:21,  2.10s/it, lr: 1.0e-04 loss: 3.505e-01]
my_first_lora_v6:  83%|########3 | 2920/3500 [32:14<20:19,  2.10s/it, lr: 1.0e-04 loss: 1.292e-01]
my_first_lora_v6:  83%|########3 | 2920/3500 [32:14<20:19,  2.10s/it, lr: 1.0e-04 loss: 1.292e-01]
my_first_lora_v6:  83%|########3 | 2921/3500 [32:16<20:17,  2.10s/it, lr: 1.0e-04 loss: 4.951e-02]
my_first_lora_v6:  83%|########3 | 2921/3500 [32:16<20:17,  2.10s/it, lr: 1.0e-04 loss: 4.951e-02]
my_first_lora_v6:  83%|########3 | 2922/3500 [32:17<20:14,  2.10s/it, lr: 1.0e-04 loss: 7.247e-01]
my_first_lora_v6:  83%|########3 | 2922/3500 [32:17<20:14,  2.10s/it, lr: 1.0e-04 loss: 7.247e-01]
my_first_lora_v6:  84%|########3 | 2923/3500 [32:19<20:12,  2.10s/it, lr: 1.0e-04 loss: 2.119e-01]
my_first_lora_v6:  84%|########3 | 2923/3500 [32:19<20:12,  2.10s/it, lr: 1.0e-04 loss: 2.119e-01]
my_first_lora_v6:  84%|########3 | 2924/3500 [32:22<20:10,  2.10s/it, lr: 1.0e-04 loss: 8.313e-01]
my_first_lora_v6:  84%|########3 | 2924/3500 [32:22<20:10,  2.10s/it, lr: 1.0e-04 loss: 8.313e-01]
my_first_lora_v6:  84%|########3 | 2925/3500 [32:24<20:08,  2.10s/it, lr: 1.0e-04 loss: 6.271e-01]
my_first_lora_v6:  84%|########3 | 2925/3500 [32:24<20:08,  2.10s/it, lr: 1.0e-04 loss: 6.271e-01]
my_first_lora_v6:  84%|########3 | 2926/3500 [32:27<20:07,  2.10s/it, lr: 1.0e-04 loss: 3.995e-01]
my_first_lora_v6:  84%|########3 | 2926/3500 [32:27<20:07,  2.10s/it, lr: 1.0e-04 loss: 3.995e-01]
my_first_lora_v6:  84%|########3 | 2927/3500 [32:30<20:05,  2.10s/it, lr: 1.0e-04 loss: 1.530e-01]
my_first_lora_v6:  84%|########3 | 2927/3500 [32:30<20:05,  2.10s/it, lr: 1.0e-04 loss: 1.530e-01]
my_first_lora_v6:  84%|########3 | 2928/3500 [32:32<20:03,  2.10s/it, lr: 1.0e-04 loss: 7.434e-01]
my_first_lora_v6:  84%|########3 | 2928/3500 [32:32<20:03,  2.10s/it, lr: 1.0e-04 loss: 7.434e-01]
my_first_lora_v6:  84%|########3 | 2929/3500 [32:33<20:00,  2.10s/it, lr: 1.0e-04 loss: 1.300e-01]
my_first_lora_v6:  84%|########3 | 2929/3500 [32:33<20:00,  2.10s/it, lr: 1.0e-04 loss: 1.300e-01]
my_first_lora_v6:  84%|########3 | 2930/3500 [32:34<19:57,  2.10s/it, lr: 1.0e-04 loss: 3.699e-01]
my_first_lora_v6:  84%|########3 | 2930/3500 [32:34<19:57,  2.10s/it, lr: 1.0e-04 loss: 3.699e-01]
my_first_lora_v6:  84%|########3 | 2931/3500 [32:36<19:55,  2.10s/it, lr: 1.0e-04 loss: 7.510e-01]
my_first_lora_v6:  84%|########3 | 2931/3500 [32:36<19:55,  2.10s/it, lr: 1.0e-04 loss: 7.510e-01]
my_first_lora_v6:  84%|########3 | 2932/3500 [32:39<19:54,  2.10s/it, lr: 1.0e-04 loss: 7.182e-01]
my_first_lora_v6:  84%|########3 | 2932/3500 [32:39<19:54,  2.10s/it, lr: 1.0e-04 loss: 7.182e-01]
my_first_lora_v6:  84%|########3 | 2933/3500 [32:41<19:52,  2.10s/it, lr: 1.0e-04 loss: 2.007e-01]
my_first_lora_v6:  84%|########3 | 2933/3500 [32:41<19:52,  2.10s/it, lr: 1.0e-04 loss: 2.007e-01]
my_first_lora_v6:  84%|########3 | 2934/3500 [32:43<19:50,  2.10s/it, lr: 1.0e-04 loss: 2.169e-01]
my_first_lora_v6:  84%|########3 | 2934/3500 [32:43<19:50,  2.10s/it, lr: 1.0e-04 loss: 2.169e-01]
my_first_lora_v6:  84%|########3 | 2935/3500 [32:46<19:48,  2.10s/it, lr: 1.0e-04 loss: 4.082e-01]
my_first_lora_v6:  84%|########3 | 2935/3500 [32:46<19:48,  2.10s/it, lr: 1.0e-04 loss: 4.082e-01]
my_first_lora_v6:  84%|########3 | 2936/3500 [32:49<19:46,  2.10s/it, lr: 1.0e-04 loss: 4.108e-01]
my_first_lora_v6:  84%|########3 | 2936/3500 [32:49<19:46,  2.10s/it, lr: 1.0e-04 loss: 4.108e-01]
my_first_lora_v6:  84%|########3 | 2937/3500 [32:50<19:43,  2.10s/it, lr: 1.0e-04 loss: 3.841e-01]
my_first_lora_v6:  84%|########3 | 2937/3500 [32:50<19:43,  2.10s/it, lr: 1.0e-04 loss: 3.841e-01]
my_first_lora_v6:  84%|########3 | 2938/3500 [32:52<19:42,  2.10s/it, lr: 1.0e-04 loss: 7.233e-01]
my_first_lora_v6:  84%|########3 | 2938/3500 [32:52<19:42,  2.10s/it, lr: 1.0e-04 loss: 7.233e-01]
my_first_lora_v6:  84%|########3 | 2939/3500 [32:54<19:39,  2.10s/it, lr: 1.0e-04 loss: 1.678e-01]
my_first_lora_v6:  84%|########3 | 2939/3500 [32:54<19:39,  2.10s/it, lr: 1.0e-04 loss: 1.678e-01]
my_first_lora_v6:  84%|########4 | 2940/3500 [32:57<19:38,  2.10s/it, lr: 1.0e-04 loss: 7.052e-01]
my_first_lora_v6:  84%|########4 | 2940/3500 [32:57<19:38,  2.10s/it, lr: 1.0e-04 loss: 7.052e-01]
my_first_lora_v6:  84%|########4 | 2941/3500 [32:59<19:36,  2.10s/it, lr: 1.0e-04 loss: 5.925e-01]
my_first_lora_v6:  84%|########4 | 2941/3500 [32:59<19:36,  2.10s/it, lr: 1.0e-04 loss: 5.925e-01]
my_first_lora_v6:  84%|########4 | 2942/3500 [33:01<19:34,  2.10s/it, lr: 1.0e-04 loss: 8.472e-02]
my_first_lora_v6:  84%|########4 | 2942/3500 [33:01<19:34,  2.10s/it, lr: 1.0e-04 loss: 8.472e-02]
my_first_lora_v6:  84%|########4 | 2943/3500 [33:02<19:31,  2.10s/it, lr: 1.0e-04 loss: 8.088e-01]
my_first_lora_v6:  84%|########4 | 2943/3500 [33:02<19:31,  2.10s/it, lr: 1.0e-04 loss: 8.088e-01]
my_first_lora_v6:  84%|########4 | 2944/3500 [33:05<19:29,  2.10s/it, lr: 1.0e-04 loss: 1.041e-01]
my_first_lora_v6:  84%|########4 | 2944/3500 [33:05<19:29,  2.10s/it, lr: 1.0e-04 loss: 1.041e-01]
my_first_lora_v6:  84%|########4 | 2945/3500 [33:07<19:26,  2.10s/it, lr: 1.0e-04 loss: 7.204e-01]
my_first_lora_v6:  84%|########4 | 2945/3500 [33:07<19:26,  2.10s/it, lr: 1.0e-04 loss: 7.204e-01]
my_first_lora_v6:  84%|########4 | 2946/3500 [33:09<19:25,  2.10s/it, lr: 1.0e-04 loss: 3.199e-01]
my_first_lora_v6:  84%|########4 | 2946/3500 [33:09<19:25,  2.10s/it, lr: 1.0e-04 loss: 3.199e-01]
my_first_lora_v6:  84%|########4 | 2947/3500 [33:10<19:22,  2.10s/it, lr: 1.0e-04 loss: 2.132e-02]
my_first_lora_v6:  84%|########4 | 2947/3500 [33:10<19:22,  2.10s/it, lr: 1.0e-04 loss: 2.132e-02]
my_first_lora_v6:  84%|########4 | 2948/3500 [33:13<19:20,  2.10s/it, lr: 1.0e-04 loss: 3.257e-01]
my_first_lora_v6:  84%|########4 | 2948/3500 [33:13<19:20,  2.10s/it, lr: 1.0e-04 loss: 3.257e-01]
my_first_lora_v6:  84%|########4 | 2949/3500 [33:15<19:18,  2.10s/it, lr: 1.0e-04 loss: 7.130e-01]
my_first_lora_v6:  84%|########4 | 2949/3500 [33:15<19:18,  2.10s/it, lr: 1.0e-04 loss: 7.130e-01]
my_first_lora_v6:  84%|########4 | 2950/3500 [33:18<19:16,  2.10s/it, lr: 1.0e-04 loss: 4.412e-01]
my_first_lora_v6:  84%|########4 | 2950/3500 [33:18<19:16,  2.10s/it, lr: 1.0e-04 loss: 4.412e-01]
my_first_lora_v6:  84%|########4 | 2951/3500 [33:20<19:14,  2.10s/it, lr: 1.0e-04 loss: 2.877e-01]
my_first_lora_v6:  84%|########4 | 2951/3500 [33:20<19:14,  2.10s/it, lr: 1.0e-04 loss: 2.877e-01]
my_first_lora_v6:  84%|########4 | 2952/3500 [33:22<19:12,  2.10s/it, lr: 1.0e-04 loss: 3.609e-01]
my_first_lora_v6:  84%|########4 | 2952/3500 [33:22<19:12,  2.10s/it, lr: 1.0e-04 loss: 3.609e-01]
my_first_lora_v6:  84%|########4 | 2953/3500 [33:23<19:09,  2.10s/it, lr: 1.0e-04 loss: 1.621e-01]
my_first_lora_v6:  84%|########4 | 2953/3500 [33:23<19:09,  2.10s/it, lr: 1.0e-04 loss: 1.621e-01]
my_first_lora_v6:  84%|########4 | 2954/3500 [33:25<19:08,  2.10s/it, lr: 1.0e-04 loss: 5.936e-01]
my_first_lora_v6:  84%|########4 | 2954/3500 [33:25<19:08,  2.10s/it, lr: 1.0e-04 loss: 5.936e-01]
my_first_lora_v6:  84%|########4 | 2955/3500 [33:28<19:06,  2.10s/it, lr: 1.0e-04 loss: 7.878e-01]
my_first_lora_v6:  84%|########4 | 2955/3500 [33:28<19:06,  2.10s/it, lr: 1.0e-04 loss: 7.878e-01]
my_first_lora_v6:  84%|########4 | 2956/3500 [33:30<19:04,  2.10s/it, lr: 1.0e-04 loss: 4.376e-01]
my_first_lora_v6:  84%|########4 | 2956/3500 [33:30<19:04,  2.10s/it, lr: 1.0e-04 loss: 4.376e-01]
my_first_lora_v6:  84%|########4 | 2957/3500 [33:33<19:02,  2.10s/it, lr: 1.0e-04 loss: 3.551e-01]
my_first_lora_v6:  84%|########4 | 2957/3500 [33:33<19:02,  2.10s/it, lr: 1.0e-04 loss: 3.551e-01]
my_first_lora_v6:  85%|########4 | 2958/3500 [33:36<19:00,  2.10s/it, lr: 1.0e-04 loss: 4.209e-01]
my_first_lora_v6:  85%|########4 | 2958/3500 [33:36<19:00,  2.10s/it, lr: 1.0e-04 loss: 4.209e-01]
my_first_lora_v6:  85%|########4 | 2959/3500 [33:37<18:58,  2.10s/it, lr: 1.0e-04 loss: 1.709e-01]
my_first_lora_v6:  85%|########4 | 2959/3500 [33:37<18:58,  2.10s/it, lr: 1.0e-04 loss: 1.709e-01]
my_first_lora_v6:  85%|########4 | 2960/3500 [33:39<18:56,  2.10s/it, lr: 1.0e-04 loss: 4.954e-01]
my_first_lora_v6:  85%|########4 | 2960/3500 [33:39<18:56,  2.10s/it, lr: 1.0e-04 loss: 4.954e-01]
my_first_lora_v6:  85%|########4 | 2961/3500 [33:40<18:53,  2.10s/it, lr: 1.0e-04 loss: 2.699e-01]
my_first_lora_v6:  85%|########4 | 2961/3500 [33:40<18:53,  2.10s/it, lr: 1.0e-04 loss: 2.699e-01]
my_first_lora_v6:  85%|########4 | 2962/3500 [33:43<18:51,  2.10s/it, lr: 1.0e-04 loss: 4.447e-01]
my_first_lora_v6:  85%|########4 | 2962/3500 [33:43<18:51,  2.10s/it, lr: 1.0e-04 loss: 4.447e-01]
my_first_lora_v6:  85%|########4 | 2963/3500 [33:46<18:49,  2.10s/it, lr: 1.0e-04 loss: 2.287e-01]
my_first_lora_v6:  85%|########4 | 2963/3500 [33:46<18:49,  2.10s/it, lr: 1.0e-04 loss: 2.287e-01]
my_first_lora_v6:  85%|########4 | 2964/3500 [33:48<18:47,  2.10s/it, lr: 1.0e-04 loss: 4.900e-02]
my_first_lora_v6:  85%|########4 | 2964/3500 [33:48<18:47,  2.10s/it, lr: 1.0e-04 loss: 4.900e-02]
my_first_lora_v6:  85%|########4 | 2965/3500 [33:50<18:45,  2.10s/it, lr: 1.0e-04 loss: 7.770e-01]
my_first_lora_v6:  85%|########4 | 2965/3500 [33:50<18:45,  2.10s/it, lr: 1.0e-04 loss: 7.770e-01]
my_first_lora_v6:  85%|########4 | 2966/3500 [33:53<18:43,  2.10s/it, lr: 1.0e-04 loss: 2.212e-01]
my_first_lora_v6:  85%|########4 | 2966/3500 [33:53<18:43,  2.10s/it, lr: 1.0e-04 loss: 2.212e-01]
my_first_lora_v6:  85%|########4 | 2967/3500 [33:54<18:41,  2.10s/it, lr: 1.0e-04 loss: 7.903e-01]
my_first_lora_v6:  85%|########4 | 2967/3500 [33:54<18:41,  2.10s/it, lr: 1.0e-04 loss: 7.903e-01]
my_first_lora_v6:  85%|########4 | 2968/3500 [33:55<18:38,  2.10s/it, lr: 1.0e-04 loss: 6.922e-01]
my_first_lora_v6:  85%|########4 | 2968/3500 [33:55<18:38,  2.10s/it, lr: 1.0e-04 loss: 6.922e-01]
my_first_lora_v6:  85%|########4 | 2969/3500 [33:57<18:36,  2.10s/it, lr: 1.0e-04 loss: 5.739e-01]
my_first_lora_v6:  85%|########4 | 2969/3500 [33:57<18:36,  2.10s/it, lr: 1.0e-04 loss: 5.739e-01]
my_first_lora_v6:  85%|########4 | 2970/3500 [33:59<18:34,  2.10s/it, lr: 1.0e-04 loss: 1.846e-01]
my_first_lora_v6:  85%|########4 | 2970/3500 [33:59<18:34,  2.10s/it, lr: 1.0e-04 loss: 1.846e-01]
my_first_lora_v6:  85%|########4 | 2971/3500 [34:02<18:32,  2.10s/it, lr: 1.0e-04 loss: 4.637e-01]
my_first_lora_v6:  85%|########4 | 2971/3500 [34:02<18:32,  2.10s/it, lr: 1.0e-04 loss: 4.637e-01]
my_first_lora_v6:  85%|########4 | 2972/3500 [34:04<18:30,  2.10s/it, lr: 1.0e-04 loss: 7.070e-01]
my_first_lora_v6:  85%|########4 | 2972/3500 [34:04<18:30,  2.10s/it, lr: 1.0e-04 loss: 7.070e-01]
my_first_lora_v6:  85%|########4 | 2973/3500 [34:07<18:28,  2.10s/it, lr: 1.0e-04 loss: 7.451e-01]
my_first_lora_v6:  85%|########4 | 2973/3500 [34:07<18:28,  2.10s/it, lr: 1.0e-04 loss: 7.451e-01]
my_first_lora_v6:  85%|########4 | 2974/3500 [34:08<18:26,  2.10s/it, lr: 1.0e-04 loss: 8.247e-02]
my_first_lora_v6:  85%|########4 | 2974/3500 [34:08<18:26,  2.10s/it, lr: 1.0e-04 loss: 8.247e-02]
my_first_lora_v6:  85%|########5 | 2975/3500 [34:10<18:24,  2.10s/it, lr: 1.0e-04 loss: 3.848e-01]
my_first_lora_v6:  85%|########5 | 2975/3500 [34:10<18:24,  2.10s/it, lr: 1.0e-04 loss: 3.848e-01]
my_first_lora_v6:  85%|########5 | 2976/3500 [34:12<18:21,  2.10s/it, lr: 1.0e-04 loss: 7.359e-01]
my_first_lora_v6:  85%|########5 | 2976/3500 [34:12<18:21,  2.10s/it, lr: 1.0e-04 loss: 7.359e-01]
my_first_lora_v6:  85%|########5 | 2977/3500 [34:14<18:19,  2.10s/it, lr: 1.0e-04 loss: 6.569e-01]
my_first_lora_v6:  85%|########5 | 2977/3500 [34:14<18:19,  2.10s/it, lr: 1.0e-04 loss: 6.569e-01]
my_first_lora_v6:  85%|########5 | 2978/3500 [34:17<18:18,  2.10s/it, lr: 1.0e-04 loss: 6.467e-01]
my_first_lora_v6:  85%|########5 | 2978/3500 [34:17<18:18,  2.10s/it, lr: 1.0e-04 loss: 6.467e-01]
my_first_lora_v6:  85%|########5 | 2979/3500 [34:18<18:15,  2.10s/it, lr: 1.0e-04 loss: 4.500e-01]
my_first_lora_v6:  85%|########5 | 2979/3500 [34:18<18:15,  2.10s/it, lr: 1.0e-04 loss: 4.500e-01]
my_first_lora_v6:  85%|########5 | 2980/3500 [34:19<18:12,  2.10s/it, lr: 1.0e-04 loss: 3.151e-01]
my_first_lora_v6:  85%|########5 | 2980/3500 [34:19<18:12,  2.10s/it, lr: 1.0e-04 loss: 3.151e-01]
my_first_lora_v6:  85%|########5 | 2981/3500 [34:21<18:10,  2.10s/it, lr: 1.0e-04 loss: 9.529e-02]
my_first_lora_v6:  85%|########5 | 2981/3500 [34:21<18:10,  2.10s/it, lr: 1.0e-04 loss: 9.529e-02]
my_first_lora_v6:  85%|########5 | 2982/3500 [34:23<18:08,  2.10s/it, lr: 1.0e-04 loss: 7.951e-02]
my_first_lora_v6:  85%|########5 | 2982/3500 [34:23<18:08,  2.10s/it, lr: 1.0e-04 loss: 7.951e-02]
my_first_lora_v6:  85%|########5 | 2983/3500 [34:25<18:06,  2.10s/it, lr: 1.0e-04 loss: 8.774e-02]
my_first_lora_v6:  85%|########5 | 2983/3500 [34:25<18:06,  2.10s/it, lr: 1.0e-04 loss: 8.774e-02]
my_first_lora_v6:  85%|########5 | 2984/3500 [34:28<18:04,  2.10s/it, lr: 1.0e-04 loss: 2.803e-01]
my_first_lora_v6:  85%|########5 | 2984/3500 [34:28<18:04,  2.10s/it, lr: 1.0e-04 loss: 2.803e-01]
my_first_lora_v6:  85%|########5 | 2985/3500 [34:30<18:02,  2.10s/it, lr: 1.0e-04 loss: 4.314e-02]
my_first_lora_v6:  85%|########5 | 2985/3500 [34:30<18:02,  2.10s/it, lr: 1.0e-04 loss: 4.314e-02]
my_first_lora_v6:  85%|########5 | 2986/3500 [34:33<18:00,  2.10s/it, lr: 1.0e-04 loss: 8.275e-01]
my_first_lora_v6:  85%|########5 | 2986/3500 [34:33<18:00,  2.10s/it, lr: 1.0e-04 loss: 8.275e-01]
my_first_lora_v6:  85%|########5 | 2987/3500 [34:35<17:58,  2.10s/it, lr: 1.0e-04 loss: 2.831e-01]
my_first_lora_v6:  85%|########5 | 2987/3500 [34:35<17:58,  2.10s/it, lr: 1.0e-04 loss: 2.831e-01]
my_first_lora_v6:  85%|########5 | 2988/3500 [34:37<17:56,  2.10s/it, lr: 1.0e-04 loss: 4.152e-01]
my_first_lora_v6:  85%|########5 | 2988/3500 [34:37<17:56,  2.10s/it, lr: 1.0e-04 loss: 4.152e-01]
my_first_lora_v6:  85%|########5 | 2989/3500 [34:38<17:54,  2.10s/it, lr: 1.0e-04 loss: 2.331e-01]
my_first_lora_v6:  85%|########5 | 2989/3500 [34:38<17:54,  2.10s/it, lr: 1.0e-04 loss: 2.331e-01]
my_first_lora_v6:  85%|########5 | 2990/3500 [34:41<17:52,  2.10s/it, lr: 1.0e-04 loss: 3.506e-01]
my_first_lora_v6:  85%|########5 | 2990/3500 [34:41<17:52,  2.10s/it, lr: 1.0e-04 loss: 3.506e-01]
my_first_lora_v6:  85%|########5 | 2991/3500 [34:43<17:50,  2.10s/it, lr: 1.0e-04 loss: 2.446e-01]
my_first_lora_v6:  85%|########5 | 2991/3500 [34:43<17:50,  2.10s/it, lr: 1.0e-04 loss: 2.446e-01]
my_first_lora_v6:  85%|########5 | 2992/3500 [34:45<17:48,  2.10s/it, lr: 1.0e-04 loss: 7.750e-01]
my_first_lora_v6:  85%|########5 | 2992/3500 [34:45<17:48,  2.10s/it, lr: 1.0e-04 loss: 7.750e-01]
my_first_lora_v6:  86%|########5 | 2993/3500 [34:48<17:46,  2.10s/it, lr: 1.0e-04 loss: 2.051e-01]
my_first_lora_v6:  86%|########5 | 2993/3500 [34:48<17:46,  2.10s/it, lr: 1.0e-04 loss: 2.051e-01]
my_first_lora_v6:  86%|########5 | 2994/3500 [34:50<17:44,  2.10s/it, lr: 1.0e-04 loss: 3.503e-02]
my_first_lora_v6:  86%|########5 | 2994/3500 [34:50<17:44,  2.10s/it, lr: 1.0e-04 loss: 3.503e-02]
my_first_lora_v6:  86%|########5 | 2995/3500 [34:51<17:41,  2.10s/it, lr: 1.0e-04 loss: 7.893e-01]
my_first_lora_v6:  86%|########5 | 2995/3500 [34:51<17:41,  2.10s/it, lr: 1.0e-04 loss: 7.893e-01]
my_first_lora_v6:  86%|########5 | 2996/3500 [34:54<17:39,  2.10s/it, lr: 1.0e-04 loss: 3.755e-01]
my_first_lora_v6:  86%|########5 | 2996/3500 [34:54<17:39,  2.10s/it, lr: 1.0e-04 loss: 3.755e-01]
my_first_lora_v6:  86%|########5 | 2997/3500 [34:56<17:37,  2.10s/it, lr: 1.0e-04 loss: 2.644e-01]
my_first_lora_v6:  86%|########5 | 2997/3500 [34:56<17:37,  2.10s/it, lr: 1.0e-04 loss: 2.644e-01]
my_first_lora_v6:  86%|########5 | 2998/3500 [34:58<17:35,  2.10s/it, lr: 1.0e-04 loss: 8.012e-01]
my_first_lora_v6:  86%|########5 | 2998/3500 [34:58<17:35,  2.10s/it, lr: 1.0e-04 loss: 8.012e-01]
my_first_lora_v6:  86%|########5 | 2999/3500 [35:00<17:33,  2.10s/it, lr: 1.0e-04 loss: 2.600e-01]
my_first_lora_v6:  86%|########5 | 2999/3500 [35:00<17:33,  2.10s/it, lr: 1.0e-04 loss: 2.600e-01]
Saving at step 3000
Saved checkpoint to /teamspace/studios/this_studio/ai-toolkit/output/my_first_lora_v6/my_first_lora_v6_000003000.safetensors
Saved optimizer to /teamspace/studios/this_studio/ai-toolkit/output/my_first_lora_v6/optimizer.pt
Unloading assistant lora



Generating Images:   0%|          | 0/5 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/5 [00:00<?, ?it/s]


Generating Images:  20%|##        | 1/5 [00:07<00:31,  7.97s/it]
Generating Images:  20%|##        | 1/5 [00:07<00:31,  7.97s/it]


Generating Images:  40%|####      | 2/5 [00:15<00:23,  7.89s/it]
Generating Images:  40%|####      | 2/5 [00:15<00:23,  7.89s/it]


Generating Images:  60%|######    | 3/5 [00:23<00:15,  7.78s/it]
Generating Images:  60%|######    | 3/5 [00:23<00:15,  7.78s/it]


Generating Images:  80%|########  | 4/5 [00:31<00:07,  7.80s/it]
Generating Images:  80%|########  | 4/5 [00:31<00:07,  7.80s/it]


Generating Images: 100%|##########| 5/5 [00:39<00:00,  7.83s/it]
Generating Images: 100%|##########| 5/5 [00:39<00:00,  7.83s/it]


                                                                
                                                                Loading assistant lora

my_first_lora_v6:  86%|########5 | 3000/3500 [35:01<17:30,  2.10s/it, lr: 1.0e-04 loss: 1.392e-02]
my_first_lora_v6:  86%|########5 | 3000/3500 [35:01<17:30,  2.10s/it, lr: 1.0e-04 loss: 1.392e-02]
my_first_lora_v6:  86%|########5 | 3001/3500 [35:03<17:28,  2.10s/it, lr: 1.0e-04 loss: 3.873e-01]
my_first_lora_v6:  86%|########5 | 3001/3500 [35:03<17:28,  2.10s/it, lr: 1.0e-04 loss: 3.873e-01]
my_first_lora_v6:  86%|########5 | 3002/3500 [35:06<17:26,  2.10s/it, lr: 1.0e-04 loss: 9.982e-02]
my_first_lora_v6:  86%|########5 | 3002/3500 [35:06<17:26,  2.10s/it, lr: 1.0e-04 loss: 9.982e-02]
my_first_lora_v6:  86%|########5 | 3003/3500 [35:08<17:24,  2.10s/it, lr: 1.0e-04 loss: 1.732e-01]
my_first_lora_v6:  86%|########5 | 3003/3500 [35:08<17:24,  2.10s/it, lr: 1.0e-04 loss: 1.732e-01]
my_first_lora_v6:  86%|########5 | 3004/3500 [35:10<17:22,  2.10s/it, lr: 1.0e-04 loss: 1.809e-01]
my_first_lora_v6:  86%|########5 | 3004/3500 [35:10<17:22,  2.10s/it, lr: 1.0e-04 loss: 1.809e-01]
my_first_lora_v6:  86%|########5 | 3005/3500 [35:13<17:20,  2.10s/it, lr: 1.0e-04 loss: 2.091e-01]
my_first_lora_v6:  86%|########5 | 3005/3500 [35:13<17:20,  2.10s/it, lr: 1.0e-04 loss: 2.091e-01]
my_first_lora_v6:  86%|########5 | 3006/3500 [35:15<17:19,  2.10s/it, lr: 1.0e-04 loss: 5.596e-02]
my_first_lora_v6:  86%|########5 | 3006/3500 [35:15<17:19,  2.10s/it, lr: 1.0e-04 loss: 5.596e-02]
my_first_lora_v6:  86%|########5 | 3007/3500 [35:18<17:17,  2.10s/it, lr: 1.0e-04 loss: 6.022e-02]
my_first_lora_v6:  86%|########5 | 3007/3500 [35:18<17:17,  2.10s/it, lr: 1.0e-04 loss: 6.022e-02]
my_first_lora_v6:  86%|########5 | 3008/3500 [35:21<17:15,  2.10s/it, lr: 1.0e-04 loss: 7.178e-01]
my_first_lora_v6:  86%|########5 | 3008/3500 [35:21<17:15,  2.10s/it, lr: 1.0e-04 loss: 7.178e-01]
my_first_lora_v6:  86%|########5 | 3009/3500 [35:24<17:13,  2.11s/it, lr: 1.0e-04 loss: 4.893e-01]
my_first_lora_v6:  86%|########5 | 3009/3500 [35:24<17:13,  2.11s/it, lr: 1.0e-04 loss: 4.893e-01]
my_first_lora_v6:  86%|########6 | 3010/3500 [35:26<17:11,  2.11s/it, lr: 1.0e-04 loss: 6.083e-01]
my_first_lora_v6:  86%|########6 | 3010/3500 [35:26<17:11,  2.11s/it, lr: 1.0e-04 loss: 6.083e-01]
my_first_lora_v6:  86%|########6 | 3011/3500 [35:27<17:08,  2.10s/it, lr: 1.0e-04 loss: 2.875e-01]
my_first_lora_v6:  86%|########6 | 3011/3500 [35:27<17:08,  2.10s/it, lr: 1.0e-04 loss: 2.875e-01]
my_first_lora_v6:  86%|########6 | 3012/3500 [35:28<17:06,  2.10s/it, lr: 1.0e-04 loss: 3.155e-01]
my_first_lora_v6:  86%|########6 | 3012/3500 [35:28<17:06,  2.10s/it, lr: 1.0e-04 loss: 3.155e-01]
my_first_lora_v6:  86%|########6 | 3013/3500 [35:31<17:04,  2.10s/it, lr: 1.0e-04 loss: 4.784e-01]
my_first_lora_v6:  86%|########6 | 3013/3500 [35:31<17:04,  2.10s/it, lr: 1.0e-04 loss: 4.784e-01]
my_first_lora_v6:  86%|########6 | 3014/3500 [35:32<17:02,  2.10s/it, lr: 1.0e-04 loss: 8.073e-01]
my_first_lora_v6:  86%|########6 | 3014/3500 [35:32<17:02,  2.10s/it, lr: 1.0e-04 loss: 8.073e-01]
my_first_lora_v6:  86%|########6 | 3015/3500 [35:35<17:00,  2.10s/it, lr: 1.0e-04 loss: 1.850e-01]
my_first_lora_v6:  86%|########6 | 3015/3500 [35:35<17:00,  2.10s/it, lr: 1.0e-04 loss: 1.850e-01]
my_first_lora_v6:  86%|########6 | 3016/3500 [35:38<16:58,  2.10s/it, lr: 1.0e-04 loss: 9.630e-02]
my_first_lora_v6:  86%|########6 | 3016/3500 [35:38<16:58,  2.10s/it, lr: 1.0e-04 loss: 9.630e-02]
my_first_lora_v6:  86%|########6 | 3017/3500 [35:40<16:56,  2.10s/it, lr: 1.0e-04 loss: 7.964e-01]
my_first_lora_v6:  86%|########6 | 3017/3500 [35:40<16:56,  2.10s/it, lr: 1.0e-04 loss: 7.964e-01]
my_first_lora_v6:  86%|########6 | 3018/3500 [35:42<16:54,  2.10s/it, lr: 1.0e-04 loss: 7.482e-01]
my_first_lora_v6:  86%|########6 | 3018/3500 [35:42<16:54,  2.10s/it, lr: 1.0e-04 loss: 7.482e-01]
my_first_lora_v6:  86%|########6 | 3019/3500 [35:45<16:52,  2.11s/it, lr: 1.0e-04 loss: 1.683e-01]
my_first_lora_v6:  86%|########6 | 3019/3500 [35:45<16:52,  2.11s/it, lr: 1.0e-04 loss: 1.683e-01]
my_first_lora_v6:  86%|########6 | 3020/3500 [35:47<16:50,  2.11s/it, lr: 1.0e-04 loss: 5.132e-02]
my_first_lora_v6:  86%|########6 | 3020/3500 [35:47<16:50,  2.11s/it, lr: 1.0e-04 loss: 5.132e-02]
my_first_lora_v6:  86%|########6 | 3021/3500 [35:48<16:48,  2.10s/it, lr: 1.0e-04 loss: 4.361e-01]
my_first_lora_v6:  86%|########6 | 3021/3500 [35:48<16:48,  2.10s/it, lr: 1.0e-04 loss: 4.361e-01]
my_first_lora_v6:  86%|########6 | 3022/3500 [35:49<16:45,  2.10s/it, lr: 1.0e-04 loss: 7.973e-01]
my_first_lora_v6:  86%|########6 | 3022/3500 [35:49<16:45,  2.10s/it, lr: 1.0e-04 loss: 7.973e-01]
my_first_lora_v6:  86%|########6 | 3023/3500 [35:52<16:43,  2.10s/it, lr: 1.0e-04 loss: 5.312e-01]
my_first_lora_v6:  86%|########6 | 3023/3500 [35:52<16:43,  2.10s/it, lr: 1.0e-04 loss: 5.312e-01]
my_first_lora_v6:  86%|########6 | 3024/3500 [35:54<16:41,  2.10s/it, lr: 1.0e-04 loss: 3.860e-01]
my_first_lora_v6:  86%|########6 | 3024/3500 [35:54<16:41,  2.10s/it, lr: 1.0e-04 loss: 3.860e-01]
my_first_lora_v6:  86%|########6 | 3025/3500 [35:56<16:39,  2.10s/it, lr: 1.0e-04 loss: 9.572e-02]
my_first_lora_v6:  86%|########6 | 3025/3500 [35:56<16:39,  2.10s/it, lr: 1.0e-04 loss: 9.572e-02]
my_first_lora_v6:  86%|########6 | 3026/3500 [35:58<16:37,  2.10s/it, lr: 1.0e-04 loss: 7.217e-02]
my_first_lora_v6:  86%|########6 | 3026/3500 [35:58<16:37,  2.10s/it, lr: 1.0e-04 loss: 7.217e-02]
my_first_lora_v6:  86%|########6 | 3027/3500 [36:00<16:35,  2.10s/it, lr: 1.0e-04 loss: 7.936e-01]
my_first_lora_v6:  86%|########6 | 3027/3500 [36:00<16:35,  2.10s/it, lr: 1.0e-04 loss: 7.936e-01]
my_first_lora_v6:  87%|########6 | 3028/3500 [36:03<16:33,  2.10s/it, lr: 1.0e-04 loss: 1.123e-01]
my_first_lora_v6:  87%|########6 | 3028/3500 [36:03<16:33,  2.10s/it, lr: 1.0e-04 loss: 1.123e-01]
my_first_lora_v6:  87%|########6 | 3029/3500 [36:04<16:30,  2.10s/it, lr: 1.0e-04 loss: 1.459e-01]
my_first_lora_v6:  87%|########6 | 3029/3500 [36:04<16:30,  2.10s/it, lr: 1.0e-04 loss: 1.459e-01]
my_first_lora_v6:  87%|########6 | 3030/3500 [36:07<16:28,  2.10s/it, lr: 1.0e-04 loss: 7.429e-02]
my_first_lora_v6:  87%|########6 | 3030/3500 [36:07<16:28,  2.10s/it, lr: 1.0e-04 loss: 7.429e-02]
my_first_lora_v6:  87%|########6 | 3031/3500 [36:09<16:27,  2.10s/it, lr: 1.0e-04 loss: 2.159e-01]
my_first_lora_v6:  87%|########6 | 3031/3500 [36:09<16:27,  2.10s/it, lr: 1.0e-04 loss: 2.159e-01]
my_first_lora_v6:  87%|########6 | 3032/3500 [36:10<16:24,  2.10s/it, lr: 1.0e-04 loss: 7.293e-01]
my_first_lora_v6:  87%|########6 | 3032/3500 [36:10<16:24,  2.10s/it, lr: 1.0e-04 loss: 7.293e-01]
my_first_lora_v6:  87%|########6 | 3033/3500 [36:13<16:22,  2.10s/it, lr: 1.0e-04 loss: 5.784e-01]
my_first_lora_v6:  87%|########6 | 3033/3500 [36:13<16:22,  2.10s/it, lr: 1.0e-04 loss: 5.784e-01]
my_first_lora_v6:  87%|########6 | 3034/3500 [36:15<16:20,  2.10s/it, lr: 1.0e-04 loss: 5.260e-01]
my_first_lora_v6:  87%|########6 | 3034/3500 [36:15<16:20,  2.10s/it, lr: 1.0e-04 loss: 5.260e-01]
my_first_lora_v6:  87%|########6 | 3035/3500 [36:17<16:18,  2.10s/it, lr: 1.0e-04 loss: 3.749e-01]
my_first_lora_v6:  87%|########6 | 3035/3500 [36:17<16:18,  2.10s/it, lr: 1.0e-04 loss: 3.749e-01]
my_first_lora_v6:  87%|########6 | 3036/3500 [36:20<16:16,  2.10s/it, lr: 1.0e-04 loss: 7.095e-01]
my_first_lora_v6:  87%|########6 | 3036/3500 [36:20<16:16,  2.10s/it, lr: 1.0e-04 loss: 7.095e-01]
my_first_lora_v6:  87%|########6 | 3037/3500 [36:21<16:13,  2.10s/it, lr: 1.0e-04 loss: 7.517e-01]
my_first_lora_v6:  87%|########6 | 3037/3500 [36:21<16:13,  2.10s/it, lr: 1.0e-04 loss: 7.517e-01]
my_first_lora_v6:  87%|########6 | 3038/3500 [36:24<16:12,  2.10s/it, lr: 1.0e-04 loss: 8.389e-02]
my_first_lora_v6:  87%|########6 | 3038/3500 [36:24<16:12,  2.10s/it, lr: 1.0e-04 loss: 8.389e-02]
my_first_lora_v6:  87%|########6 | 3039/3500 [36:25<16:09,  2.10s/it, lr: 1.0e-04 loss: 7.959e-01]
my_first_lora_v6:  87%|########6 | 3039/3500 [36:25<16:09,  2.10s/it, lr: 1.0e-04 loss: 7.959e-01]
my_first_lora_v6:  87%|########6 | 3040/3500 [36:27<16:07,  2.10s/it, lr: 1.0e-04 loss: 3.549e-01]
my_first_lora_v6:  87%|########6 | 3040/3500 [36:27<16:07,  2.10s/it, lr: 1.0e-04 loss: 3.549e-01]
my_first_lora_v6:  87%|########6 | 3041/3500 [36:29<16:05,  2.10s/it, lr: 1.0e-04 loss: 1.839e-01]
my_first_lora_v6:  87%|########6 | 3041/3500 [36:29<16:05,  2.10s/it, lr: 1.0e-04 loss: 1.839e-01]
my_first_lora_v6:  87%|########6 | 3042/3500 [36:32<16:03,  2.10s/it, lr: 1.0e-04 loss: 8.236e-01]
my_first_lora_v6:  87%|########6 | 3042/3500 [36:32<16:03,  2.10s/it, lr: 1.0e-04 loss: 8.236e-01]
my_first_lora_v6:  87%|########6 | 3043/3500 [36:35<16:01,  2.10s/it, lr: 1.0e-04 loss: 4.925e-01]
my_first_lora_v6:  87%|########6 | 3043/3500 [36:35<16:01,  2.10s/it, lr: 1.0e-04 loss: 4.925e-01]
my_first_lora_v6:  87%|########6 | 3044/3500 [36:37<15:59,  2.11s/it, lr: 1.0e-04 loss: 6.685e-01]
my_first_lora_v6:  87%|########6 | 3044/3500 [36:37<15:59,  2.11s/it, lr: 1.0e-04 loss: 6.685e-01]
my_first_lora_v6:  87%|########7 | 3045/3500 [36:40<15:58,  2.11s/it, lr: 1.0e-04 loss: 7.074e-01]
my_first_lora_v6:  87%|########7 | 3045/3500 [36:40<15:58,  2.11s/it, lr: 1.0e-04 loss: 7.074e-01]
my_first_lora_v6:  87%|########7 | 3046/3500 [36:42<15:55,  2.11s/it, lr: 1.0e-04 loss: 4.561e-01]
my_first_lora_v6:  87%|########7 | 3046/3500 [36:42<15:55,  2.11s/it, lr: 1.0e-04 loss: 4.561e-01]
my_first_lora_v6:  87%|########7 | 3047/3500 [36:44<15:53,  2.11s/it, lr: 1.0e-04 loss: 3.880e-02]
my_first_lora_v6:  87%|########7 | 3047/3500 [36:44<15:53,  2.11s/it, lr: 1.0e-04 loss: 3.880e-02]
my_first_lora_v6:  87%|########7 | 3048/3500 [36:46<15:51,  2.11s/it, lr: 1.0e-04 loss: 3.415e-01]
my_first_lora_v6:  87%|########7 | 3048/3500 [36:46<15:51,  2.11s/it, lr: 1.0e-04 loss: 3.415e-01]
my_first_lora_v6:  87%|########7 | 3049/3500 [36:49<15:49,  2.11s/it, lr: 1.0e-04 loss: 4.225e-01]
my_first_lora_v6:  87%|########7 | 3049/3500 [36:49<15:49,  2.11s/it, lr: 1.0e-04 loss: 4.225e-01]
my_first_lora_v6:  87%|########7 | 3050/3500 [36:50<15:47,  2.10s/it, lr: 1.0e-04 loss: 3.358e-01]
my_first_lora_v6:  87%|########7 | 3050/3500 [36:50<15:47,  2.10s/it, lr: 1.0e-04 loss: 3.358e-01]
my_first_lora_v6:  87%|########7 | 3051/3500 [36:51<15:44,  2.10s/it, lr: 1.0e-04 loss: 2.979e-01]
my_first_lora_v6:  87%|########7 | 3051/3500 [36:51<15:44,  2.10s/it, lr: 1.0e-04 loss: 2.979e-01]
my_first_lora_v6:  87%|########7 | 3052/3500 [36:53<15:42,  2.10s/it, lr: 1.0e-04 loss: 7.070e-01]
my_first_lora_v6:  87%|########7 | 3052/3500 [36:53<15:42,  2.10s/it, lr: 1.0e-04 loss: 7.070e-01]
my_first_lora_v6:  87%|########7 | 3053/3500 [36:56<15:40,  2.10s/it, lr: 1.0e-04 loss: 6.861e-01]
my_first_lora_v6:  87%|########7 | 3053/3500 [36:56<15:40,  2.10s/it, lr: 1.0e-04 loss: 6.861e-01]
my_first_lora_v6:  87%|########7 | 3054/3500 [36:58<15:38,  2.10s/it, lr: 1.0e-04 loss: 5.017e-01]
my_first_lora_v6:  87%|########7 | 3054/3500 [36:58<15:38,  2.10s/it, lr: 1.0e-04 loss: 5.017e-01]
my_first_lora_v6:  87%|########7 | 3055/3500 [37:00<15:36,  2.10s/it, lr: 1.0e-04 loss: 7.968e-01]
my_first_lora_v6:  87%|########7 | 3055/3500 [37:00<15:36,  2.10s/it, lr: 1.0e-04 loss: 7.968e-01]
my_first_lora_v6:  87%|########7 | 3056/3500 [37:01<15:33,  2.10s/it, lr: 1.0e-04 loss: 7.816e-01]
my_first_lora_v6:  87%|########7 | 3056/3500 [37:01<15:33,  2.10s/it, lr: 1.0e-04 loss: 7.816e-01]
my_first_lora_v6:  87%|########7 | 3057/3500 [37:04<15:32,  2.10s/it, lr: 1.0e-04 loss: 8.637e-02]
my_first_lora_v6:  87%|########7 | 3057/3500 [37:04<15:32,  2.10s/it, lr: 1.0e-04 loss: 8.637e-02]
my_first_lora_v6:  87%|########7 | 3058/3500 [37:06<15:30,  2.10s/it, lr: 1.0e-04 loss: 1.647e-01]
my_first_lora_v6:  87%|########7 | 3058/3500 [37:06<15:30,  2.10s/it, lr: 1.0e-04 loss: 1.647e-01]
my_first_lora_v6:  87%|########7 | 3059/3500 [37:09<15:28,  2.11s/it, lr: 1.0e-04 loss: 3.468e-01]
my_first_lora_v6:  87%|########7 | 3059/3500 [37:09<15:28,  2.11s/it, lr: 1.0e-04 loss: 3.468e-01]
my_first_lora_v6:  87%|########7 | 3060/3500 [37:10<15:25,  2.10s/it, lr: 1.0e-04 loss: 1.494e-01]
my_first_lora_v6:  87%|########7 | 3060/3500 [37:10<15:25,  2.10s/it, lr: 1.0e-04 loss: 1.494e-01]
my_first_lora_v6:  87%|########7 | 3061/3500 [37:11<15:23,  2.10s/it, lr: 1.0e-04 loss: 7.500e-01]
my_first_lora_v6:  87%|########7 | 3061/3500 [37:11<15:23,  2.10s/it, lr: 1.0e-04 loss: 7.500e-01]
my_first_lora_v6:  87%|########7 | 3062/3500 [37:12<15:20,  2.10s/it, lr: 1.0e-04 loss: 5.135e-01]
my_first_lora_v6:  87%|########7 | 3062/3500 [37:12<15:20,  2.10s/it, lr: 1.0e-04 loss: 5.135e-01]
my_first_lora_v6:  88%|########7 | 3063/3500 [37:15<15:18,  2.10s/it, lr: 1.0e-04 loss: 5.004e-02]
my_first_lora_v6:  88%|########7 | 3063/3500 [37:15<15:18,  2.10s/it, lr: 1.0e-04 loss: 5.004e-02]
my_first_lora_v6:  88%|########7 | 3064/3500 [37:17<15:16,  2.10s/it, lr: 1.0e-04 loss: 7.164e-01]
my_first_lora_v6:  88%|########7 | 3064/3500 [37:17<15:16,  2.10s/it, lr: 1.0e-04 loss: 7.164e-01]
my_first_lora_v6:  88%|########7 | 3065/3500 [37:20<15:15,  2.10s/it, lr: 1.0e-04 loss: 6.792e-01]
my_first_lora_v6:  88%|########7 | 3065/3500 [37:20<15:15,  2.10s/it, lr: 1.0e-04 loss: 6.792e-01]
my_first_lora_v6:  88%|########7 | 3066/3500 [37:22<15:13,  2.10s/it, lr: 1.0e-04 loss: 4.464e-01]
my_first_lora_v6:  88%|########7 | 3066/3500 [37:22<15:13,  2.10s/it, lr: 1.0e-04 loss: 4.464e-01]
my_first_lora_v6:  88%|########7 | 3067/3500 [37:24<15:10,  2.10s/it, lr: 1.0e-04 loss: 3.821e-01]
my_first_lora_v6:  88%|########7 | 3067/3500 [37:24<15:10,  2.10s/it, lr: 1.0e-04 loss: 3.821e-01]
my_first_lora_v6:  88%|########7 | 3068/3500 [37:27<15:08,  2.10s/it, lr: 1.0e-04 loss: 7.390e-01]
my_first_lora_v6:  88%|########7 | 3068/3500 [37:27<15:08,  2.10s/it, lr: 1.0e-04 loss: 7.390e-01]
my_first_lora_v6:  88%|########7 | 3069/3500 [37:29<15:06,  2.10s/it, lr: 1.0e-04 loss: 3.563e-01]
my_first_lora_v6:  88%|########7 | 3069/3500 [37:29<15:06,  2.10s/it, lr: 1.0e-04 loss: 3.563e-01]
my_first_lora_v6:  88%|########7 | 3070/3500 [37:31<15:04,  2.10s/it, lr: 1.0e-04 loss: 2.277e-01]
my_first_lora_v6:  88%|########7 | 3070/3500 [37:31<15:04,  2.10s/it, lr: 1.0e-04 loss: 2.277e-01]
my_first_lora_v6:  88%|########7 | 3071/3500 [37:32<15:02,  2.10s/it, lr: 1.0e-04 loss: 2.556e-01]
my_first_lora_v6:  88%|########7 | 3071/3500 [37:32<15:02,  2.10s/it, lr: 1.0e-04 loss: 2.556e-01]
my_first_lora_v6:  88%|########7 | 3072/3500 [37:35<15:00,  2.10s/it, lr: 1.0e-04 loss: 1.088e-01]
my_first_lora_v6:  88%|########7 | 3072/3500 [37:35<15:00,  2.10s/it, lr: 1.0e-04 loss: 1.088e-01]
my_first_lora_v6:  88%|########7 | 3073/3500 [37:38<14:58,  2.10s/it, lr: 1.0e-04 loss: 6.914e-01]
my_first_lora_v6:  88%|########7 | 3073/3500 [37:38<14:58,  2.10s/it, lr: 1.0e-04 loss: 6.914e-01]
my_first_lora_v6:  88%|########7 | 3074/3500 [37:39<14:56,  2.10s/it, lr: 1.0e-04 loss: 5.200e-01]
my_first_lora_v6:  88%|########7 | 3074/3500 [37:39<14:56,  2.10s/it, lr: 1.0e-04 loss: 5.200e-01]
my_first_lora_v6:  88%|########7 | 3075/3500 [37:42<14:54,  2.10s/it, lr: 1.0e-04 loss: 5.818e-01]
my_first_lora_v6:  88%|########7 | 3075/3500 [37:42<14:54,  2.10s/it, lr: 1.0e-04 loss: 5.818e-01]
my_first_lora_v6:  88%|########7 | 3076/3500 [37:43<14:52,  2.10s/it, lr: 1.0e-04 loss: 1.322e-02]
my_first_lora_v6:  88%|########7 | 3076/3500 [37:43<14:52,  2.10s/it, lr: 1.0e-04 loss: 1.322e-02]
my_first_lora_v6:  88%|########7 | 3077/3500 [37:45<14:49,  2.10s/it, lr: 1.0e-04 loss: 1.594e-01]
my_first_lora_v6:  88%|########7 | 3077/3500 [37:45<14:49,  2.10s/it, lr: 1.0e-04 loss: 1.594e-01]
my_first_lora_v6:  88%|########7 | 3078/3500 [37:48<14:47,  2.10s/it, lr: 1.0e-04 loss: 6.926e-01]
my_first_lora_v6:  88%|########7 | 3078/3500 [37:48<14:47,  2.10s/it, lr: 1.0e-04 loss: 6.926e-01]
my_first_lora_v6:  88%|########7 | 3079/3500 [37:50<14:45,  2.10s/it, lr: 1.0e-04 loss: 6.898e-01]
my_first_lora_v6:  88%|########7 | 3079/3500 [37:50<14:45,  2.10s/it, lr: 1.0e-04 loss: 6.898e-01]
my_first_lora_v6:  88%|########8 | 3080/3500 [37:51<14:43,  2.10s/it, lr: 1.0e-04 loss: 1.586e-01]
my_first_lora_v6:  88%|########8 | 3080/3500 [37:51<14:43,  2.10s/it, lr: 1.0e-04 loss: 1.586e-01]
my_first_lora_v6:  88%|########8 | 3081/3500 [37:52<14:40,  2.10s/it, lr: 1.0e-04 loss: 7.714e-01]
my_first_lora_v6:  88%|########8 | 3081/3500 [37:52<14:40,  2.10s/it, lr: 1.0e-04 loss: 7.714e-01]
my_first_lora_v6:  88%|########8 | 3082/3500 [37:55<14:38,  2.10s/it, lr: 1.0e-04 loss: 5.193e-01]
my_first_lora_v6:  88%|########8 | 3082/3500 [37:55<14:38,  2.10s/it, lr: 1.0e-04 loss: 5.193e-01]
my_first_lora_v6:  88%|########8 | 3083/3500 [37:57<14:36,  2.10s/it, lr: 1.0e-04 loss: 5.595e-01]
my_first_lora_v6:  88%|########8 | 3083/3500 [37:57<14:36,  2.10s/it, lr: 1.0e-04 loss: 5.595e-01]
my_first_lora_v6:  88%|########8 | 3084/3500 [38:00<14:35,  2.10s/it, lr: 1.0e-04 loss: 7.651e-01]
my_first_lora_v6:  88%|########8 | 3084/3500 [38:00<14:35,  2.10s/it, lr: 1.0e-04 loss: 7.651e-01]
my_first_lora_v6:  88%|########8 | 3085/3500 [38:02<14:32,  2.10s/it, lr: 1.0e-04 loss: 5.186e-01]
my_first_lora_v6:  88%|########8 | 3085/3500 [38:02<14:32,  2.10s/it, lr: 1.0e-04 loss: 5.186e-01]
my_first_lora_v6:  88%|########8 | 3086/3500 [38:04<14:30,  2.10s/it, lr: 1.0e-04 loss: 1.326e-01]
my_first_lora_v6:  88%|########8 | 3086/3500 [38:04<14:30,  2.10s/it, lr: 1.0e-04 loss: 1.326e-01]
my_first_lora_v6:  88%|########8 | 3087/3500 [38:07<14:29,  2.10s/it, lr: 1.0e-04 loss: 6.095e-01]
my_first_lora_v6:  88%|########8 | 3087/3500 [38:07<14:29,  2.10s/it, lr: 1.0e-04 loss: 6.095e-01]
my_first_lora_v6:  88%|########8 | 3088/3500 [38:09<14:27,  2.10s/it, lr: 1.0e-04 loss: 5.854e-01]
my_first_lora_v6:  88%|########8 | 3088/3500 [38:09<14:27,  2.10s/it, lr: 1.0e-04 loss: 5.854e-01]
my_first_lora_v6:  88%|########8 | 3089/3500 [38:11<14:25,  2.10s/it, lr: 1.0e-04 loss: 7.090e-01]
my_first_lora_v6:  88%|########8 | 3089/3500 [38:11<14:25,  2.10s/it, lr: 1.0e-04 loss: 7.090e-01]
my_first_lora_v6:  88%|########8 | 3090/3500 [38:14<14:23,  2.11s/it, lr: 1.0e-04 loss: 4.440e-01]
my_first_lora_v6:  88%|########8 | 3090/3500 [38:14<14:23,  2.11s/it, lr: 1.0e-04 loss: 4.440e-01]
my_first_lora_v6:  88%|########8 | 3091/3500 [38:17<14:21,  2.11s/it, lr: 1.0e-04 loss: 1.243e-01]
my_first_lora_v6:  88%|########8 | 3091/3500 [38:17<14:21,  2.11s/it, lr: 1.0e-04 loss: 1.243e-01]
my_first_lora_v6:  88%|########8 | 3092/3500 [38:19<14:18,  2.11s/it, lr: 1.0e-04 loss: 3.305e-02]
my_first_lora_v6:  88%|########8 | 3092/3500 [38:19<14:18,  2.11s/it, lr: 1.0e-04 loss: 3.305e-02]
my_first_lora_v6:  88%|########8 | 3093/3500 [38:21<14:17,  2.11s/it, lr: 1.0e-04 loss: 4.044e-01]
my_first_lora_v6:  88%|########8 | 3093/3500 [38:21<14:17,  2.11s/it, lr: 1.0e-04 loss: 4.044e-01]
my_first_lora_v6:  88%|########8 | 3094/3500 [38:22<14:14,  2.10s/it, lr: 1.0e-04 loss: 1.646e-01]
my_first_lora_v6:  88%|########8 | 3094/3500 [38:22<14:14,  2.10s/it, lr: 1.0e-04 loss: 1.646e-01]
my_first_lora_v6:  88%|########8 | 3095/3500 [38:23<14:12,  2.10s/it, lr: 1.0e-04 loss: 5.205e-01]
my_first_lora_v6:  88%|########8 | 3095/3500 [38:23<14:12,  2.10s/it, lr: 1.0e-04 loss: 5.205e-01]
my_first_lora_v6:  88%|########8 | 3096/3500 [38:26<14:10,  2.10s/it, lr: 1.0e-04 loss: 2.690e-01]
my_first_lora_v6:  88%|########8 | 3096/3500 [38:26<14:10,  2.10s/it, lr: 1.0e-04 loss: 2.690e-01]
my_first_lora_v6:  88%|########8 | 3097/3500 [38:27<14:07,  2.10s/it, lr: 1.0e-04 loss: 6.975e-01]
my_first_lora_v6:  88%|########8 | 3097/3500 [38:27<14:07,  2.10s/it, lr: 1.0e-04 loss: 6.975e-01]
my_first_lora_v6:  89%|########8 | 3098/3500 [38:29<14:05,  2.10s/it, lr: 1.0e-04 loss: 3.948e-01]
my_first_lora_v6:  89%|########8 | 3098/3500 [38:29<14:05,  2.10s/it, lr: 1.0e-04 loss: 3.948e-01]
my_first_lora_v6:  89%|########8 | 3099/3500 [38:31<14:03,  2.10s/it, lr: 1.0e-04 loss: 4.756e-01]
my_first_lora_v6:  89%|########8 | 3099/3500 [38:31<14:03,  2.10s/it, lr: 1.0e-04 loss: 4.756e-01]
my_first_lora_v6:  89%|########8 | 3100/3500 [38:33<14:01,  2.10s/it, lr: 1.0e-04 loss: 2.546e-01]
my_first_lora_v6:  89%|########8 | 3100/3500 [38:33<14:01,  2.10s/it, lr: 1.0e-04 loss: 2.546e-01]
my_first_lora_v6:  89%|########8 | 3101/3500 [38:36<13:59,  2.10s/it, lr: 1.0e-04 loss: 2.724e-02]
my_first_lora_v6:  89%|########8 | 3101/3500 [38:36<13:59,  2.10s/it, lr: 1.0e-04 loss: 2.724e-02]
my_first_lora_v6:  89%|########8 | 3102/3500 [38:37<13:57,  2.10s/it, lr: 1.0e-04 loss: 5.431e-01]
my_first_lora_v6:  89%|########8 | 3102/3500 [38:37<13:57,  2.10s/it, lr: 1.0e-04 loss: 5.431e-01]
my_first_lora_v6:  89%|########8 | 3103/3500 [38:40<13:55,  2.10s/it, lr: 1.0e-04 loss: 6.202e-01]
my_first_lora_v6:  89%|########8 | 3103/3500 [38:40<13:55,  2.10s/it, lr: 1.0e-04 loss: 6.202e-01]
my_first_lora_v6:  89%|########8 | 3104/3500 [38:42<13:53,  2.10s/it, lr: 1.0e-04 loss: 5.523e-02]
my_first_lora_v6:  89%|########8 | 3104/3500 [38:42<13:53,  2.10s/it, lr: 1.0e-04 loss: 5.523e-02]
my_first_lora_v6:  89%|########8 | 3105/3500 [38:45<13:51,  2.10s/it, lr: 1.0e-04 loss: 6.213e-02]
my_first_lora_v6:  89%|########8 | 3105/3500 [38:45<13:51,  2.10s/it, lr: 1.0e-04 loss: 6.213e-02]
my_first_lora_v6:  89%|########8 | 3106/3500 [38:48<13:49,  2.10s/it, lr: 1.0e-04 loss: 4.980e-01]
my_first_lora_v6:  89%|########8 | 3106/3500 [38:48<13:49,  2.10s/it, lr: 1.0e-04 loss: 4.980e-01]
my_first_lora_v6:  89%|########8 | 3107/3500 [38:50<13:47,  2.11s/it, lr: 1.0e-04 loss: 7.725e-01]
my_first_lora_v6:  89%|########8 | 3107/3500 [38:50<13:47,  2.11s/it, lr: 1.0e-04 loss: 7.725e-01]
my_first_lora_v6:  89%|########8 | 3108/3500 [38:52<13:45,  2.11s/it, lr: 1.0e-04 loss: 5.445e-02]
my_first_lora_v6:  89%|########8 | 3108/3500 [38:52<13:45,  2.11s/it, lr: 1.0e-04 loss: 5.445e-02]
my_first_lora_v6:  89%|########8 | 3109/3500 [38:54<13:43,  2.10s/it, lr: 1.0e-04 loss: 1.312e-01]
my_first_lora_v6:  89%|########8 | 3109/3500 [38:54<13:43,  2.10s/it, lr: 1.0e-04 loss: 1.312e-01]
my_first_lora_v6:  89%|########8 | 3110/3500 [38:56<13:41,  2.11s/it, lr: 1.0e-04 loss: 4.799e-01]
my_first_lora_v6:  89%|########8 | 3110/3500 [38:56<13:41,  2.11s/it, lr: 1.0e-04 loss: 4.799e-01]
my_first_lora_v6:  89%|########8 | 3111/3500 [38:57<13:38,  2.10s/it, lr: 1.0e-04 loss: 3.797e-02]
my_first_lora_v6:  89%|########8 | 3111/3500 [38:57<13:38,  2.10s/it, lr: 1.0e-04 loss: 3.797e-02]
my_first_lora_v6:  89%|########8 | 3112/3500 [38:58<13:36,  2.10s/it, lr: 1.0e-04 loss: 7.360e-01]
my_first_lora_v6:  89%|########8 | 3112/3500 [38:58<13:36,  2.10s/it, lr: 1.0e-04 loss: 7.360e-01]
my_first_lora_v6:  89%|########8 | 3113/3500 [39:01<13:34,  2.10s/it, lr: 1.0e-04 loss: 1.746e-01]
my_first_lora_v6:  89%|########8 | 3113/3500 [39:01<13:34,  2.10s/it, lr: 1.0e-04 loss: 1.746e-01]
my_first_lora_v6:  89%|########8 | 3114/3500 [39:04<13:32,  2.10s/it, lr: 1.0e-04 loss: 2.142e-01]
my_first_lora_v6:  89%|########8 | 3114/3500 [39:04<13:32,  2.10s/it, lr: 1.0e-04 loss: 2.142e-01]
my_first_lora_v6:  89%|########9 | 3115/3500 [39:06<13:30,  2.10s/it, lr: 1.0e-04 loss: 5.212e-01]
my_first_lora_v6:  89%|########9 | 3115/3500 [39:06<13:30,  2.10s/it, lr: 1.0e-04 loss: 5.212e-01]
my_first_lora_v6:  89%|########9 | 3116/3500 [39:08<13:28,  2.10s/it, lr: 1.0e-04 loss: 4.741e-01]
my_first_lora_v6:  89%|########9 | 3116/3500 [39:08<13:28,  2.10s/it, lr: 1.0e-04 loss: 4.741e-01]
my_first_lora_v6:  89%|########9 | 3117/3500 [39:10<13:26,  2.10s/it, lr: 1.0e-04 loss: 1.172e-01]
my_first_lora_v6:  89%|########9 | 3117/3500 [39:10<13:26,  2.10s/it, lr: 1.0e-04 loss: 1.172e-01]
my_first_lora_v6:  89%|########9 | 3118/3500 [39:13<13:24,  2.11s/it, lr: 1.0e-04 loss: 6.546e-01]
my_first_lora_v6:  89%|########9 | 3118/3500 [39:13<13:24,  2.11s/it, lr: 1.0e-04 loss: 6.546e-01]
my_first_lora_v6:  89%|########9 | 3119/3500 [39:15<13:22,  2.11s/it, lr: 1.0e-04 loss: 3.152e-01]
my_first_lora_v6:  89%|########9 | 3119/3500 [39:15<13:22,  2.11s/it, lr: 1.0e-04 loss: 3.152e-01]
my_first_lora_v6:  89%|########9 | 3120/3500 [39:18<13:20,  2.11s/it, lr: 1.0e-04 loss: 7.032e-01]
my_first_lora_v6:  89%|########9 | 3120/3500 [39:18<13:20,  2.11s/it, lr: 1.0e-04 loss: 7.032e-01]
my_first_lora_v6:  89%|########9 | 3121/3500 [39:21<13:18,  2.11s/it, lr: 1.0e-04 loss: 5.665e-01]
my_first_lora_v6:  89%|########9 | 3121/3500 [39:21<13:18,  2.11s/it, lr: 1.0e-04 loss: 5.665e-01]
my_first_lora_v6:  89%|########9 | 3122/3500 [39:22<13:15,  2.11s/it, lr: 1.0e-04 loss: 5.237e-01]
my_first_lora_v6:  89%|########9 | 3122/3500 [39:22<13:15,  2.11s/it, lr: 1.0e-04 loss: 5.237e-01]
my_first_lora_v6:  89%|########9 | 3123/3500 [39:23<13:13,  2.10s/it, lr: 1.0e-04 loss: 6.156e-01]
my_first_lora_v6:  89%|########9 | 3123/3500 [39:23<13:13,  2.10s/it, lr: 1.0e-04 loss: 6.156e-01]
my_first_lora_v6:  89%|########9 | 3124/3500 [39:24<13:10,  2.10s/it, lr: 1.0e-04 loss: 7.143e-01]
my_first_lora_v6:  89%|########9 | 3124/3500 [39:24<13:10,  2.10s/it, lr: 1.0e-04 loss: 7.143e-01]
my_first_lora_v6:  89%|########9 | 3125/3500 [39:26<13:08,  2.10s/it, lr: 1.0e-04 loss: 5.463e-01]
my_first_lora_v6:  89%|########9 | 3125/3500 [39:26<13:08,  2.10s/it, lr: 1.0e-04 loss: 5.463e-01]
my_first_lora_v6:  89%|########9 | 3126/3500 [39:29<13:06,  2.10s/it, lr: 1.0e-04 loss: 4.437e-01]
my_first_lora_v6:  89%|########9 | 3126/3500 [39:29<13:06,  2.10s/it, lr: 1.0e-04 loss: 4.437e-01]
my_first_lora_v6:  89%|########9 | 3127/3500 [39:31<13:04,  2.10s/it, lr: 1.0e-04 loss: 1.327e-01]
my_first_lora_v6:  89%|########9 | 3127/3500 [39:31<13:04,  2.10s/it, lr: 1.0e-04 loss: 1.327e-01]
my_first_lora_v6:  89%|########9 | 3128/3500 [39:33<13:02,  2.10s/it, lr: 1.0e-04 loss: 2.503e-01]
my_first_lora_v6:  89%|########9 | 3128/3500 [39:33<13:02,  2.10s/it, lr: 1.0e-04 loss: 2.503e-01]
my_first_lora_v6:  89%|########9 | 3129/3500 [39:35<13:00,  2.10s/it, lr: 1.0e-04 loss: 1.511e-01]
my_first_lora_v6:  89%|########9 | 3129/3500 [39:35<13:00,  2.10s/it, lr: 1.0e-04 loss: 1.511e-01]
my_first_lora_v6:  89%|########9 | 3130/3500 [39:37<12:58,  2.10s/it, lr: 1.0e-04 loss: 4.631e-01]
my_first_lora_v6:  89%|########9 | 3130/3500 [39:37<12:58,  2.10s/it, lr: 1.0e-04 loss: 4.631e-01]
my_first_lora_v6:  89%|########9 | 3131/3500 [39:39<12:56,  2.10s/it, lr: 1.0e-04 loss: 2.699e-01]
my_first_lora_v6:  89%|########9 | 3131/3500 [39:39<12:56,  2.10s/it, lr: 1.0e-04 loss: 2.699e-01]
my_first_lora_v6:  89%|########9 | 3132/3500 [39:42<12:54,  2.10s/it, lr: 1.0e-04 loss: 2.091e-01]
my_first_lora_v6:  89%|########9 | 3132/3500 [39:42<12:54,  2.10s/it, lr: 1.0e-04 loss: 2.091e-01]
my_first_lora_v6:  90%|########9 | 3133/3500 [39:45<12:52,  2.11s/it, lr: 1.0e-04 loss: 6.903e-01]
my_first_lora_v6:  90%|########9 | 3133/3500 [39:45<12:52,  2.11s/it, lr: 1.0e-04 loss: 6.903e-01]
my_first_lora_v6:  90%|########9 | 3134/3500 [39:46<12:50,  2.10s/it, lr: 1.0e-04 loss: 7.834e-01]
my_first_lora_v6:  90%|########9 | 3134/3500 [39:46<12:50,  2.10s/it, lr: 1.0e-04 loss: 7.834e-01]
my_first_lora_v6:  90%|########9 | 3135/3500 [39:48<12:48,  2.10s/it, lr: 1.0e-04 loss: 7.035e-01]
my_first_lora_v6:  90%|########9 | 3135/3500 [39:48<12:48,  2.10s/it, lr: 1.0e-04 loss: 7.035e-01]
my_first_lora_v6:  90%|########9 | 3136/3500 [39:51<12:46,  2.11s/it, lr: 1.0e-04 loss: 5.529e-01]
my_first_lora_v6:  90%|########9 | 3136/3500 [39:51<12:46,  2.11s/it, lr: 1.0e-04 loss: 5.529e-01]
my_first_lora_v6:  90%|########9 | 3137/3500 [39:53<12:44,  2.11s/it, lr: 1.0e-04 loss: 6.610e-01]
my_first_lora_v6:  90%|########9 | 3137/3500 [39:53<12:44,  2.11s/it, lr: 1.0e-04 loss: 6.610e-01]
my_first_lora_v6:  90%|########9 | 3138/3500 [39:54<12:41,  2.10s/it, lr: 1.0e-04 loss: 5.501e-01]
my_first_lora_v6:  90%|########9 | 3138/3500 [39:54<12:41,  2.10s/it, lr: 1.0e-04 loss: 5.501e-01]
my_first_lora_v6:  90%|########9 | 3139/3500 [39:56<12:39,  2.10s/it, lr: 1.0e-04 loss: 1.614e-01]
my_first_lora_v6:  90%|########9 | 3139/3500 [39:56<12:39,  2.10s/it, lr: 1.0e-04 loss: 1.614e-01]
my_first_lora_v6:  90%|########9 | 3140/3500 [39:58<12:37,  2.10s/it, lr: 1.0e-04 loss: 4.706e-01]
my_first_lora_v6:  90%|########9 | 3140/3500 [39:58<12:37,  2.10s/it, lr: 1.0e-04 loss: 4.706e-01]
my_first_lora_v6:  90%|########9 | 3141/3500 [40:01<12:35,  2.10s/it, lr: 1.0e-04 loss: 1.246e-01]
my_first_lora_v6:  90%|########9 | 3141/3500 [40:01<12:35,  2.10s/it, lr: 1.0e-04 loss: 1.246e-01]
my_first_lora_v6:  90%|########9 | 3142/3500 [40:03<12:33,  2.11s/it, lr: 1.0e-04 loss: 3.938e-01]
my_first_lora_v6:  90%|########9 | 3142/3500 [40:03<12:33,  2.11s/it, lr: 1.0e-04 loss: 3.938e-01]
my_first_lora_v6:  90%|########9 | 3143/3500 [40:05<12:31,  2.10s/it, lr: 1.0e-04 loss: 6.515e-01]
my_first_lora_v6:  90%|########9 | 3143/3500 [40:05<12:31,  2.10s/it, lr: 1.0e-04 loss: 6.515e-01]
my_first_lora_v6:  90%|########9 | 3144/3500 [40:07<12:29,  2.10s/it, lr: 1.0e-04 loss: 8.278e-01]
my_first_lora_v6:  90%|########9 | 3144/3500 [40:07<12:29,  2.10s/it, lr: 1.0e-04 loss: 8.278e-01]
my_first_lora_v6:  90%|########9 | 3145/3500 [40:10<12:27,  2.11s/it, lr: 1.0e-04 loss: 6.864e-01]
my_first_lora_v6:  90%|########9 | 3145/3500 [40:10<12:27,  2.11s/it, lr: 1.0e-04 loss: 6.864e-01]
my_first_lora_v6:  90%|########9 | 3146/3500 [40:11<12:24,  2.10s/it, lr: 1.0e-04 loss: 1.232e-01]
my_first_lora_v6:  90%|########9 | 3146/3500 [40:11<12:24,  2.10s/it, lr: 1.0e-04 loss: 1.232e-01]
my_first_lora_v6:  90%|########9 | 3147/3500 [40:13<12:22,  2.10s/it, lr: 1.0e-04 loss: 3.063e-01]
my_first_lora_v6:  90%|########9 | 3147/3500 [40:13<12:22,  2.10s/it, lr: 1.0e-04 loss: 3.063e-01]
my_first_lora_v6:  90%|########9 | 3148/3500 [40:15<12:20,  2.10s/it, lr: 1.0e-04 loss: 4.591e-01]
my_first_lora_v6:  90%|########9 | 3148/3500 [40:15<12:20,  2.10s/it, lr: 1.0e-04 loss: 4.591e-01]
my_first_lora_v6:  90%|########9 | 3149/3500 [40:17<12:18,  2.10s/it, lr: 1.0e-04 loss: 2.167e-01]
my_first_lora_v6:  90%|########9 | 3149/3500 [40:17<12:18,  2.10s/it, lr: 1.0e-04 loss: 2.167e-01]
my_first_lora_v6:  90%|######### | 3150/3500 [40:20<12:16,  2.10s/it, lr: 1.0e-04 loss: 2.198e-01]
my_first_lora_v6:  90%|######### | 3150/3500 [40:20<12:16,  2.10s/it, lr: 1.0e-04 loss: 2.198e-01]
my_first_lora_v6:  90%|######### | 3151/3500 [40:21<12:14,  2.10s/it, lr: 1.0e-04 loss: 1.560e-01]
my_first_lora_v6:  90%|######### | 3151/3500 [40:21<12:14,  2.10s/it, lr: 1.0e-04 loss: 1.560e-01]
my_first_lora_v6:  90%|######### | 3152/3500 [40:22<12:11,  2.10s/it, lr: 1.0e-04 loss: 2.521e-01]
my_first_lora_v6:  90%|######### | 3152/3500 [40:22<12:11,  2.10s/it, lr: 1.0e-04 loss: 2.521e-01]
my_first_lora_v6:  90%|######### | 3153/3500 [40:25<12:09,  2.10s/it, lr: 1.0e-04 loss: 5.044e-01]
my_first_lora_v6:  90%|######### | 3153/3500 [40:25<12:09,  2.10s/it, lr: 1.0e-04 loss: 5.044e-01]
my_first_lora_v6:  90%|######### | 3154/3500 [40:26<12:07,  2.10s/it, lr: 1.0e-04 loss: 1.896e-01]
my_first_lora_v6:  90%|######### | 3154/3500 [40:26<12:07,  2.10s/it, lr: 1.0e-04 loss: 1.896e-01]
my_first_lora_v6:  90%|######### | 3155/3500 [40:29<12:05,  2.10s/it, lr: 1.0e-04 loss: 5.634e-02]
my_first_lora_v6:  90%|######### | 3155/3500 [40:29<12:05,  2.10s/it, lr: 1.0e-04 loss: 5.634e-02]
my_first_lora_v6:  90%|######### | 3156/3500 [40:31<12:03,  2.10s/it, lr: 1.0e-04 loss: 4.726e-01]
my_first_lora_v6:  90%|######### | 3156/3500 [40:31<12:03,  2.10s/it, lr: 1.0e-04 loss: 4.726e-01]
my_first_lora_v6:  90%|######### | 3157/3500 [40:33<12:01,  2.10s/it, lr: 1.0e-04 loss: 8.053e-01]
my_first_lora_v6:  90%|######### | 3157/3500 [40:33<12:01,  2.10s/it, lr: 1.0e-04 loss: 8.053e-01]
my_first_lora_v6:  90%|######### | 3158/3500 [40:36<11:59,  2.10s/it, lr: 1.0e-04 loss: 6.258e-01]
my_first_lora_v6:  90%|######### | 3158/3500 [40:36<11:59,  2.10s/it, lr: 1.0e-04 loss: 6.258e-01]
my_first_lora_v6:  90%|######### | 3159/3500 [40:39<11:57,  2.10s/it, lr: 1.0e-04 loss: 5.790e-02]
my_first_lora_v6:  90%|######### | 3159/3500 [40:39<11:57,  2.10s/it, lr: 1.0e-04 loss: 5.790e-02]
my_first_lora_v6:  90%|######### | 3160/3500 [40:41<11:55,  2.10s/it, lr: 1.0e-04 loss: 5.189e-01]
my_first_lora_v6:  90%|######### | 3160/3500 [40:41<11:55,  2.10s/it, lr: 1.0e-04 loss: 5.189e-01]
my_first_lora_v6:  90%|######### | 3161/3500 [40:44<11:53,  2.11s/it, lr: 1.0e-04 loss: 4.920e-02]
my_first_lora_v6:  90%|######### | 3161/3500 [40:44<11:53,  2.11s/it, lr: 1.0e-04 loss: 4.920e-02]
my_first_lora_v6:  90%|######### | 3162/3500 [40:46<11:51,  2.11s/it, lr: 1.0e-04 loss: 5.582e-01]
my_first_lora_v6:  90%|######### | 3162/3500 [40:46<11:51,  2.11s/it, lr: 1.0e-04 loss: 5.582e-01]
my_first_lora_v6:  90%|######### | 3163/3500 [40:48<11:49,  2.11s/it, lr: 1.0e-04 loss: 7.996e-02]
my_first_lora_v6:  90%|######### | 3163/3500 [40:48<11:49,  2.11s/it, lr: 1.0e-04 loss: 7.996e-02]
my_first_lora_v6:  90%|######### | 3164/3500 [40:51<11:47,  2.11s/it, lr: 1.0e-04 loss: 1.321e-01]
my_first_lora_v6:  90%|######### | 3164/3500 [40:51<11:47,  2.11s/it, lr: 1.0e-04 loss: 1.321e-01]
my_first_lora_v6:  90%|######### | 3165/3500 [40:52<11:45,  2.10s/it, lr: 1.0e-04 loss: 5.105e-01]
my_first_lora_v6:  90%|######### | 3165/3500 [40:52<11:45,  2.10s/it, lr: 1.0e-04 loss: 5.105e-01]
my_first_lora_v6:  90%|######### | 3166/3500 [40:53<11:42,  2.10s/it, lr: 1.0e-04 loss: 1.895e-01]
my_first_lora_v6:  90%|######### | 3166/3500 [40:53<11:42,  2.10s/it, lr: 1.0e-04 loss: 1.895e-01]
my_first_lora_v6:  90%|######### | 3167/3500 [40:55<11:40,  2.10s/it, lr: 1.0e-04 loss: 6.923e-01]
my_first_lora_v6:  90%|######### | 3167/3500 [40:55<11:40,  2.10s/it, lr: 1.0e-04 loss: 6.923e-01]
my_first_lora_v6:  91%|######### | 3168/3500 [40:58<11:38,  2.10s/it, lr: 1.0e-04 loss: 6.659e-01]
my_first_lora_v6:  91%|######### | 3168/3500 [40:58<11:38,  2.10s/it, lr: 1.0e-04 loss: 6.659e-01]
my_first_lora_v6:  91%|######### | 3169/3500 [41:00<11:36,  2.11s/it, lr: 1.0e-04 loss: 1.039e-01]
my_first_lora_v6:  91%|######### | 3169/3500 [41:00<11:36,  2.11s/it, lr: 1.0e-04 loss: 1.039e-01]
my_first_lora_v6:  91%|######### | 3170/3500 [41:03<11:34,  2.11s/it, lr: 1.0e-04 loss: 6.602e-01]
my_first_lora_v6:  91%|######### | 3170/3500 [41:03<11:34,  2.11s/it, lr: 1.0e-04 loss: 6.602e-01]
my_first_lora_v6:  91%|######### | 3171/3500 [41:05<11:32,  2.11s/it, lr: 1.0e-04 loss: 4.289e-01]
my_first_lora_v6:  91%|######### | 3171/3500 [41:05<11:32,  2.11s/it, lr: 1.0e-04 loss: 4.289e-01]
my_first_lora_v6:  91%|######### | 3172/3500 [41:07<11:30,  2.11s/it, lr: 1.0e-04 loss: 4.763e-01]
my_first_lora_v6:  91%|######### | 3172/3500 [41:07<11:30,  2.11s/it, lr: 1.0e-04 loss: 4.763e-01]
my_first_lora_v6:  91%|######### | 3173/3500 [41:08<11:28,  2.10s/it, lr: 1.0e-04 loss: 7.653e-01]
my_first_lora_v6:  91%|######### | 3173/3500 [41:08<11:28,  2.10s/it, lr: 1.0e-04 loss: 7.653e-01]
my_first_lora_v6:  91%|######### | 3174/3500 [41:09<11:25,  2.10s/it, lr: 1.0e-04 loss: 1.530e-01]
my_first_lora_v6:  91%|######### | 3174/3500 [41:09<11:25,  2.10s/it, lr: 1.0e-04 loss: 1.530e-01]
my_first_lora_v6:  91%|######### | 3175/3500 [41:11<11:23,  2.10s/it, lr: 1.0e-04 loss: 8.034e-01]
my_first_lora_v6:  91%|######### | 3175/3500 [41:11<11:23,  2.10s/it, lr: 1.0e-04 loss: 8.034e-01]
my_first_lora_v6:  91%|######### | 3176/3500 [41:14<11:21,  2.10s/it, lr: 1.0e-04 loss: 6.737e-01]
my_first_lora_v6:  91%|######### | 3176/3500 [41:14<11:21,  2.10s/it, lr: 1.0e-04 loss: 6.737e-01]
my_first_lora_v6:  91%|######### | 3177/3500 [41:17<11:19,  2.10s/it, lr: 1.0e-04 loss: 1.894e-01]
my_first_lora_v6:  91%|######### | 3177/3500 [41:17<11:19,  2.10s/it, lr: 1.0e-04 loss: 1.894e-01]
my_first_lora_v6:  91%|######### | 3178/3500 [41:19<11:17,  2.11s/it, lr: 1.0e-04 loss: 2.880e-01]
my_first_lora_v6:  91%|######### | 3178/3500 [41:19<11:17,  2.11s/it, lr: 1.0e-04 loss: 2.880e-01]
my_first_lora_v6:  91%|######### | 3179/3500 [41:20<11:15,  2.10s/it, lr: 1.0e-04 loss: 1.718e-01]
my_first_lora_v6:  91%|######### | 3179/3500 [41:20<11:15,  2.10s/it, lr: 1.0e-04 loss: 1.718e-01]
my_first_lora_v6:  91%|######### | 3180/3500 [41:23<11:13,  2.10s/it, lr: 1.0e-04 loss: 6.285e-02]
my_first_lora_v6:  91%|######### | 3180/3500 [41:23<11:13,  2.10s/it, lr: 1.0e-04 loss: 6.285e-02]
my_first_lora_v6:  91%|######### | 3181/3500 [41:25<11:11,  2.10s/it, lr: 1.0e-04 loss: 2.911e-01]
my_first_lora_v6:  91%|######### | 3181/3500 [41:25<11:11,  2.10s/it, lr: 1.0e-04 loss: 2.911e-01]
my_first_lora_v6:  91%|######### | 3182/3500 [41:27<11:09,  2.10s/it, lr: 1.0e-04 loss: 9.282e-02]
my_first_lora_v6:  91%|######### | 3182/3500 [41:27<11:09,  2.10s/it, lr: 1.0e-04 loss: 9.282e-02]
my_first_lora_v6:  91%|######### | 3183/3500 [41:28<11:06,  2.10s/it, lr: 1.0e-04 loss: 5.785e-01]
my_first_lora_v6:  91%|######### | 3183/3500 [41:28<11:06,  2.10s/it, lr: 1.0e-04 loss: 5.785e-01]
my_first_lora_v6:  91%|######### | 3184/3500 [41:31<11:04,  2.10s/it, lr: 1.0e-04 loss: 6.770e-01]
my_first_lora_v6:  91%|######### | 3184/3500 [41:31<11:04,  2.10s/it, lr: 1.0e-04 loss: 6.770e-01]
my_first_lora_v6:  91%|#########1| 3185/3500 [41:33<11:02,  2.10s/it, lr: 1.0e-04 loss: 7.761e-01]
my_first_lora_v6:  91%|#########1| 3185/3500 [41:33<11:02,  2.10s/it, lr: 1.0e-04 loss: 7.761e-01]
my_first_lora_v6:  91%|#########1| 3186/3500 [41:35<11:00,  2.10s/it, lr: 1.0e-04 loss: 5.323e-01]
my_first_lora_v6:  91%|#########1| 3186/3500 [41:35<11:00,  2.10s/it, lr: 1.0e-04 loss: 5.323e-01]
my_first_lora_v6:  91%|#########1| 3187/3500 [41:38<10:58,  2.11s/it, lr: 1.0e-04 loss: 5.122e-02]
my_first_lora_v6:  91%|#########1| 3187/3500 [41:38<10:58,  2.11s/it, lr: 1.0e-04 loss: 5.122e-02]
my_first_lora_v6:  91%|#########1| 3188/3500 [41:40<10:56,  2.10s/it, lr: 1.0e-04 loss: 6.769e-01]
my_first_lora_v6:  91%|#########1| 3188/3500 [41:40<10:56,  2.10s/it, lr: 1.0e-04 loss: 6.769e-01]
my_first_lora_v6:  91%|#########1| 3189/3500 [41:42<10:54,  2.10s/it, lr: 1.0e-04 loss: 5.850e-01]
my_first_lora_v6:  91%|#########1| 3189/3500 [41:42<10:54,  2.10s/it, lr: 1.0e-04 loss: 5.850e-01]
my_first_lora_v6:  91%|#########1| 3190/3500 [41:44<10:52,  2.10s/it, lr: 1.0e-04 loss: 5.128e-01]
my_first_lora_v6:  91%|#########1| 3190/3500 [41:44<10:52,  2.10s/it, lr: 1.0e-04 loss: 5.128e-01]
my_first_lora_v6:  91%|#########1| 3191/3500 [41:47<10:50,  2.11s/it, lr: 1.0e-04 loss: 7.926e-01]
my_first_lora_v6:  91%|#########1| 3191/3500 [41:47<10:50,  2.11s/it, lr: 1.0e-04 loss: 7.926e-01]
my_first_lora_v6:  91%|#########1| 3192/3500 [41:49<10:48,  2.11s/it, lr: 1.0e-04 loss: 7.307e-01]
my_first_lora_v6:  91%|#########1| 3192/3500 [41:49<10:48,  2.11s/it, lr: 1.0e-04 loss: 7.307e-01]
my_first_lora_v6:  91%|#########1| 3193/3500 [41:50<10:46,  2.10s/it, lr: 1.0e-04 loss: 1.808e-01]
my_first_lora_v6:  91%|#########1| 3193/3500 [41:50<10:46,  2.10s/it, lr: 1.0e-04 loss: 1.808e-01]
my_first_lora_v6:  91%|#########1| 3194/3500 [41:53<10:44,  2.10s/it, lr: 1.0e-04 loss: 3.804e-02]
my_first_lora_v6:  91%|#########1| 3194/3500 [41:53<10:44,  2.10s/it, lr: 1.0e-04 loss: 3.804e-02]
my_first_lora_v6:  91%|#########1| 3195/3500 [41:55<10:41,  2.10s/it, lr: 1.0e-04 loss: 4.740e-02]
my_first_lora_v6:  91%|#########1| 3195/3500 [41:55<10:41,  2.10s/it, lr: 1.0e-04 loss: 4.740e-02]
my_first_lora_v6:  91%|#########1| 3196/3500 [41:56<10:39,  2.10s/it, lr: 1.0e-04 loss: 3.948e-01]
my_first_lora_v6:  91%|#########1| 3196/3500 [41:56<10:39,  2.10s/it, lr: 1.0e-04 loss: 3.948e-01]
my_first_lora_v6:  91%|#########1| 3197/3500 [41:58<10:37,  2.10s/it, lr: 1.0e-04 loss: 2.535e-01]
my_first_lora_v6:  91%|#########1| 3197/3500 [41:58<10:37,  2.10s/it, lr: 1.0e-04 loss: 2.535e-01]
my_first_lora_v6:  91%|#########1| 3198/3500 [42:00<10:35,  2.10s/it, lr: 1.0e-04 loss: 3.315e-01]
my_first_lora_v6:  91%|#########1| 3198/3500 [42:00<10:35,  2.10s/it, lr: 1.0e-04 loss: 3.315e-01]
my_first_lora_v6:  91%|#########1| 3199/3500 [42:03<10:33,  2.10s/it, lr: 1.0e-04 loss: 3.467e-01]
my_first_lora_v6:  91%|#########1| 3199/3500 [42:03<10:33,  2.10s/it, lr: 1.0e-04 loss: 3.467e-01]
my_first_lora_v6:  91%|#########1| 3200/3500 [42:05<10:31,  2.10s/it, lr: 1.0e-04 loss: 4.699e-01]
my_first_lora_v6:  91%|#########1| 3200/3500 [42:05<10:31,  2.10s/it, lr: 1.0e-04 loss: 4.699e-01]
my_first_lora_v6:  91%|#########1| 3201/3500 [42:07<10:29,  2.10s/it, lr: 1.0e-04 loss: 5.422e-02]
my_first_lora_v6:  91%|#########1| 3201/3500 [42:07<10:29,  2.10s/it, lr: 1.0e-04 loss: 5.422e-02]
my_first_lora_v6:  91%|#########1| 3202/3500 [42:08<10:26,  2.10s/it, lr: 1.0e-04 loss: 4.328e-01]
my_first_lora_v6:  91%|#########1| 3202/3500 [42:08<10:26,  2.10s/it, lr: 1.0e-04 loss: 4.328e-01]
my_first_lora_v6:  92%|#########1| 3203/3500 [42:11<10:24,  2.10s/it, lr: 1.0e-04 loss: 3.310e-01]
my_first_lora_v6:  92%|#########1| 3203/3500 [42:11<10:24,  2.10s/it, lr: 1.0e-04 loss: 3.310e-01]
my_first_lora_v6:  92%|#########1| 3204/3500 [42:14<10:23,  2.10s/it, lr: 1.0e-04 loss: 6.685e-01]
my_first_lora_v6:  92%|#########1| 3204/3500 [42:14<10:23,  2.10s/it, lr: 1.0e-04 loss: 6.685e-01]
my_first_lora_v6:  92%|#########1| 3205/3500 [42:15<10:20,  2.10s/it, lr: 1.0e-04 loss: 2.337e-01]
my_first_lora_v6:  92%|#########1| 3205/3500 [42:15<10:20,  2.10s/it, lr: 1.0e-04 loss: 2.337e-01]
my_first_lora_v6:  92%|#########1| 3206/3500 [42:17<10:18,  2.10s/it, lr: 1.0e-04 loss: 4.248e-01]
my_first_lora_v6:  92%|#########1| 3206/3500 [42:17<10:18,  2.10s/it, lr: 1.0e-04 loss: 4.248e-01]
my_first_lora_v6:  92%|#########1| 3207/3500 [42:20<10:16,  2.10s/it, lr: 1.0e-04 loss: 8.166e-02]
my_first_lora_v6:  92%|#########1| 3207/3500 [42:20<10:16,  2.10s/it, lr: 1.0e-04 loss: 8.166e-02]
my_first_lora_v6:  92%|#########1| 3208/3500 [42:22<10:14,  2.10s/it, lr: 1.0e-04 loss: 4.109e-02]
my_first_lora_v6:  92%|#########1| 3208/3500 [42:22<10:14,  2.10s/it, lr: 1.0e-04 loss: 4.109e-02]
my_first_lora_v6:  92%|#########1| 3209/3500 [42:25<10:12,  2.11s/it, lr: 1.0e-04 loss: 1.568e-01]
my_first_lora_v6:  92%|#########1| 3209/3500 [42:25<10:12,  2.11s/it, lr: 1.0e-04 loss: 1.568e-01]
my_first_lora_v6:  92%|#########1| 3210/3500 [42:27<10:10,  2.10s/it, lr: 1.0e-04 loss: 7.934e-01]
my_first_lora_v6:  92%|#########1| 3210/3500 [42:27<10:10,  2.10s/it, lr: 1.0e-04 loss: 7.934e-01]
my_first_lora_v6:  92%|#########1| 3211/3500 [42:28<10:08,  2.10s/it, lr: 1.0e-04 loss: 4.902e-02]
my_first_lora_v6:  92%|#########1| 3211/3500 [42:28<10:08,  2.10s/it, lr: 1.0e-04 loss: 4.902e-02]
my_first_lora_v6:  92%|#########1| 3212/3500 [42:30<10:06,  2.10s/it, lr: 1.0e-04 loss: 9.463e-02]
my_first_lora_v6:  92%|#########1| 3212/3500 [42:30<10:06,  2.10s/it, lr: 1.0e-04 loss: 9.463e-02]
my_first_lora_v6:  92%|#########1| 3213/3500 [42:33<10:04,  2.10s/it, lr: 1.0e-04 loss: 2.982e-01]
my_first_lora_v6:  92%|#########1| 3213/3500 [42:33<10:04,  2.10s/it, lr: 1.0e-04 loss: 2.982e-01]
my_first_lora_v6:  92%|#########1| 3214/3500 [42:35<10:02,  2.11s/it, lr: 1.0e-04 loss: 7.145e-01]
my_first_lora_v6:  92%|#########1| 3214/3500 [42:35<10:02,  2.11s/it, lr: 1.0e-04 loss: 7.145e-01]
my_first_lora_v6:  92%|#########1| 3215/3500 [42:37<09:59,  2.10s/it, lr: 1.0e-04 loss: 7.970e-01]
my_first_lora_v6:  92%|#########1| 3215/3500 [42:37<09:59,  2.10s/it, lr: 1.0e-04 loss: 7.970e-01]
my_first_lora_v6:  92%|#########1| 3216/3500 [42:39<09:57,  2.10s/it, lr: 1.0e-04 loss: 4.877e-01]
my_first_lora_v6:  92%|#########1| 3216/3500 [42:39<09:57,  2.10s/it, lr: 1.0e-04 loss: 4.877e-01]
my_first_lora_v6:  92%|#########1| 3217/3500 [42:42<09:55,  2.11s/it, lr: 1.0e-04 loss: 7.368e-01]
my_first_lora_v6:  92%|#########1| 3217/3500 [42:42<09:55,  2.11s/it, lr: 1.0e-04 loss: 7.368e-01]
my_first_lora_v6:  92%|#########1| 3218/3500 [42:44<09:53,  2.11s/it, lr: 1.0e-04 loss: 5.230e-01]
my_first_lora_v6:  92%|#########1| 3218/3500 [42:44<09:53,  2.11s/it, lr: 1.0e-04 loss: 5.230e-01]
my_first_lora_v6:  92%|#########1| 3219/3500 [42:45<09:51,  2.10s/it, lr: 1.0e-04 loss: 2.151e-01]
my_first_lora_v6:  92%|#########1| 3219/3500 [42:45<09:51,  2.10s/it, lr: 1.0e-04 loss: 2.151e-01]
my_first_lora_v6:  92%|#########2| 3220/3500 [42:47<09:49,  2.10s/it, lr: 1.0e-04 loss: 5.331e-01]
my_first_lora_v6:  92%|#########2| 3220/3500 [42:47<09:49,  2.10s/it, lr: 1.0e-04 loss: 5.331e-01]
my_first_lora_v6:  92%|#########2| 3221/3500 [42:49<09:47,  2.10s/it, lr: 1.0e-04 loss: 7.072e-01]
my_first_lora_v6:  92%|#########2| 3221/3500 [42:49<09:47,  2.10s/it, lr: 1.0e-04 loss: 7.072e-01]
my_first_lora_v6:  92%|#########2| 3222/3500 [42:52<09:45,  2.10s/it, lr: 1.0e-04 loss: 1.821e-01]
my_first_lora_v6:  92%|#########2| 3222/3500 [42:52<09:45,  2.10s/it, lr: 1.0e-04 loss: 1.821e-01]
my_first_lora_v6:  92%|#########2| 3223/3500 [42:53<09:42,  2.10s/it, lr: 1.0e-04 loss: 7.115e-01]
my_first_lora_v6:  92%|#########2| 3223/3500 [42:53<09:42,  2.10s/it, lr: 1.0e-04 loss: 7.115e-01]
my_first_lora_v6:  92%|#########2| 3224/3500 [42:55<09:40,  2.10s/it, lr: 1.0e-04 loss: 1.569e-01]
my_first_lora_v6:  92%|#########2| 3224/3500 [42:55<09:40,  2.10s/it, lr: 1.0e-04 loss: 1.569e-01]
my_first_lora_v6:  92%|#########2| 3225/3500 [42:58<09:38,  2.10s/it, lr: 1.0e-04 loss: 5.353e-01]
my_first_lora_v6:  92%|#########2| 3225/3500 [42:58<09:38,  2.10s/it, lr: 1.0e-04 loss: 5.353e-01]
my_first_lora_v6:  92%|#########2| 3226/3500 [43:00<09:36,  2.11s/it, lr: 1.0e-04 loss: 3.754e-01]
my_first_lora_v6:  92%|#########2| 3226/3500 [43:00<09:36,  2.11s/it, lr: 1.0e-04 loss: 3.754e-01]
my_first_lora_v6:  92%|#########2| 3227/3500 [43:03<09:34,  2.11s/it, lr: 1.0e-04 loss: 2.469e-01]
my_first_lora_v6:  92%|#########2| 3227/3500 [43:03<09:34,  2.11s/it, lr: 1.0e-04 loss: 2.469e-01]
my_first_lora_v6:  92%|#########2| 3228/3500 [43:05<09:32,  2.11s/it, lr: 1.0e-04 loss: 3.683e-01]
my_first_lora_v6:  92%|#########2| 3228/3500 [43:05<09:32,  2.11s/it, lr: 1.0e-04 loss: 3.683e-01]
my_first_lora_v6:  92%|#########2| 3229/3500 [43:06<09:30,  2.10s/it, lr: 1.0e-04 loss: 6.098e-01]
my_first_lora_v6:  92%|#########2| 3229/3500 [43:06<09:30,  2.10s/it, lr: 1.0e-04 loss: 6.098e-01]
my_first_lora_v6:  92%|#########2| 3230/3500 [43:08<09:28,  2.10s/it, lr: 1.0e-04 loss: 8.473e-02]
my_first_lora_v6:  92%|#########2| 3230/3500 [43:08<09:28,  2.10s/it, lr: 1.0e-04 loss: 8.473e-02]
my_first_lora_v6:  92%|#########2| 3231/3500 [43:11<09:26,  2.10s/it, lr: 1.0e-04 loss: 4.642e-01]
my_first_lora_v6:  92%|#########2| 3231/3500 [43:11<09:26,  2.10s/it, lr: 1.0e-04 loss: 4.642e-01]
my_first_lora_v6:  92%|#########2| 3232/3500 [43:12<09:23,  2.10s/it, lr: 1.0e-04 loss: 1.699e-01]
my_first_lora_v6:  92%|#########2| 3232/3500 [43:12<09:23,  2.10s/it, lr: 1.0e-04 loss: 1.699e-01]
my_first_lora_v6:  92%|#########2| 3233/3500 [43:15<09:21,  2.10s/it, lr: 1.0e-04 loss: 1.005e-01]
my_first_lora_v6:  92%|#########2| 3233/3500 [43:15<09:21,  2.10s/it, lr: 1.0e-04 loss: 1.005e-01]
my_first_lora_v6:  92%|#########2| 3234/3500 [43:17<09:19,  2.10s/it, lr: 1.0e-04 loss: 2.455e-01]
my_first_lora_v6:  92%|#########2| 3234/3500 [43:17<09:19,  2.10s/it, lr: 1.0e-04 loss: 2.455e-01]
my_first_lora_v6:  92%|#########2| 3235/3500 [43:18<09:17,  2.10s/it, lr: 1.0e-04 loss: 6.452e-02]
my_first_lora_v6:  92%|#########2| 3235/3500 [43:18<09:17,  2.10s/it, lr: 1.0e-04 loss: 6.452e-02]
my_first_lora_v6:  92%|#########2| 3236/3500 [43:20<09:15,  2.10s/it, lr: 1.0e-04 loss: 8.032e-01]
my_first_lora_v6:  92%|#########2| 3236/3500 [43:20<09:15,  2.10s/it, lr: 1.0e-04 loss: 8.032e-01]
my_first_lora_v6:  92%|#########2| 3237/3500 [43:23<09:13,  2.10s/it, lr: 1.0e-04 loss: 6.253e-01]
my_first_lora_v6:  92%|#########2| 3237/3500 [43:23<09:13,  2.10s/it, lr: 1.0e-04 loss: 6.253e-01]
my_first_lora_v6:  93%|#########2| 3238/3500 [43:24<09:11,  2.10s/it, lr: 1.0e-04 loss: 2.018e-01]
my_first_lora_v6:  93%|#########2| 3238/3500 [43:24<09:11,  2.10s/it, lr: 1.0e-04 loss: 2.018e-01]
my_first_lora_v6:  93%|#########2| 3239/3500 [43:27<09:09,  2.10s/it, lr: 1.0e-04 loss: 3.062e-01]
my_first_lora_v6:  93%|#########2| 3239/3500 [43:27<09:09,  2.10s/it, lr: 1.0e-04 loss: 3.062e-01]
my_first_lora_v6:  93%|#########2| 3240/3500 [43:30<09:07,  2.11s/it, lr: 1.0e-04 loss: 6.298e-01]
my_first_lora_v6:  93%|#########2| 3240/3500 [43:30<09:07,  2.11s/it, lr: 1.0e-04 loss: 6.298e-01]
my_first_lora_v6:  93%|#########2| 3241/3500 [43:32<09:05,  2.11s/it, lr: 1.0e-04 loss: 5.245e-01]
my_first_lora_v6:  93%|#########2| 3241/3500 [43:32<09:05,  2.11s/it, lr: 1.0e-04 loss: 5.245e-01]
my_first_lora_v6:  93%|#########2| 3242/3500 [43:34<09:03,  2.11s/it, lr: 1.0e-04 loss: 6.354e-02]
my_first_lora_v6:  93%|#########2| 3242/3500 [43:34<09:03,  2.11s/it, lr: 1.0e-04 loss: 6.354e-02]
my_first_lora_v6:  93%|#########2| 3243/3500 [43:37<09:01,  2.11s/it, lr: 1.0e-04 loss: 4.591e-01]
my_first_lora_v6:  93%|#########2| 3243/3500 [43:37<09:01,  2.11s/it, lr: 1.0e-04 loss: 4.591e-01]
my_first_lora_v6:  93%|#########2| 3244/3500 [43:39<08:59,  2.11s/it, lr: 1.0e-04 loss: 2.909e-01]
my_first_lora_v6:  93%|#########2| 3244/3500 [43:39<08:59,  2.11s/it, lr: 1.0e-04 loss: 2.909e-01]
my_first_lora_v6:  93%|#########2| 3245/3500 [43:41<08:56,  2.11s/it, lr: 1.0e-04 loss: 6.691e-01]
my_first_lora_v6:  93%|#########2| 3245/3500 [43:41<08:56,  2.11s/it, lr: 1.0e-04 loss: 6.691e-01]
my_first_lora_v6:  93%|#########2| 3246/3500 [43:42<08:54,  2.10s/it, lr: 1.0e-04 loss: 4.973e-02]
my_first_lora_v6:  93%|#########2| 3246/3500 [43:42<08:54,  2.10s/it, lr: 1.0e-04 loss: 4.973e-02]
my_first_lora_v6:  93%|#########2| 3247/3500 [43:44<08:52,  2.10s/it, lr: 1.0e-04 loss: 4.013e-02]
my_first_lora_v6:  93%|#########2| 3247/3500 [43:44<08:52,  2.10s/it, lr: 1.0e-04 loss: 4.013e-02]
my_first_lora_v6:  93%|#########2| 3248/3500 [43:46<08:50,  2.10s/it, lr: 1.0e-04 loss: 1.337e-01]
my_first_lora_v6:  93%|#########2| 3248/3500 [43:46<08:50,  2.10s/it, lr: 1.0e-04 loss: 1.337e-01]
my_first_lora_v6:  93%|#########2| 3249/3500 [43:49<08:48,  2.11s/it, lr: 1.0e-04 loss: 8.088e-01]
my_first_lora_v6:  93%|#########2| 3249/3500 [43:49<08:48,  2.11s/it, lr: 1.0e-04 loss: 8.088e-01]Unloading assistant lora



Generating Images:   0%|          | 0/5 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/5 [00:00<?, ?it/s]


Generating Images:  20%|##        | 1/5 [00:07<00:31,  7.95s/it]
Generating Images:  20%|##        | 1/5 [00:07<00:31,  7.95s/it]


Generating Images:  40%|####      | 2/5 [00:15<00:23,  7.86s/it]
Generating Images:  40%|####      | 2/5 [00:15<00:23,  7.86s/it]


Generating Images:  60%|######    | 3/5 [00:23<00:15,  7.76s/it]
Generating Images:  60%|######    | 3/5 [00:23<00:15,  7.76s/it]


Generating Images:  80%|########  | 4/5 [00:31<00:07,  7.76s/it]
Generating Images:  80%|########  | 4/5 [00:31<00:07,  7.76s/it]


Generating Images: 100%|##########| 5/5 [00:39<00:00,  7.80s/it]
Generating Images: 100%|##########| 5/5 [00:39<00:00,  7.80s/it]


                                                                
                                                                Loading assistant lora

my_first_lora_v6:  93%|#########2| 3250/3500 [43:50<08:46,  2.10s/it, lr: 1.0e-04 loss: 6.928e-03]
my_first_lora_v6:  93%|#########2| 3250/3500 [43:50<08:46,  2.10s/it, lr: 1.0e-04 loss: 6.928e-03]
my_first_lora_v6:  93%|#########2| 3251/3500 [43:51<08:43,  2.10s/it, lr: 1.0e-04 loss: 7.130e-01]
my_first_lora_v6:  93%|#########2| 3251/3500 [43:51<08:43,  2.10s/it, lr: 1.0e-04 loss: 7.130e-01]
my_first_lora_v6:  93%|#########2| 3252/3500 [43:53<08:41,  2.10s/it, lr: 1.0e-04 loss: 7.844e-01]
my_first_lora_v6:  93%|#########2| 3252/3500 [43:53<08:41,  2.10s/it, lr: 1.0e-04 loss: 7.844e-01]
my_first_lora_v6:  93%|#########2| 3253/3500 [43:56<08:39,  2.10s/it, lr: 1.0e-04 loss: 8.185e-01]
my_first_lora_v6:  93%|#########2| 3253/3500 [43:56<08:39,  2.10s/it, lr: 1.0e-04 loss: 8.185e-01]
my_first_lora_v6:  93%|#########2| 3254/3500 [43:58<08:37,  2.10s/it, lr: 1.0e-04 loss: 3.395e-01]
my_first_lora_v6:  93%|#########2| 3254/3500 [43:58<08:37,  2.10s/it, lr: 1.0e-04 loss: 3.395e-01]
my_first_lora_v6:  93%|#########3| 3255/3500 [44:01<08:35,  2.10s/it, lr: 1.0e-04 loss: 9.959e-02]
my_first_lora_v6:  93%|#########3| 3255/3500 [44:01<08:35,  2.10s/it, lr: 1.0e-04 loss: 9.959e-02]
my_first_lora_v6:  93%|#########3| 3256/3500 [44:03<08:33,  2.10s/it, lr: 1.0e-04 loss: 8.655e-02]
my_first_lora_v6:  93%|#########3| 3256/3500 [44:03<08:33,  2.10s/it, lr: 1.0e-04 loss: 8.655e-02]
my_first_lora_v6:  93%|#########3| 3257/3500 [44:05<08:31,  2.10s/it, lr: 1.0e-04 loss: 5.675e-01]
my_first_lora_v6:  93%|#########3| 3257/3500 [44:05<08:31,  2.10s/it, lr: 1.0e-04 loss: 5.675e-01]
my_first_lora_v6:  93%|#########3| 3258/3500 [44:08<08:29,  2.11s/it, lr: 1.0e-04 loss: 1.075e-02]
my_first_lora_v6:  93%|#########3| 3258/3500 [44:08<08:29,  2.11s/it, lr: 1.0e-04 loss: 1.075e-02]
my_first_lora_v6:  93%|#########3| 3259/3500 [44:09<08:27,  2.10s/it, lr: 1.0e-04 loss: 1.969e-01]
my_first_lora_v6:  93%|#########3| 3259/3500 [44:09<08:27,  2.10s/it, lr: 1.0e-04 loss: 1.969e-01]
my_first_lora_v6:  93%|#########3| 3260/3500 [44:11<08:25,  2.10s/it, lr: 1.0e-04 loss: 3.985e-01]
my_first_lora_v6:  93%|#########3| 3260/3500 [44:11<08:25,  2.10s/it, lr: 1.0e-04 loss: 3.985e-01]
my_first_lora_v6:  93%|#########3| 3261/3500 [44:12<08:22,  2.10s/it, lr: 1.0e-04 loss: 3.314e-01]
my_first_lora_v6:  93%|#########3| 3261/3500 [44:12<08:22,  2.10s/it, lr: 1.0e-04 loss: 3.314e-01]
my_first_lora_v6:  93%|#########3| 3262/3500 [44:14<08:20,  2.10s/it, lr: 1.0e-04 loss: 1.467e-01]
my_first_lora_v6:  93%|#########3| 3262/3500 [44:14<08:20,  2.10s/it, lr: 1.0e-04 loss: 1.467e-01]
my_first_lora_v6:  93%|#########3| 3263/3500 [44:17<08:18,  2.10s/it, lr: 1.0e-04 loss: 3.886e-01]
my_first_lora_v6:  93%|#########3| 3263/3500 [44:17<08:18,  2.10s/it, lr: 1.0e-04 loss: 3.886e-01]
my_first_lora_v6:  93%|#########3| 3264/3500 [44:19<08:16,  2.10s/it, lr: 1.0e-04 loss: 7.192e-01]
my_first_lora_v6:  93%|#########3| 3264/3500 [44:19<08:16,  2.10s/it, lr: 1.0e-04 loss: 7.192e-01]
my_first_lora_v6:  93%|#########3| 3265/3500 [44:21<08:14,  2.10s/it, lr: 1.0e-04 loss: 1.600e-01]
my_first_lora_v6:  93%|#########3| 3265/3500 [44:21<08:14,  2.10s/it, lr: 1.0e-04 loss: 1.600e-01]
my_first_lora_v6:  93%|#########3| 3266/3500 [44:24<08:12,  2.10s/it, lr: 1.0e-04 loss: 5.207e-01]
my_first_lora_v6:  93%|#########3| 3266/3500 [44:24<08:12,  2.10s/it, lr: 1.0e-04 loss: 5.207e-01]
my_first_lora_v6:  93%|#########3| 3267/3500 [44:27<08:10,  2.11s/it, lr: 1.0e-04 loss: 4.404e-01]
my_first_lora_v6:  93%|#########3| 3267/3500 [44:27<08:10,  2.11s/it, lr: 1.0e-04 loss: 4.404e-01]
my_first_lora_v6:  93%|#########3| 3268/3500 [44:29<08:08,  2.11s/it, lr: 1.0e-04 loss: 4.468e-01]
my_first_lora_v6:  93%|#########3| 3268/3500 [44:29<08:08,  2.11s/it, lr: 1.0e-04 loss: 4.468e-01]
my_first_lora_v6:  93%|#########3| 3269/3500 [44:31<08:06,  2.11s/it, lr: 1.0e-04 loss: 3.858e-01]
my_first_lora_v6:  93%|#########3| 3269/3500 [44:31<08:06,  2.11s/it, lr: 1.0e-04 loss: 3.858e-01]
my_first_lora_v6:  93%|#########3| 3270/3500 [44:33<08:04,  2.11s/it, lr: 1.0e-04 loss: 9.658e-02]
my_first_lora_v6:  93%|#########3| 3270/3500 [44:33<08:04,  2.11s/it, lr: 1.0e-04 loss: 9.658e-02]
my_first_lora_v6:  93%|#########3| 3271/3500 [44:36<08:02,  2.11s/it, lr: 1.0e-04 loss: 1.301e-01]
my_first_lora_v6:  93%|#########3| 3271/3500 [44:36<08:02,  2.11s/it, lr: 1.0e-04 loss: 1.301e-01]
my_first_lora_v6:  93%|#########3| 3272/3500 [44:39<08:00,  2.11s/it, lr: 1.0e-04 loss: 4.672e-01]
my_first_lora_v6:  93%|#########3| 3272/3500 [44:39<08:00,  2.11s/it, lr: 1.0e-04 loss: 4.672e-01]
my_first_lora_v6:  94%|#########3| 3273/3500 [44:40<07:57,  2.11s/it, lr: 1.0e-04 loss: 1.368e-01]
my_first_lora_v6:  94%|#########3| 3273/3500 [44:40<07:57,  2.11s/it, lr: 1.0e-04 loss: 1.368e-01]
my_first_lora_v6:  94%|#########3| 3274/3500 [44:41<07:55,  2.10s/it, lr: 1.0e-04 loss: 3.515e-01]
my_first_lora_v6:  94%|#########3| 3274/3500 [44:41<07:55,  2.10s/it, lr: 1.0e-04 loss: 3.515e-01]
my_first_lora_v6:  94%|#########3| 3275/3500 [44:43<07:53,  2.10s/it, lr: 1.0e-04 loss: 5.736e-02]
my_first_lora_v6:  94%|#########3| 3275/3500 [44:43<07:53,  2.10s/it, lr: 1.0e-04 loss: 5.736e-02]
my_first_lora_v6:  94%|#########3| 3276/3500 [44:46<07:51,  2.11s/it, lr: 1.0e-04 loss: 4.940e-01]
my_first_lora_v6:  94%|#########3| 3276/3500 [44:46<07:51,  2.11s/it, lr: 1.0e-04 loss: 4.940e-01]
my_first_lora_v6:  94%|#########3| 3277/3500 [44:47<07:49,  2.10s/it, lr: 1.0e-04 loss: 7.631e-01]
my_first_lora_v6:  94%|#########3| 3277/3500 [44:47<07:49,  2.10s/it, lr: 1.0e-04 loss: 7.631e-01]
my_first_lora_v6:  94%|#########3| 3278/3500 [44:50<07:47,  2.11s/it, lr: 1.0e-04 loss: 1.063e-01]
my_first_lora_v6:  94%|#########3| 3278/3500 [44:50<07:47,  2.11s/it, lr: 1.0e-04 loss: 1.063e-01]
my_first_lora_v6:  94%|#########3| 3279/3500 [44:52<07:45,  2.11s/it, lr: 1.0e-04 loss: 8.256e-01]
my_first_lora_v6:  94%|#########3| 3279/3500 [44:52<07:45,  2.11s/it, lr: 1.0e-04 loss: 8.256e-01]
my_first_lora_v6:  94%|#########3| 3280/3500 [44:55<07:43,  2.11s/it, lr: 1.0e-04 loss: 5.569e-01]
my_first_lora_v6:  94%|#########3| 3280/3500 [44:55<07:43,  2.11s/it, lr: 1.0e-04 loss: 5.569e-01]
my_first_lora_v6:  94%|#########3| 3281/3500 [44:57<07:41,  2.11s/it, lr: 1.0e-04 loss: 7.501e-01]
my_first_lora_v6:  94%|#########3| 3281/3500 [44:57<07:41,  2.11s/it, lr: 1.0e-04 loss: 7.501e-01]
my_first_lora_v6:  94%|#########3| 3282/3500 [44:59<07:38,  2.11s/it, lr: 1.0e-04 loss: 4.260e-01]
my_first_lora_v6:  94%|#########3| 3282/3500 [44:59<07:38,  2.11s/it, lr: 1.0e-04 loss: 4.260e-01]
my_first_lora_v6:  94%|#########3| 3283/3500 [45:01<07:36,  2.11s/it, lr: 1.0e-04 loss: 7.756e-01]
my_first_lora_v6:  94%|#########3| 3283/3500 [45:01<07:36,  2.11s/it, lr: 1.0e-04 loss: 7.756e-01]
my_first_lora_v6:  94%|#########3| 3284/3500 [45:02<07:34,  2.10s/it, lr: 1.0e-04 loss: 1.702e-01]
my_first_lora_v6:  94%|#########3| 3284/3500 [45:02<07:34,  2.10s/it, lr: 1.0e-04 loss: 1.702e-01]
my_first_lora_v6:  94%|#########3| 3285/3500 [45:05<07:32,  2.11s/it, lr: 1.0e-04 loss: 7.469e-01]
my_first_lora_v6:  94%|#########3| 3285/3500 [45:05<07:32,  2.11s/it, lr: 1.0e-04 loss: 7.469e-01]
my_first_lora_v6:  94%|#########3| 3286/3500 [45:08<07:30,  2.11s/it, lr: 1.0e-04 loss: 4.897e-02]
my_first_lora_v6:  94%|#########3| 3286/3500 [45:08<07:30,  2.11s/it, lr: 1.0e-04 loss: 4.897e-02]
my_first_lora_v6:  94%|#########3| 3287/3500 [45:10<07:28,  2.11s/it, lr: 1.0e-04 loss: 3.708e-01]
my_first_lora_v6:  94%|#########3| 3287/3500 [45:10<07:28,  2.11s/it, lr: 1.0e-04 loss: 3.708e-01]
my_first_lora_v6:  94%|#########3| 3288/3500 [45:11<07:26,  2.11s/it, lr: 1.0e-04 loss: 1.955e-01]
my_first_lora_v6:  94%|#########3| 3288/3500 [45:11<07:26,  2.11s/it, lr: 1.0e-04 loss: 1.955e-01]
my_first_lora_v6:  94%|#########3| 3289/3500 [45:14<07:24,  2.11s/it, lr: 1.0e-04 loss: 2.589e-01]
my_first_lora_v6:  94%|#########3| 3289/3500 [45:14<07:24,  2.11s/it, lr: 1.0e-04 loss: 2.589e-01]
my_first_lora_v6:  94%|#########3| 3290/3500 [45:15<07:22,  2.10s/it, lr: 1.0e-04 loss: 1.756e-02]
my_first_lora_v6:  94%|#########3| 3290/3500 [45:15<07:22,  2.10s/it, lr: 1.0e-04 loss: 1.756e-02]
my_first_lora_v6:  94%|#########4| 3291/3500 [45:17<07:19,  2.11s/it, lr: 1.0e-04 loss: 7.481e-01]
my_first_lora_v6:  94%|#########4| 3291/3500 [45:17<07:19,  2.11s/it, lr: 1.0e-04 loss: 7.481e-01]
my_first_lora_v6:  94%|#########4| 3292/3500 [45:20<07:17,  2.11s/it, lr: 1.0e-04 loss: 6.763e-02]
my_first_lora_v6:  94%|#########4| 3292/3500 [45:20<07:17,  2.11s/it, lr: 1.0e-04 loss: 6.763e-02]
my_first_lora_v6:  94%|#########4| 3293/3500 [45:22<07:15,  2.11s/it, lr: 1.0e-04 loss: 4.501e-02]
my_first_lora_v6:  94%|#########4| 3293/3500 [45:22<07:15,  2.11s/it, lr: 1.0e-04 loss: 4.501e-02]
my_first_lora_v6:  94%|#########4| 3294/3500 [45:24<07:13,  2.11s/it, lr: 1.0e-04 loss: 3.165e-01]
my_first_lora_v6:  94%|#########4| 3294/3500 [45:24<07:13,  2.11s/it, lr: 1.0e-04 loss: 3.165e-01]
my_first_lora_v6:  94%|#########4| 3295/3500 [45:27<07:11,  2.11s/it, lr: 1.0e-04 loss: 1.730e-01]
my_first_lora_v6:  94%|#########4| 3295/3500 [45:27<07:11,  2.11s/it, lr: 1.0e-04 loss: 1.730e-01]
my_first_lora_v6:  94%|#########4| 3296/3500 [45:28<07:09,  2.11s/it, lr: 1.0e-04 loss: 4.583e-01]
my_first_lora_v6:  94%|#########4| 3296/3500 [45:28<07:09,  2.11s/it, lr: 1.0e-04 loss: 4.583e-01]
my_first_lora_v6:  94%|#########4| 3297/3500 [45:31<07:07,  2.11s/it, lr: 1.0e-04 loss: 1.595e-01]
my_first_lora_v6:  94%|#########4| 3297/3500 [45:31<07:07,  2.11s/it, lr: 1.0e-04 loss: 1.595e-01]
my_first_lora_v6:  94%|#########4| 3298/3500 [45:32<07:05,  2.11s/it, lr: 1.0e-04 loss: 1.808e-01]
my_first_lora_v6:  94%|#########4| 3298/3500 [45:32<07:05,  2.11s/it, lr: 1.0e-04 loss: 1.808e-01]
my_first_lora_v6:  94%|#########4| 3299/3500 [45:33<07:03,  2.10s/it, lr: 1.0e-04 loss: 5.966e-01]
my_first_lora_v6:  94%|#########4| 3299/3500 [45:33<07:03,  2.10s/it, lr: 1.0e-04 loss: 5.966e-01]
my_first_lora_v6:  94%|#########4| 3300/3500 [45:36<07:00,  2.10s/it, lr: 1.0e-04 loss: 7.227e-01]
my_first_lora_v6:  94%|#########4| 3300/3500 [45:36<07:00,  2.10s/it, lr: 1.0e-04 loss: 7.227e-01]
my_first_lora_v6:  94%|#########4| 3301/3500 [45:38<06:58,  2.11s/it, lr: 1.0e-04 loss: 6.934e-01]
my_first_lora_v6:  94%|#########4| 3301/3500 [45:38<06:58,  2.11s/it, lr: 1.0e-04 loss: 6.934e-01]
my_first_lora_v6:  94%|#########4| 3302/3500 [45:41<06:56,  2.11s/it, lr: 1.0e-04 loss: 6.777e-01]
my_first_lora_v6:  94%|#########4| 3302/3500 [45:41<06:56,  2.11s/it, lr: 1.0e-04 loss: 6.777e-01]
my_first_lora_v6:  94%|#########4| 3303/3500 [45:43<06:54,  2.11s/it, lr: 1.0e-04 loss: 5.951e-01]
my_first_lora_v6:  94%|#########4| 3303/3500 [45:43<06:54,  2.11s/it, lr: 1.0e-04 loss: 5.951e-01]
my_first_lora_v6:  94%|#########4| 3304/3500 [45:46<06:52,  2.11s/it, lr: 1.0e-04 loss: 1.834e-01]
my_first_lora_v6:  94%|#########4| 3304/3500 [45:46<06:52,  2.11s/it, lr: 1.0e-04 loss: 1.834e-01]
my_first_lora_v6:  94%|#########4| 3305/3500 [45:47<06:50,  2.11s/it, lr: 1.0e-04 loss: 3.391e-01]
my_first_lora_v6:  94%|#########4| 3305/3500 [45:47<06:50,  2.11s/it, lr: 1.0e-04 loss: 3.391e-01]
my_first_lora_v6:  94%|#########4| 3306/3500 [45:50<06:48,  2.11s/it, lr: 1.0e-04 loss: 7.242e-01]
my_first_lora_v6:  94%|#########4| 3306/3500 [45:50<06:48,  2.11s/it, lr: 1.0e-04 loss: 7.242e-01]
my_first_lora_v6:  94%|#########4| 3307/3500 [45:51<06:46,  2.11s/it, lr: 1.0e-04 loss: 7.932e-01]
my_first_lora_v6:  94%|#########4| 3307/3500 [45:51<06:46,  2.11s/it, lr: 1.0e-04 loss: 7.932e-01]
my_first_lora_v6:  95%|#########4| 3308/3500 [45:54<06:44,  2.11s/it, lr: 1.0e-04 loss: 3.965e-01]
my_first_lora_v6:  95%|#########4| 3308/3500 [45:54<06:44,  2.11s/it, lr: 1.0e-04 loss: 3.965e-01]
my_first_lora_v6:  95%|#########4| 3309/3500 [45:56<06:42,  2.11s/it, lr: 1.0e-04 loss: 3.961e-02]
my_first_lora_v6:  95%|#########4| 3309/3500 [45:56<06:42,  2.11s/it, lr: 1.0e-04 loss: 3.961e-02]
my_first_lora_v6:  95%|#########4| 3310/3500 [45:59<06:40,  2.11s/it, lr: 1.0e-04 loss: 3.599e-01]
my_first_lora_v6:  95%|#########4| 3310/3500 [45:59<06:40,  2.11s/it, lr: 1.0e-04 loss: 3.599e-01]
my_first_lora_v6:  95%|#########4| 3311/3500 [46:00<06:37,  2.11s/it, lr: 1.0e-04 loss: 1.013e-01]
my_first_lora_v6:  95%|#########4| 3311/3500 [46:00<06:37,  2.11s/it, lr: 1.0e-04 loss: 1.013e-01]
my_first_lora_v6:  95%|#########4| 3312/3500 [46:02<06:35,  2.11s/it, lr: 1.0e-04 loss: 3.526e-01]
my_first_lora_v6:  95%|#########4| 3312/3500 [46:02<06:35,  2.11s/it, lr: 1.0e-04 loss: 3.526e-01]
my_first_lora_v6:  95%|#########4| 3313/3500 [46:03<06:33,  2.10s/it, lr: 1.0e-04 loss: 3.334e-01]
my_first_lora_v6:  95%|#########4| 3313/3500 [46:03<06:33,  2.10s/it, lr: 1.0e-04 loss: 3.334e-01]
my_first_lora_v6:  95%|#########4| 3314/3500 [46:05<06:31,  2.10s/it, lr: 1.0e-04 loss: 4.453e-01]
my_first_lora_v6:  95%|#########4| 3314/3500 [46:05<06:31,  2.10s/it, lr: 1.0e-04 loss: 4.453e-01]
my_first_lora_v6:  95%|#########4| 3315/3500 [46:08<06:29,  2.11s/it, lr: 1.0e-04 loss: 2.900e-01]
my_first_lora_v6:  95%|#########4| 3315/3500 [46:08<06:29,  2.11s/it, lr: 1.0e-04 loss: 2.900e-01]
my_first_lora_v6:  95%|#########4| 3316/3500 [46:10<06:27,  2.11s/it, lr: 1.0e-04 loss: 1.813e-01]
my_first_lora_v6:  95%|#########4| 3316/3500 [46:10<06:27,  2.11s/it, lr: 1.0e-04 loss: 1.813e-01]
my_first_lora_v6:  95%|#########4| 3317/3500 [46:11<06:25,  2.10s/it, lr: 1.0e-04 loss: 7.901e-01]
my_first_lora_v6:  95%|#########4| 3317/3500 [46:11<06:25,  2.10s/it, lr: 1.0e-04 loss: 7.901e-01]
my_first_lora_v6:  95%|#########4| 3318/3500 [46:14<06:23,  2.11s/it, lr: 1.0e-04 loss: 7.893e-01]
my_first_lora_v6:  95%|#########4| 3318/3500 [46:14<06:23,  2.11s/it, lr: 1.0e-04 loss: 7.893e-01]
my_first_lora_v6:  95%|#########4| 3319/3500 [46:16<06:20,  2.10s/it, lr: 1.0e-04 loss: 6.661e-01]
my_first_lora_v6:  95%|#########4| 3319/3500 [46:16<06:20,  2.10s/it, lr: 1.0e-04 loss: 6.661e-01]
my_first_lora_v6:  95%|#########4| 3320/3500 [46:18<06:18,  2.11s/it, lr: 1.0e-04 loss: 6.502e-01]
my_first_lora_v6:  95%|#########4| 3320/3500 [46:18<06:18,  2.11s/it, lr: 1.0e-04 loss: 6.502e-01]
my_first_lora_v6:  95%|#########4| 3321/3500 [46:21<06:16,  2.11s/it, lr: 1.0e-04 loss: 1.178e-01]
my_first_lora_v6:  95%|#########4| 3321/3500 [46:21<06:16,  2.11s/it, lr: 1.0e-04 loss: 1.178e-01]
my_first_lora_v6:  95%|#########4| 3322/3500 [46:24<06:14,  2.11s/it, lr: 1.0e-04 loss: 7.018e-01]
my_first_lora_v6:  95%|#########4| 3322/3500 [46:24<06:14,  2.11s/it, lr: 1.0e-04 loss: 7.018e-01]
my_first_lora_v6:  95%|#########4| 3323/3500 [46:26<06:12,  2.11s/it, lr: 1.0e-04 loss: 7.642e-01]
my_first_lora_v6:  95%|#########4| 3323/3500 [46:26<06:12,  2.11s/it, lr: 1.0e-04 loss: 7.642e-01]
my_first_lora_v6:  95%|#########4| 3324/3500 [46:29<06:10,  2.11s/it, lr: 1.0e-04 loss: 7.316e-01]
my_first_lora_v6:  95%|#########4| 3324/3500 [46:29<06:10,  2.11s/it, lr: 1.0e-04 loss: 7.316e-01]
my_first_lora_v6:  95%|#########5| 3325/3500 [46:31<06:08,  2.11s/it, lr: 1.0e-04 loss: 4.698e-01]
my_first_lora_v6:  95%|#########5| 3325/3500 [46:31<06:08,  2.11s/it, lr: 1.0e-04 loss: 4.698e-01]
my_first_lora_v6:  95%|#########5| 3326/3500 [46:32<06:06,  2.11s/it, lr: 1.0e-04 loss: 5.570e-01]
my_first_lora_v6:  95%|#########5| 3326/3500 [46:32<06:06,  2.11s/it, lr: 1.0e-04 loss: 5.570e-01]
my_first_lora_v6:  95%|#########5| 3327/3500 [46:33<06:04,  2.11s/it, lr: 1.0e-04 loss: 6.612e-01]
my_first_lora_v6:  95%|#########5| 3327/3500 [46:33<06:04,  2.11s/it, lr: 1.0e-04 loss: 6.612e-01]
my_first_lora_v6:  95%|#########5| 3328/3500 [46:36<06:02,  2.11s/it, lr: 1.0e-04 loss: 1.416e-01]
my_first_lora_v6:  95%|#########5| 3328/3500 [46:36<06:02,  2.11s/it, lr: 1.0e-04 loss: 1.416e-01]
my_first_lora_v6:  95%|#########5| 3329/3500 [46:38<06:00,  2.11s/it, lr: 1.0e-04 loss: 2.316e-01]
my_first_lora_v6:  95%|#########5| 3329/3500 [46:38<06:00,  2.11s/it, lr: 1.0e-04 loss: 2.316e-01]
my_first_lora_v6:  95%|#########5| 3330/3500 [46:40<05:57,  2.11s/it, lr: 1.0e-04 loss: 1.300e-01]
my_first_lora_v6:  95%|#########5| 3330/3500 [46:40<05:57,  2.11s/it, lr: 1.0e-04 loss: 1.300e-01]
my_first_lora_v6:  95%|#########5| 3331/3500 [46:41<05:55,  2.11s/it, lr: 1.0e-04 loss: 6.234e-01]
my_first_lora_v6:  95%|#########5| 3331/3500 [46:41<05:55,  2.11s/it, lr: 1.0e-04 loss: 6.234e-01]
my_first_lora_v6:  95%|#########5| 3332/3500 [46:44<05:53,  2.11s/it, lr: 1.0e-04 loss: 8.664e-02]
my_first_lora_v6:  95%|#########5| 3332/3500 [46:44<05:53,  2.11s/it, lr: 1.0e-04 loss: 8.664e-02]
my_first_lora_v6:  95%|#########5| 3333/3500 [46:46<05:51,  2.11s/it, lr: 1.0e-04 loss: 1.969e-01]
my_first_lora_v6:  95%|#########5| 3333/3500 [46:46<05:51,  2.11s/it, lr: 1.0e-04 loss: 1.969e-01]
my_first_lora_v6:  95%|#########5| 3334/3500 [46:49<05:49,  2.11s/it, lr: 1.0e-04 loss: 6.884e-01]
my_first_lora_v6:  95%|#########5| 3334/3500 [46:49<05:49,  2.11s/it, lr: 1.0e-04 loss: 6.884e-01]
my_first_lora_v6:  95%|#########5| 3335/3500 [46:50<05:47,  2.11s/it, lr: 1.0e-04 loss: 6.101e-01]
my_first_lora_v6:  95%|#########5| 3335/3500 [46:50<05:47,  2.11s/it, lr: 1.0e-04 loss: 6.101e-01]
my_first_lora_v6:  95%|#########5| 3336/3500 [46:53<05:45,  2.11s/it, lr: 1.0e-04 loss: 7.011e-01]
my_first_lora_v6:  95%|#########5| 3336/3500 [46:53<05:45,  2.11s/it, lr: 1.0e-04 loss: 7.011e-01]
my_first_lora_v6:  95%|#########5| 3337/3500 [46:54<05:43,  2.11s/it, lr: 1.0e-04 loss: 3.255e-01]
my_first_lora_v6:  95%|#########5| 3337/3500 [46:54<05:43,  2.11s/it, lr: 1.0e-04 loss: 3.255e-01]
my_first_lora_v6:  95%|#########5| 3338/3500 [46:56<05:41,  2.11s/it, lr: 1.0e-04 loss: 2.054e-01]
my_first_lora_v6:  95%|#########5| 3338/3500 [46:56<05:41,  2.11s/it, lr: 1.0e-04 loss: 2.054e-01]
my_first_lora_v6:  95%|#########5| 3339/3500 [46:59<05:39,  2.11s/it, lr: 1.0e-04 loss: 7.380e-01]
my_first_lora_v6:  95%|#########5| 3339/3500 [46:59<05:39,  2.11s/it, lr: 1.0e-04 loss: 7.380e-01]
my_first_lora_v6:  95%|#########5| 3340/3500 [47:02<05:36,  2.11s/it, lr: 1.0e-04 loss: 1.053e-01]
my_first_lora_v6:  95%|#########5| 3340/3500 [47:02<05:36,  2.11s/it, lr: 1.0e-04 loss: 1.053e-01]
my_first_lora_v6:  95%|#########5| 3341/3500 [47:04<05:34,  2.11s/it, lr: 1.0e-04 loss: 4.908e-01]
my_first_lora_v6:  95%|#########5| 3341/3500 [47:04<05:34,  2.11s/it, lr: 1.0e-04 loss: 4.908e-01]
my_first_lora_v6:  95%|#########5| 3342/3500 [47:06<05:32,  2.11s/it, lr: 1.0e-04 loss: 7.465e-01]
my_first_lora_v6:  95%|#########5| 3342/3500 [47:06<05:32,  2.11s/it, lr: 1.0e-04 loss: 7.465e-01]
my_first_lora_v6:  96%|#########5| 3343/3500 [47:09<05:30,  2.11s/it, lr: 1.0e-04 loss: 7.280e-01]
my_first_lora_v6:  96%|#########5| 3343/3500 [47:09<05:30,  2.11s/it, lr: 1.0e-04 loss: 7.280e-01]
my_first_lora_v6:  96%|#########5| 3344/3500 [47:11<05:28,  2.11s/it, lr: 1.0e-04 loss: 5.250e-01]
my_first_lora_v6:  96%|#########5| 3344/3500 [47:11<05:28,  2.11s/it, lr: 1.0e-04 loss: 5.250e-01]
my_first_lora_v6:  96%|#########5| 3345/3500 [47:14<05:26,  2.11s/it, lr: 1.0e-04 loss: 7.658e-01]
my_first_lora_v6:  96%|#########5| 3345/3500 [47:14<05:26,  2.11s/it, lr: 1.0e-04 loss: 7.658e-01]
my_first_lora_v6:  96%|#########5| 3346/3500 [47:16<05:24,  2.11s/it, lr: 1.0e-04 loss: 7.230e-01]
my_first_lora_v6:  96%|#########5| 3346/3500 [47:16<05:24,  2.11s/it, lr: 1.0e-04 loss: 7.230e-01]
my_first_lora_v6:  96%|#########5| 3347/3500 [47:17<05:22,  2.11s/it, lr: 1.0e-04 loss: 7.025e-01]
my_first_lora_v6:  96%|#########5| 3347/3500 [47:17<05:22,  2.11s/it, lr: 1.0e-04 loss: 7.025e-01]
my_first_lora_v6:  96%|#########5| 3348/3500 [47:18<05:20,  2.11s/it, lr: 1.0e-04 loss: 7.506e-01]
my_first_lora_v6:  96%|#########5| 3348/3500 [47:18<05:20,  2.11s/it, lr: 1.0e-04 loss: 7.506e-01]
my_first_lora_v6:  96%|#########5| 3349/3500 [47:21<05:18,  2.11s/it, lr: 1.0e-04 loss: 5.841e-01]
my_first_lora_v6:  96%|#########5| 3349/3500 [47:21<05:18,  2.11s/it, lr: 1.0e-04 loss: 5.841e-01]
my_first_lora_v6:  96%|#########5| 3350/3500 [47:22<05:15,  2.11s/it, lr: 1.0e-04 loss: 7.415e-01]
my_first_lora_v6:  96%|#########5| 3350/3500 [47:22<05:15,  2.11s/it, lr: 1.0e-04 loss: 7.415e-01]
my_first_lora_v6:  96%|#########5| 3351/3500 [47:24<05:13,  2.11s/it, lr: 1.0e-04 loss: 1.880e-01]
my_first_lora_v6:  96%|#########5| 3351/3500 [47:24<05:13,  2.11s/it, lr: 1.0e-04 loss: 1.880e-01]
my_first_lora_v6:  96%|#########5| 3352/3500 [47:27<05:11,  2.11s/it, lr: 1.0e-04 loss: 6.145e-01]
my_first_lora_v6:  96%|#########5| 3352/3500 [47:27<05:11,  2.11s/it, lr: 1.0e-04 loss: 6.145e-01]
my_first_lora_v6:  96%|#########5| 3353/3500 [47:29<05:09,  2.11s/it, lr: 1.0e-04 loss: 6.900e-01]
my_first_lora_v6:  96%|#########5| 3353/3500 [47:29<05:09,  2.11s/it, lr: 1.0e-04 loss: 6.900e-01]
my_first_lora_v6:  96%|#########5| 3354/3500 [47:30<05:07,  2.11s/it, lr: 1.0e-04 loss: 5.077e-01]
my_first_lora_v6:  96%|#########5| 3354/3500 [47:30<05:07,  2.11s/it, lr: 1.0e-04 loss: 5.077e-01]
my_first_lora_v6:  96%|#########5| 3355/3500 [47:33<05:05,  2.11s/it, lr: 1.0e-04 loss: 7.054e-01]
my_first_lora_v6:  96%|#########5| 3355/3500 [47:33<05:05,  2.11s/it, lr: 1.0e-04 loss: 7.054e-01]
my_first_lora_v6:  96%|#########5| 3356/3500 [47:35<05:03,  2.11s/it, lr: 1.0e-04 loss: 2.913e-01]
my_first_lora_v6:  96%|#########5| 3356/3500 [47:35<05:03,  2.11s/it, lr: 1.0e-04 loss: 2.913e-01]
my_first_lora_v6:  96%|#########5| 3357/3500 [47:37<05:01,  2.11s/it, lr: 1.0e-04 loss: 6.814e-01]
my_first_lora_v6:  96%|#########5| 3357/3500 [47:37<05:01,  2.11s/it, lr: 1.0e-04 loss: 6.814e-01]
my_first_lora_v6:  96%|#########5| 3358/3500 [47:40<04:59,  2.11s/it, lr: 1.0e-04 loss: 7.551e-01]
my_first_lora_v6:  96%|#########5| 3358/3500 [47:40<04:59,  2.11s/it, lr: 1.0e-04 loss: 7.551e-01]
my_first_lora_v6:  96%|#########5| 3359/3500 [47:42<04:57,  2.11s/it, lr: 1.0e-04 loss: 1.177e-01]
my_first_lora_v6:  96%|#########5| 3359/3500 [47:42<04:57,  2.11s/it, lr: 1.0e-04 loss: 1.177e-01]
my_first_lora_v6:  96%|#########6| 3360/3500 [47:45<04:54,  2.11s/it, lr: 1.0e-04 loss: 7.615e-01]
my_first_lora_v6:  96%|#########6| 3360/3500 [47:45<04:54,  2.11s/it, lr: 1.0e-04 loss: 7.615e-01]
my_first_lora_v6:  96%|#########6| 3361/3500 [47:46<04:52,  2.11s/it, lr: 1.0e-04 loss: 6.842e-01]
my_first_lora_v6:  96%|#########6| 3361/3500 [47:46<04:52,  2.11s/it, lr: 1.0e-04 loss: 6.842e-01]
my_first_lora_v6:  96%|#########6| 3362/3500 [47:49<04:50,  2.11s/it, lr: 1.0e-04 loss: 6.069e-01]
my_first_lora_v6:  96%|#########6| 3362/3500 [47:49<04:50,  2.11s/it, lr: 1.0e-04 loss: 6.069e-01]
my_first_lora_v6:  96%|#########6| 3363/3500 [47:51<04:48,  2.11s/it, lr: 1.0e-04 loss: 7.380e-02]
my_first_lora_v6:  96%|#########6| 3363/3500 [47:51<04:48,  2.11s/it, lr: 1.0e-04 loss: 7.380e-02]
my_first_lora_v6:  96%|#########6| 3364/3500 [47:52<04:46,  2.11s/it, lr: 1.0e-04 loss: 5.170e-01]
my_first_lora_v6:  96%|#########6| 3364/3500 [47:52<04:46,  2.11s/it, lr: 1.0e-04 loss: 5.170e-01]
my_first_lora_v6:  96%|#########6| 3365/3500 [47:54<04:44,  2.11s/it, lr: 1.0e-04 loss: 4.839e-01]
my_first_lora_v6:  96%|#########6| 3365/3500 [47:54<04:44,  2.11s/it, lr: 1.0e-04 loss: 4.839e-01]
my_first_lora_v6:  96%|#########6| 3366/3500 [47:56<04:42,  2.11s/it, lr: 1.0e-04 loss: 6.298e-01]
my_first_lora_v6:  96%|#########6| 3366/3500 [47:56<04:42,  2.11s/it, lr: 1.0e-04 loss: 6.298e-01]
my_first_lora_v6:  96%|#########6| 3367/3500 [47:59<04:40,  2.11s/it, lr: 1.0e-04 loss: 5.941e-02]
my_first_lora_v6:  96%|#########6| 3367/3500 [47:59<04:40,  2.11s/it, lr: 1.0e-04 loss: 5.941e-02]
my_first_lora_v6:  96%|#########6| 3368/3500 [48:02<04:38,  2.11s/it, lr: 1.0e-04 loss: 6.509e-02]
my_first_lora_v6:  96%|#########6| 3368/3500 [48:02<04:38,  2.11s/it, lr: 1.0e-04 loss: 6.509e-02]
my_first_lora_v6:  96%|#########6| 3369/3500 [48:04<04:36,  2.11s/it, lr: 1.0e-04 loss: 3.481e-01]
my_first_lora_v6:  96%|#########6| 3369/3500 [48:04<04:36,  2.11s/it, lr: 1.0e-04 loss: 3.481e-01]
my_first_lora_v6:  96%|#########6| 3370/3500 [48:05<04:33,  2.11s/it, lr: 1.0e-04 loss: 4.178e-02]
my_first_lora_v6:  96%|#########6| 3370/3500 [48:05<04:33,  2.11s/it, lr: 1.0e-04 loss: 4.178e-02]
my_first_lora_v6:  96%|#########6| 3371/3500 [48:08<04:31,  2.11s/it, lr: 1.0e-04 loss: 4.279e-01]
my_first_lora_v6:  96%|#########6| 3371/3500 [48:08<04:31,  2.11s/it, lr: 1.0e-04 loss: 4.279e-01]
my_first_lora_v6:  96%|#########6| 3372/3500 [48:10<04:29,  2.11s/it, lr: 1.0e-04 loss: 5.492e-01]
my_first_lora_v6:  96%|#########6| 3372/3500 [48:10<04:29,  2.11s/it, lr: 1.0e-04 loss: 5.492e-01]
my_first_lora_v6:  96%|#########6| 3373/3500 [48:12<04:27,  2.11s/it, lr: 1.0e-04 loss: 5.125e-01]
my_first_lora_v6:  96%|#########6| 3373/3500 [48:12<04:27,  2.11s/it, lr: 1.0e-04 loss: 5.125e-01]
my_first_lora_v6:  96%|#########6| 3374/3500 [48:14<04:25,  2.11s/it, lr: 1.0e-04 loss: 7.433e-01]
my_first_lora_v6:  96%|#########6| 3374/3500 [48:14<04:25,  2.11s/it, lr: 1.0e-04 loss: 7.433e-01]
my_first_lora_v6:  96%|#########6| 3375/3500 [48:15<04:23,  2.11s/it, lr: 1.0e-04 loss: 0.000e+00]
my_first_lora_v6:  96%|#########6| 3375/3500 [48:15<04:23,  2.11s/it, lr: 1.0e-04 loss: 0.000e+00]
my_first_lora_v6:  96%|#########6| 3376/3500 [48:18<04:21,  2.11s/it, lr: 1.0e-04 loss: 4.787e-01]
my_first_lora_v6:  96%|#########6| 3376/3500 [48:18<04:21,  2.11s/it, lr: 1.0e-04 loss: 4.787e-01]
my_first_lora_v6:  96%|#########6| 3377/3500 [48:21<04:19,  2.11s/it, lr: 1.0e-04 loss: 6.970e-01]
my_first_lora_v6:  96%|#########6| 3377/3500 [48:21<04:19,  2.11s/it, lr: 1.0e-04 loss: 6.970e-01]
my_first_lora_v6:  97%|#########6| 3378/3500 [48:23<04:17,  2.11s/it, lr: 1.0e-04 loss: 6.930e-01]
my_first_lora_v6:  97%|#########6| 3378/3500 [48:23<04:17,  2.11s/it, lr: 1.0e-04 loss: 6.930e-01]
my_first_lora_v6:  97%|#########6| 3379/3500 [48:25<04:14,  2.11s/it, lr: 1.0e-04 loss: 6.808e-01]
my_first_lora_v6:  97%|#########6| 3379/3500 [48:25<04:14,  2.11s/it, lr: 1.0e-04 loss: 6.808e-01]
my_first_lora_v6:  97%|#########6| 3380/3500 [48:28<04:12,  2.11s/it, lr: 1.0e-04 loss: 5.117e-02]
my_first_lora_v6:  97%|#########6| 3380/3500 [48:28<04:12,  2.11s/it, lr: 1.0e-04 loss: 5.117e-02]
my_first_lora_v6:  97%|#########6| 3381/3500 [48:29<04:10,  2.11s/it, lr: 1.0e-04 loss: 7.943e-01]
my_first_lora_v6:  97%|#########6| 3381/3500 [48:29<04:10,  2.11s/it, lr: 1.0e-04 loss: 7.943e-01]
my_first_lora_v6:  97%|#########6| 3382/3500 [48:31<04:08,  2.11s/it, lr: 1.0e-04 loss: 9.345e-02]
my_first_lora_v6:  97%|#########6| 3382/3500 [48:31<04:08,  2.11s/it, lr: 1.0e-04 loss: 9.345e-02]
my_first_lora_v6:  97%|#########6| 3383/3500 [48:33<04:06,  2.11s/it, lr: 1.0e-04 loss: 6.295e-01]
my_first_lora_v6:  97%|#########6| 3383/3500 [48:33<04:06,  2.11s/it, lr: 1.0e-04 loss: 6.295e-01]
my_first_lora_v6:  97%|#########6| 3384/3500 [48:34<04:04,  2.11s/it, lr: 1.0e-04 loss: 8.225e-02]
my_first_lora_v6:  97%|#########6| 3384/3500 [48:34<04:04,  2.11s/it, lr: 1.0e-04 loss: 8.225e-02]
my_first_lora_v6:  97%|#########6| 3385/3500 [48:36<04:02,  2.11s/it, lr: 1.0e-04 loss: 3.119e-01]
my_first_lora_v6:  97%|#########6| 3385/3500 [48:36<04:02,  2.11s/it, lr: 1.0e-04 loss: 3.119e-01]
my_first_lora_v6:  97%|#########6| 3386/3500 [48:38<04:00,  2.11s/it, lr: 1.0e-04 loss: 6.343e-01]
my_first_lora_v6:  97%|#########6| 3386/3500 [48:38<04:00,  2.11s/it, lr: 1.0e-04 loss: 6.343e-01]
my_first_lora_v6:  97%|#########6| 3387/3500 [48:40<03:57,  2.11s/it, lr: 1.0e-04 loss: 4.551e-01]
my_first_lora_v6:  97%|#########6| 3387/3500 [48:40<03:57,  2.11s/it, lr: 1.0e-04 loss: 4.551e-01]
my_first_lora_v6:  97%|#########6| 3388/3500 [48:43<03:55,  2.11s/it, lr: 1.0e-04 loss: 6.733e-01]
my_first_lora_v6:  97%|#########6| 3388/3500 [48:43<03:55,  2.11s/it, lr: 1.0e-04 loss: 6.733e-01]
my_first_lora_v6:  97%|#########6| 3389/3500 [48:45<03:53,  2.11s/it, lr: 1.0e-04 loss: 3.493e-01]
my_first_lora_v6:  97%|#########6| 3389/3500 [48:45<03:53,  2.11s/it, lr: 1.0e-04 loss: 3.493e-01]
my_first_lora_v6:  97%|#########6| 3390/3500 [48:48<03:51,  2.11s/it, lr: 1.0e-04 loss: 6.363e-01]
my_first_lora_v6:  97%|#########6| 3390/3500 [48:48<03:51,  2.11s/it, lr: 1.0e-04 loss: 6.363e-01]
my_first_lora_v6:  97%|#########6| 3391/3500 [48:49<03:49,  2.11s/it, lr: 1.0e-04 loss: 3.995e-01]
my_first_lora_v6:  97%|#########6| 3391/3500 [48:49<03:49,  2.11s/it, lr: 1.0e-04 loss: 3.995e-01]
my_first_lora_v6:  97%|#########6| 3392/3500 [48:51<03:47,  2.11s/it, lr: 1.0e-04 loss: 6.772e-02]
my_first_lora_v6:  97%|#########6| 3392/3500 [48:51<03:47,  2.11s/it, lr: 1.0e-04 loss: 6.772e-02]
my_first_lora_v6:  97%|#########6| 3393/3500 [48:53<03:45,  2.11s/it, lr: 1.0e-04 loss: 1.656e-01]
my_first_lora_v6:  97%|#########6| 3393/3500 [48:53<03:45,  2.11s/it, lr: 1.0e-04 loss: 1.656e-01]
my_first_lora_v6:  97%|#########6| 3394/3500 [48:56<03:43,  2.11s/it, lr: 1.0e-04 loss: 6.814e-01]
my_first_lora_v6:  97%|#########6| 3394/3500 [48:56<03:43,  2.11s/it, lr: 1.0e-04 loss: 6.814e-01]
my_first_lora_v6:  97%|#########7| 3395/3500 [48:59<03:41,  2.11s/it, lr: 1.0e-04 loss: 4.129e-01]
my_first_lora_v6:  97%|#########7| 3395/3500 [48:59<03:41,  2.11s/it, lr: 1.0e-04 loss: 4.129e-01]
my_first_lora_v6:  97%|#########7| 3396/3500 [49:01<03:39,  2.11s/it, lr: 1.0e-04 loss: 7.703e-01]
my_first_lora_v6:  97%|#########7| 3396/3500 [49:01<03:39,  2.11s/it, lr: 1.0e-04 loss: 7.703e-01]
my_first_lora_v6:  97%|#########7| 3397/3500 [49:02<03:36,  2.11s/it, lr: 1.0e-04 loss: 7.705e-01]
my_first_lora_v6:  97%|#########7| 3397/3500 [49:02<03:36,  2.11s/it, lr: 1.0e-04 loss: 7.705e-01]
my_first_lora_v6:  97%|#########7| 3398/3500 [49:05<03:34,  2.11s/it, lr: 1.0e-04 loss: 3.871e-02]
my_first_lora_v6:  97%|#########7| 3398/3500 [49:05<03:34,  2.11s/it, lr: 1.0e-04 loss: 3.871e-02]
my_first_lora_v6:  97%|#########7| 3399/3500 [49:06<03:32,  2.11s/it, lr: 1.0e-04 loss: 9.515e-02]
my_first_lora_v6:  97%|#########7| 3399/3500 [49:06<03:32,  2.11s/it, lr: 1.0e-04 loss: 9.515e-02]
my_first_lora_v6:  97%|#########7| 3400/3500 [49:09<03:30,  2.11s/it, lr: 1.0e-04 loss: 8.871e-02]
my_first_lora_v6:  97%|#########7| 3400/3500 [49:09<03:30,  2.11s/it, lr: 1.0e-04 loss: 8.871e-02]
my_first_lora_v6:  97%|#########7| 3401/3500 [49:11<03:28,  2.11s/it, lr: 1.0e-04 loss: 1.552e-01]
my_first_lora_v6:  97%|#########7| 3401/3500 [49:11<03:28,  2.11s/it, lr: 1.0e-04 loss: 1.552e-01]
my_first_lora_v6:  97%|#########7| 3402/3500 [49:12<03:26,  2.11s/it, lr: 1.0e-04 loss: 2.608e-01]
my_first_lora_v6:  97%|#########7| 3402/3500 [49:12<03:26,  2.11s/it, lr: 1.0e-04 loss: 2.608e-01]
my_first_lora_v6:  97%|#########7| 3403/3500 [49:14<03:24,  2.11s/it, lr: 1.0e-04 loss: 6.502e-02]
my_first_lora_v6:  97%|#########7| 3403/3500 [49:14<03:24,  2.11s/it, lr: 1.0e-04 loss: 6.502e-02]
my_first_lora_v6:  97%|#########7| 3404/3500 [49:15<03:22,  2.11s/it, lr: 1.0e-04 loss: 4.931e-01]
my_first_lora_v6:  97%|#########7| 3404/3500 [49:15<03:22,  2.11s/it, lr: 1.0e-04 loss: 4.931e-01]
my_first_lora_v6:  97%|#########7| 3405/3500 [49:18<03:20,  2.11s/it, lr: 1.0e-04 loss: 2.678e-01]
my_first_lora_v6:  97%|#########7| 3405/3500 [49:18<03:20,  2.11s/it, lr: 1.0e-04 loss: 2.678e-01]
my_first_lora_v6:  97%|#########7| 3406/3500 [49:20<03:17,  2.11s/it, lr: 1.0e-04 loss: 4.302e-01]
my_first_lora_v6:  97%|#########7| 3406/3500 [49:20<03:17,  2.11s/it, lr: 1.0e-04 loss: 4.302e-01]
my_first_lora_v6:  97%|#########7| 3407/3500 [49:22<03:15,  2.11s/it, lr: 1.0e-04 loss: 6.319e-01]
my_first_lora_v6:  97%|#########7| 3407/3500 [49:22<03:15,  2.11s/it, lr: 1.0e-04 loss: 6.319e-01]
my_first_lora_v6:  97%|#########7| 3408/3500 [49:23<03:13,  2.11s/it, lr: 1.0e-04 loss: 6.908e-01]
my_first_lora_v6:  97%|#########7| 3408/3500 [49:23<03:13,  2.11s/it, lr: 1.0e-04 loss: 6.908e-01]
my_first_lora_v6:  97%|#########7| 3409/3500 [49:26<03:11,  2.11s/it, lr: 1.0e-04 loss: 8.776e-02]
my_first_lora_v6:  97%|#########7| 3409/3500 [49:26<03:11,  2.11s/it, lr: 1.0e-04 loss: 8.776e-02]
my_first_lora_v6:  97%|#########7| 3410/3500 [49:29<03:09,  2.11s/it, lr: 1.0e-04 loss: 1.447e-01]
my_first_lora_v6:  97%|#########7| 3410/3500 [49:29<03:09,  2.11s/it, lr: 1.0e-04 loss: 1.447e-01]
my_first_lora_v6:  97%|#########7| 3411/3500 [49:31<03:07,  2.11s/it, lr: 1.0e-04 loss: 1.259e-01]
my_first_lora_v6:  97%|#########7| 3411/3500 [49:31<03:07,  2.11s/it, lr: 1.0e-04 loss: 1.259e-01]
my_first_lora_v6:  97%|#########7| 3412/3500 [49:33<03:05,  2.11s/it, lr: 1.0e-04 loss: 7.726e-01]
my_first_lora_v6:  97%|#########7| 3412/3500 [49:33<03:05,  2.11s/it, lr: 1.0e-04 loss: 7.726e-01]
my_first_lora_v6:  98%|#########7| 3413/3500 [49:36<03:03,  2.11s/it, lr: 1.0e-04 loss: 3.019e-02]
my_first_lora_v6:  98%|#########7| 3413/3500 [49:36<03:03,  2.11s/it, lr: 1.0e-04 loss: 3.019e-02]
my_first_lora_v6:  98%|#########7| 3414/3500 [49:39<03:01,  2.11s/it, lr: 1.0e-04 loss: 4.692e-01]
my_first_lora_v6:  98%|#########7| 3414/3500 [49:39<03:01,  2.11s/it, lr: 1.0e-04 loss: 4.692e-01]
my_first_lora_v6:  98%|#########7| 3415/3500 [49:41<02:59,  2.11s/it, lr: 1.0e-04 loss: 1.691e-02]
my_first_lora_v6:  98%|#########7| 3415/3500 [49:41<02:59,  2.11s/it, lr: 1.0e-04 loss: 1.691e-02]
my_first_lora_v6:  98%|#########7| 3416/3500 [49:43<02:56,  2.11s/it, lr: 1.0e-04 loss: 4.001e-01]
my_first_lora_v6:  98%|#########7| 3416/3500 [49:43<02:56,  2.11s/it, lr: 1.0e-04 loss: 4.001e-01]
my_first_lora_v6:  98%|#########7| 3417/3500 [49:45<02:54,  2.11s/it, lr: 1.0e-04 loss: 1.098e-01]
my_first_lora_v6:  98%|#########7| 3417/3500 [49:45<02:54,  2.11s/it, lr: 1.0e-04 loss: 1.098e-01]
my_first_lora_v6:  98%|#########7| 3418/3500 [49:48<02:52,  2.11s/it, lr: 1.0e-04 loss: 6.393e-01]
my_first_lora_v6:  98%|#########7| 3418/3500 [49:48<02:52,  2.11s/it, lr: 1.0e-04 loss: 6.393e-01]
my_first_lora_v6:  98%|#########7| 3419/3500 [49:49<02:50,  2.11s/it, lr: 1.0e-04 loss: 7.762e-01]
my_first_lora_v6:  98%|#########7| 3419/3500 [49:49<02:50,  2.11s/it, lr: 1.0e-04 loss: 7.762e-01]
my_first_lora_v6:  98%|#########7| 3420/3500 [49:50<02:48,  2.11s/it, lr: 1.0e-04 loss: 7.538e-01]
my_first_lora_v6:  98%|#########7| 3420/3500 [49:50<02:48,  2.11s/it, lr: 1.0e-04 loss: 7.538e-01]
my_first_lora_v6:  98%|#########7| 3421/3500 [49:51<02:46,  2.11s/it, lr: 1.0e-04 loss: 3.279e-01]
my_first_lora_v6:  98%|#########7| 3421/3500 [49:51<02:46,  2.11s/it, lr: 1.0e-04 loss: 3.279e-01]
my_first_lora_v6:  98%|#########7| 3422/3500 [49:52<02:44,  2.10s/it, lr: 1.0e-04 loss: 6.680e-01]
my_first_lora_v6:  98%|#########7| 3422/3500 [49:52<02:44,  2.10s/it, lr: 1.0e-04 loss: 6.680e-01]
my_first_lora_v6:  98%|#########7| 3423/3500 [49:54<02:42,  2.10s/it, lr: 1.0e-04 loss: 9.405e-02]
my_first_lora_v6:  98%|#########7| 3423/3500 [49:54<02:42,  2.10s/it, lr: 1.0e-04 loss: 9.405e-02]
my_first_lora_v6:  98%|#########7| 3424/3500 [49:57<02:39,  2.10s/it, lr: 1.0e-04 loss: 5.992e-01]
my_first_lora_v6:  98%|#########7| 3424/3500 [49:57<02:39,  2.10s/it, lr: 1.0e-04 loss: 5.992e-01]
my_first_lora_v6:  98%|#########7| 3425/3500 [49:59<02:37,  2.10s/it, lr: 1.0e-04 loss: 5.569e-01]
my_first_lora_v6:  98%|#########7| 3425/3500 [49:59<02:37,  2.10s/it, lr: 1.0e-04 loss: 5.569e-01]
my_first_lora_v6:  98%|#########7| 3426/3500 [50:01<02:35,  2.10s/it, lr: 1.0e-04 loss: 6.684e-01]
my_first_lora_v6:  98%|#########7| 3426/3500 [50:01<02:35,  2.10s/it, lr: 1.0e-04 loss: 6.684e-01]
my_first_lora_v6:  98%|#########7| 3427/3500 [50:04<02:33,  2.11s/it, lr: 1.0e-04 loss: 7.747e-01]
my_first_lora_v6:  98%|#########7| 3427/3500 [50:04<02:33,  2.11s/it, lr: 1.0e-04 loss: 7.747e-01]
my_first_lora_v6:  98%|#########7| 3428/3500 [50:06<02:31,  2.11s/it, lr: 1.0e-04 loss: 6.724e-01]
my_first_lora_v6:  98%|#########7| 3428/3500 [50:06<02:31,  2.11s/it, lr: 1.0e-04 loss: 6.724e-01]
my_first_lora_v6:  98%|#########7| 3429/3500 [50:09<02:29,  2.11s/it, lr: 1.0e-04 loss: 6.622e-01]
my_first_lora_v6:  98%|#########7| 3429/3500 [50:09<02:29,  2.11s/it, lr: 1.0e-04 loss: 6.622e-01]
my_first_lora_v6:  98%|#########8| 3430/3500 [50:12<02:27,  2.11s/it, lr: 1.0e-04 loss: 6.744e-01]
my_first_lora_v6:  98%|#########8| 3430/3500 [50:12<02:27,  2.11s/it, lr: 1.0e-04 loss: 6.744e-01]
my_first_lora_v6:  98%|#########8| 3431/3500 [50:14<02:25,  2.11s/it, lr: 1.0e-04 loss: 7.840e-01]
my_first_lora_v6:  98%|#########8| 3431/3500 [50:14<02:25,  2.11s/it, lr: 1.0e-04 loss: 7.840e-01]
my_first_lora_v6:  98%|#########8| 3432/3500 [50:16<02:23,  2.11s/it, lr: 1.0e-04 loss: 6.582e-01]
my_first_lora_v6:  98%|#########8| 3432/3500 [50:16<02:23,  2.11s/it, lr: 1.0e-04 loss: 6.582e-01]
my_first_lora_v6:  98%|#########8| 3433/3500 [50:19<02:21,  2.11s/it, lr: 1.0e-04 loss: 7.262e-01]
my_first_lora_v6:  98%|#########8| 3433/3500 [50:19<02:21,  2.11s/it, lr: 1.0e-04 loss: 7.262e-01]
my_first_lora_v6:  98%|#########8| 3434/3500 [50:20<02:19,  2.11s/it, lr: 1.0e-04 loss: 7.235e-01]
my_first_lora_v6:  98%|#########8| 3434/3500 [50:20<02:19,  2.11s/it, lr: 1.0e-04 loss: 7.235e-01]
my_first_lora_v6:  98%|#########8| 3435/3500 [50:22<02:16,  2.11s/it, lr: 1.0e-04 loss: 4.102e-01]
my_first_lora_v6:  98%|#########8| 3435/3500 [50:22<02:16,  2.11s/it, lr: 1.0e-04 loss: 4.102e-01]
my_first_lora_v6:  98%|#########8| 3436/3500 [50:25<02:14,  2.11s/it, lr: 1.0e-04 loss: 8.268e-01]
my_first_lora_v6:  98%|#########8| 3436/3500 [50:25<02:14,  2.11s/it, lr: 1.0e-04 loss: 8.268e-01]
my_first_lora_v6:  98%|#########8| 3437/3500 [50:26<02:12,  2.11s/it, lr: 1.0e-04 loss: 1.180e-01]
my_first_lora_v6:  98%|#########8| 3437/3500 [50:26<02:12,  2.11s/it, lr: 1.0e-04 loss: 1.180e-01]
my_first_lora_v6:  98%|#########8| 3438/3500 [50:28<02:10,  2.11s/it, lr: 1.0e-04 loss: 2.266e-01]
my_first_lora_v6:  98%|#########8| 3438/3500 [50:28<02:10,  2.11s/it, lr: 1.0e-04 loss: 2.266e-01]
my_first_lora_v6:  98%|#########8| 3439/3500 [50:30<02:08,  2.11s/it, lr: 1.0e-04 loss: 4.933e-01]
my_first_lora_v6:  98%|#########8| 3439/3500 [50:30<02:08,  2.11s/it, lr: 1.0e-04 loss: 4.933e-01]
my_first_lora_v6:  98%|#########8| 3440/3500 [50:33<02:06,  2.11s/it, lr: 1.0e-04 loss: 3.459e-01]
my_first_lora_v6:  98%|#########8| 3440/3500 [50:33<02:06,  2.11s/it, lr: 1.0e-04 loss: 3.459e-01]
my_first_lora_v6:  98%|#########8| 3441/3500 [50:36<02:04,  2.11s/it, lr: 1.0e-04 loss: 2.949e-01]
my_first_lora_v6:  98%|#########8| 3441/3500 [50:36<02:04,  2.11s/it, lr: 1.0e-04 loss: 2.949e-01]
my_first_lora_v6:  98%|#########8| 3442/3500 [50:38<02:02,  2.11s/it, lr: 1.0e-04 loss: 4.847e-01]
my_first_lora_v6:  98%|#########8| 3442/3500 [50:38<02:02,  2.11s/it, lr: 1.0e-04 loss: 4.847e-01]
my_first_lora_v6:  98%|#########8| 3443/3500 [50:41<02:00,  2.11s/it, lr: 1.0e-04 loss: 6.412e-01]
my_first_lora_v6:  98%|#########8| 3443/3500 [50:41<02:00,  2.11s/it, lr: 1.0e-04 loss: 6.412e-01]
my_first_lora_v6:  98%|#########8| 3444/3500 [50:43<01:58,  2.11s/it, lr: 1.0e-04 loss: 1.079e-01]
my_first_lora_v6:  98%|#########8| 3444/3500 [50:43<01:58,  2.11s/it, lr: 1.0e-04 loss: 1.079e-01]
my_first_lora_v6:  98%|#########8| 3445/3500 [50:45<01:55,  2.11s/it, lr: 1.0e-04 loss: 1.315e-01]
my_first_lora_v6:  98%|#########8| 3445/3500 [50:45<01:55,  2.11s/it, lr: 1.0e-04 loss: 1.315e-01]
my_first_lora_v6:  98%|#########8| 3446/3500 [50:46<01:53,  2.11s/it, lr: 1.0e-04 loss: 7.453e-01]
my_first_lora_v6:  98%|#########8| 3446/3500 [50:46<01:53,  2.11s/it, lr: 1.0e-04 loss: 7.453e-01]
my_first_lora_v6:  98%|#########8| 3447/3500 [50:47<01:51,  2.11s/it, lr: 1.0e-04 loss: 4.082e-01]
my_first_lora_v6:  98%|#########8| 3447/3500 [50:47<01:51,  2.11s/it, lr: 1.0e-04 loss: 4.082e-01]
my_first_lora_v6:  99%|#########8| 3448/3500 [50:50<01:49,  2.11s/it, lr: 1.0e-04 loss: 4.179e-01]
my_first_lora_v6:  99%|#########8| 3448/3500 [50:50<01:49,  2.11s/it, lr: 1.0e-04 loss: 4.179e-01]
my_first_lora_v6:  99%|#########8| 3449/3500 [50:52<01:47,  2.11s/it, lr: 1.0e-04 loss: 7.784e-01]
my_first_lora_v6:  99%|#########8| 3449/3500 [50:52<01:47,  2.11s/it, lr: 1.0e-04 loss: 7.784e-01]
my_first_lora_v6:  99%|#########8| 3450/3500 [50:54<01:45,  2.11s/it, lr: 1.0e-04 loss: 3.045e-01]
my_first_lora_v6:  99%|#########8| 3450/3500 [50:54<01:45,  2.11s/it, lr: 1.0e-04 loss: 3.045e-01]
my_first_lora_v6:  99%|#########8| 3451/3500 [50:55<01:43,  2.11s/it, lr: 1.0e-04 loss: 4.844e-01]
my_first_lora_v6:  99%|#########8| 3451/3500 [50:55<01:43,  2.11s/it, lr: 1.0e-04 loss: 4.844e-01]
my_first_lora_v6:  99%|#########8| 3452/3500 [50:58<01:41,  2.11s/it, lr: 1.0e-04 loss: 2.495e-02]
my_first_lora_v6:  99%|#########8| 3452/3500 [50:58<01:41,  2.11s/it, lr: 1.0e-04 loss: 2.495e-02]
my_first_lora_v6:  99%|#########8| 3453/3500 [51:00<01:38,  2.11s/it, lr: 1.0e-04 loss: 1.051e-01]
my_first_lora_v6:  99%|#########8| 3453/3500 [51:00<01:38,  2.11s/it, lr: 1.0e-04 loss: 1.051e-01]
my_first_lora_v6:  99%|#########8| 3454/3500 [51:02<01:36,  2.11s/it, lr: 1.0e-04 loss: 5.180e-01]
my_first_lora_v6:  99%|#########8| 3454/3500 [51:02<01:36,  2.11s/it, lr: 1.0e-04 loss: 5.180e-01]
my_first_lora_v6:  99%|#########8| 3455/3500 [51:03<01:34,  2.11s/it, lr: 1.0e-04 loss: 7.322e-01]
my_first_lora_v6:  99%|#########8| 3455/3500 [51:03<01:34,  2.11s/it, lr: 1.0e-04 loss: 7.322e-01]
my_first_lora_v6:  99%|#########8| 3456/3500 [51:06<01:32,  2.11s/it, lr: 1.0e-04 loss: 4.177e-01]
my_first_lora_v6:  99%|#########8| 3456/3500 [51:06<01:32,  2.11s/it, lr: 1.0e-04 loss: 4.177e-01]
my_first_lora_v6:  99%|#########8| 3457/3500 [51:08<01:30,  2.11s/it, lr: 1.0e-04 loss: 4.815e-01]
my_first_lora_v6:  99%|#########8| 3457/3500 [51:08<01:30,  2.11s/it, lr: 1.0e-04 loss: 4.815e-01]
my_first_lora_v6:  99%|#########8| 3458/3500 [51:10<01:28,  2.11s/it, lr: 1.0e-04 loss: 8.209e-01]
my_first_lora_v6:  99%|#########8| 3458/3500 [51:10<01:28,  2.11s/it, lr: 1.0e-04 loss: 8.209e-01]
my_first_lora_v6:  99%|#########8| 3459/3500 [51:13<01:26,  2.11s/it, lr: 1.0e-04 loss: 5.237e-01]
my_first_lora_v6:  99%|#########8| 3459/3500 [51:13<01:26,  2.11s/it, lr: 1.0e-04 loss: 5.237e-01]
my_first_lora_v6:  99%|#########8| 3460/3500 [51:14<01:24,  2.11s/it, lr: 1.0e-04 loss: 7.606e-01]
my_first_lora_v6:  99%|#########8| 3460/3500 [51:14<01:24,  2.11s/it, lr: 1.0e-04 loss: 7.606e-01]
my_first_lora_v6:  99%|#########8| 3461/3500 [51:16<01:22,  2.11s/it, lr: 1.0e-04 loss: 6.276e-01]
my_first_lora_v6:  99%|#########8| 3461/3500 [51:16<01:22,  2.11s/it, lr: 1.0e-04 loss: 6.276e-01]
my_first_lora_v6:  99%|#########8| 3462/3500 [51:17<01:19,  2.11s/it, lr: 1.0e-04 loss: 2.741e-01]
my_first_lora_v6:  99%|#########8| 3462/3500 [51:17<01:19,  2.11s/it, lr: 1.0e-04 loss: 2.741e-01]
my_first_lora_v6:  99%|#########8| 3463/3500 [51:19<01:17,  2.11s/it, lr: 1.0e-04 loss: 5.763e-01]
my_first_lora_v6:  99%|#########8| 3463/3500 [51:19<01:17,  2.11s/it, lr: 1.0e-04 loss: 5.763e-01]
my_first_lora_v6:  99%|#########8| 3464/3500 [51:22<01:15,  2.11s/it, lr: 1.0e-04 loss: 2.737e-01]
my_first_lora_v6:  99%|#########8| 3464/3500 [51:22<01:15,  2.11s/it, lr: 1.0e-04 loss: 2.737e-01]
my_first_lora_v6:  99%|#########9| 3465/3500 [51:24<01:13,  2.11s/it, lr: 1.0e-04 loss: 1.957e-01]
my_first_lora_v6:  99%|#########9| 3465/3500 [51:24<01:13,  2.11s/it, lr: 1.0e-04 loss: 1.957e-01]
my_first_lora_v6:  99%|#########9| 3466/3500 [51:27<01:11,  2.11s/it, lr: 1.0e-04 loss: 7.171e-02]
my_first_lora_v6:  99%|#########9| 3466/3500 [51:27<01:11,  2.11s/it, lr: 1.0e-04 loss: 7.171e-02]
my_first_lora_v6:  99%|#########9| 3467/3500 [51:30<01:09,  2.11s/it, lr: 1.0e-04 loss: 6.937e-01]
my_first_lora_v6:  99%|#########9| 3467/3500 [51:30<01:09,  2.11s/it, lr: 1.0e-04 loss: 6.937e-01]
my_first_lora_v6:  99%|#########9| 3468/3500 [51:32<01:07,  2.11s/it, lr: 1.0e-04 loss: 5.837e-01]
my_first_lora_v6:  99%|#########9| 3468/3500 [51:32<01:07,  2.11s/it, lr: 1.0e-04 loss: 5.837e-01]
my_first_lora_v6:  99%|#########9| 3469/3500 [51:34<01:05,  2.11s/it, lr: 1.0e-04 loss: 2.707e-01]
my_first_lora_v6:  99%|#########9| 3469/3500 [51:34<01:05,  2.11s/it, lr: 1.0e-04 loss: 2.707e-01]
my_first_lora_v6:  99%|#########9| 3470/3500 [51:35<01:03,  2.11s/it, lr: 1.0e-04 loss: 4.639e-01]
my_first_lora_v6:  99%|#########9| 3470/3500 [51:35<01:03,  2.11s/it, lr: 1.0e-04 loss: 4.639e-01]
my_first_lora_v6:  99%|#########9| 3471/3500 [51:37<01:01,  2.11s/it, lr: 1.0e-04 loss: 6.566e-02]
my_first_lora_v6:  99%|#########9| 3471/3500 [51:37<01:01,  2.11s/it, lr: 1.0e-04 loss: 6.566e-02]
my_first_lora_v6:  99%|#########9| 3472/3500 [51:38<00:58,  2.11s/it, lr: 1.0e-04 loss: 5.484e-01]
my_first_lora_v6:  99%|#########9| 3472/3500 [51:38<00:58,  2.11s/it, lr: 1.0e-04 loss: 5.484e-01]
my_first_lora_v6:  99%|#########9| 3473/3500 [51:41<00:56,  2.11s/it, lr: 1.0e-04 loss: 7.614e-01]
my_first_lora_v6:  99%|#########9| 3473/3500 [51:41<00:56,  2.11s/it, lr: 1.0e-04 loss: 7.614e-01]
my_first_lora_v6:  99%|#########9| 3474/3500 [51:43<00:54,  2.11s/it, lr: 1.0e-04 loss: 5.514e-01]
my_first_lora_v6:  99%|#########9| 3474/3500 [51:43<00:54,  2.11s/it, lr: 1.0e-04 loss: 5.514e-01]
my_first_lora_v6:  99%|#########9| 3475/3500 [51:46<00:52,  2.11s/it, lr: 1.0e-04 loss: 5.952e-01]
my_first_lora_v6:  99%|#########9| 3475/3500 [51:46<00:52,  2.11s/it, lr: 1.0e-04 loss: 5.952e-01]
my_first_lora_v6:  99%|#########9| 3476/3500 [51:47<00:50,  2.11s/it, lr: 1.0e-04 loss: 5.748e-01]
my_first_lora_v6:  99%|#########9| 3476/3500 [51:47<00:50,  2.11s/it, lr: 1.0e-04 loss: 5.748e-01]
my_first_lora_v6:  99%|#########9| 3477/3500 [51:49<00:48,  2.11s/it, lr: 1.0e-04 loss: 3.636e-01]
my_first_lora_v6:  99%|#########9| 3477/3500 [51:49<00:48,  2.11s/it, lr: 1.0e-04 loss: 3.636e-01]
my_first_lora_v6:  99%|#########9| 3478/3500 [51:51<00:46,  2.11s/it, lr: 1.0e-04 loss: 9.452e-02]
my_first_lora_v6:  99%|#########9| 3478/3500 [51:51<00:46,  2.11s/it, lr: 1.0e-04 loss: 9.452e-02]
my_first_lora_v6:  99%|#########9| 3479/3500 [51:54<00:44,  2.11s/it, lr: 1.0e-04 loss: 7.104e-01]
my_first_lora_v6:  99%|#########9| 3479/3500 [51:54<00:44,  2.11s/it, lr: 1.0e-04 loss: 7.104e-01]
my_first_lora_v6:  99%|#########9| 3480/3500 [51:56<00:42,  2.11s/it, lr: 1.0e-04 loss: 6.237e-01]
my_first_lora_v6:  99%|#########9| 3480/3500 [51:56<00:42,  2.11s/it, lr: 1.0e-04 loss: 6.237e-01]
my_first_lora_v6:  99%|#########9| 3481/3500 [51:57<00:39,  2.11s/it, lr: 1.0e-04 loss: 6.216e-01]
my_first_lora_v6:  99%|#########9| 3481/3500 [51:57<00:39,  2.11s/it, lr: 1.0e-04 loss: 6.216e-01]
my_first_lora_v6:  99%|#########9| 3482/3500 [52:00<00:37,  2.11s/it, lr: 1.0e-04 loss: 3.472e-02]
my_first_lora_v6:  99%|#########9| 3482/3500 [52:00<00:37,  2.11s/it, lr: 1.0e-04 loss: 3.472e-02]
my_first_lora_v6: 100%|#########9| 3483/3500 [52:03<00:35,  2.11s/it, lr: 1.0e-04 loss: 3.474e-01]
my_first_lora_v6: 100%|#########9| 3483/3500 [52:03<00:35,  2.11s/it, lr: 1.0e-04 loss: 3.474e-01]
my_first_lora_v6: 100%|#########9| 3484/3500 [52:05<00:33,  2.11s/it, lr: 1.0e-04 loss: 4.433e-01]
my_first_lora_v6: 100%|#########9| 3484/3500 [52:05<00:33,  2.11s/it, lr: 1.0e-04 loss: 4.433e-01]
my_first_lora_v6: 100%|#########9| 3485/3500 [52:07<00:31,  2.11s/it, lr: 1.0e-04 loss: 4.399e-01]
my_first_lora_v6: 100%|#########9| 3485/3500 [52:07<00:31,  2.11s/it, lr: 1.0e-04 loss: 4.399e-01]
my_first_lora_v6: 100%|#########9| 3486/3500 [52:09<00:29,  2.11s/it, lr: 1.0e-04 loss: 2.691e-01]
my_first_lora_v6: 100%|#########9| 3486/3500 [52:09<00:29,  2.11s/it, lr: 1.0e-04 loss: 2.691e-01]
my_first_lora_v6: 100%|#########9| 3487/3500 [52:10<00:27,  2.11s/it, lr: 1.0e-04 loss: 2.726e-02]
my_first_lora_v6: 100%|#########9| 3487/3500 [52:10<00:27,  2.11s/it, lr: 1.0e-04 loss: 2.726e-02]
my_first_lora_v6: 100%|#########9| 3488/3500 [52:13<00:25,  2.11s/it, lr: 1.0e-04 loss: 6.895e-01]
my_first_lora_v6: 100%|#########9| 3488/3500 [52:13<00:25,  2.11s/it, lr: 1.0e-04 loss: 6.895e-01]
my_first_lora_v6: 100%|#########9| 3489/3500 [52:15<00:23,  2.11s/it, lr: 1.0e-04 loss: 1.927e-01]
my_first_lora_v6: 100%|#########9| 3489/3500 [52:15<00:23,  2.11s/it, lr: 1.0e-04 loss: 1.927e-01]
my_first_lora_v6: 100%|#########9| 3490/3500 [52:18<00:21,  2.11s/it, lr: 1.0e-04 loss: 3.966e-01]
my_first_lora_v6: 100%|#########9| 3490/3500 [52:18<00:21,  2.11s/it, lr: 1.0e-04 loss: 3.966e-01]
my_first_lora_v6: 100%|#########9| 3491/3500 [52:20<00:18,  2.11s/it, lr: 1.0e-04 loss: 7.445e-01]
my_first_lora_v6: 100%|#########9| 3491/3500 [52:20<00:18,  2.11s/it, lr: 1.0e-04 loss: 7.445e-01]
my_first_lora_v6: 100%|#########9| 3492/3500 [52:21<00:16,  2.11s/it, lr: 1.0e-04 loss: 7.762e-01]
my_first_lora_v6: 100%|#########9| 3492/3500 [52:21<00:16,  2.11s/it, lr: 1.0e-04 loss: 7.762e-01]
my_first_lora_v6: 100%|#########9| 3493/3500 [52:24<00:14,  2.11s/it, lr: 1.0e-04 loss: 7.448e-01]
my_first_lora_v6: 100%|#########9| 3493/3500 [52:24<00:14,  2.11s/it, lr: 1.0e-04 loss: 7.448e-01]
my_first_lora_v6: 100%|#########9| 3494/3500 [52:25<00:12,  2.11s/it, lr: 1.0e-04 loss: 3.558e-01]
my_first_lora_v6: 100%|#########9| 3494/3500 [52:25<00:12,  2.11s/it, lr: 1.0e-04 loss: 3.558e-01]
my_first_lora_v6: 100%|#########9| 3495/3500 [52:28<00:10,  2.11s/it, lr: 1.0e-04 loss: 7.844e-01]
my_first_lora_v6: 100%|#########9| 3495/3500 [52:28<00:10,  2.11s/it, lr: 1.0e-04 loss: 7.844e-01]
my_first_lora_v6: 100%|#########9| 3496/3500 [52:30<00:08,  2.11s/it, lr: 1.0e-04 loss: 7.118e-01]
my_first_lora_v6: 100%|#########9| 3496/3500 [52:30<00:08,  2.11s/it, lr: 1.0e-04 loss: 7.118e-01]
my_first_lora_v6: 100%|#########9| 3497/3500 [52:31<00:06,  2.10s/it, lr: 1.0e-04 loss: 4.371e-01]
my_first_lora_v6: 100%|#########9| 3497/3500 [52:31<00:06,  2.10s/it, lr: 1.0e-04 loss: 4.371e-01]
my_first_lora_v6: 100%|#########9| 3498/3500 [52:34<00:04,  2.11s/it, lr: 1.0e-04 loss: 5.960e-01]
my_first_lora_v6: 100%|#########9| 3498/3500 [52:34<00:04,  2.11s/it, lr: 1.0e-04 loss: 5.960e-01]
my_first_lora_v6: 100%|#########9| 3499/3500 [52:34<00:02,  2.10s/it, lr: 1.0e-04 loss: 5.960e-01]
my_first_lora_v6: 100%|#########9| 3499/3500 [52:34<00:02,  2.10s/it, lr: 1.0e-04 loss: 5.960e-01]

Unloading assistant lora

Generating Images:   0%|          | 0/5 [00:00<?, ?it/s]
Generating Images:   0%|          | 0/5 [00:00<?, ?it/s]
Generating Images:  20%|##        | 1/5 [00:07<00:31,  7.89s/it]
Generating Images:  20%|##        | 1/5 [00:07<00:31,  7.89s/it]
Generating Images:  40%|####      | 2/5 [00:15<00:23,  7.83s/it]
Generating Images:  40%|####      | 2/5 [00:15<00:23,  7.83s/it]
Generating Images:  60%|######    | 3/5 [00:23<00:15,  7.73s/it]
Generating Images:  60%|######    | 3/5 [00:23<00:15,  7.73s/it]
Generating Images:  80%|########  | 4/5 [00:31<00:07,  7.76s/it]
Generating Images:  80%|########  | 4/5 [00:31<00:07,  7.76s/it]
Generating Images: 100%|##########| 5/5 [00:38<00:00,  7.78s/it]
Generating Images: 100%|##########| 5/5 [00:38<00:00,  7.78s/it]
                                                                
                                                                

Loading assistant lora

Saved checkpoint to /teamspace/studios/this_studio/ai-toolkit/output/my_first_lora_v6/my_first_lora_v6.safetensors
Saved optimizer to /teamspace/studios/this_studio/ai-toolkit/output/my_first_lora_v6/optimizer.pt