runtime error

Exit code: 1. Reason: of-00004.safetensors: 1%| | 8.88M/1.17G [00:01<02:23, 8.06MB/s] model-00004-of-00004.safetensors: 25%|██▌ | 296M/1.17G [00:02<00:05, 164MB/s]  model-00004-of-00004.safetensors: 100%|██████████| 1.17G/1.17G [00:02<00:00, 409MB/s] Loading checkpoint shards: 0%| | 0/4 [00:00<?, ?it/s] Loading checkpoint shards: 100%|██████████| 4/4 [00:00<00:00, 14.80it/s] generation_config.json: 0%| | 0.00/187 [00:00<?, ?B/s] generation_config.json: 100%|██████████| 187/187 [00:00<00:00, 1.50MB/s] adapter_config.json: 0%| | 0.00/739 [00:00<?, ?B/s] adapter_config.json: 100%|██████████| 739/739 [00:00<00:00, 5.28MB/s] adapter_model.safetensors: 0%| | 0.00/1.34G [00:00<?, ?B/s] adapter_model.safetensors: 0%| | 52.5k/1.34G [00:01<7:11:39, 51.8kB/s] adapter_model.safetensors: 6%|▌ | 76.3M/1.34G [00:02<00:31, 40.4MB/s]  adapter_model.safetensors: 56%|█████▌ | 746M/1.34G [00:03<00:01, 310MB/s]  adapter_model.safetensors: 100%|██████████| 1.34G/1.34G [00:03<00:00, 366MB/s] Traceback (most recent call last): File "/app/app.py", line 31, in <module> model = PeftModel.from_pretrained(base_model, "Wilfrid28/llama3-meld-wilfrid") File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 568, in from_pretrained load_result = model.load_adapter( File "/usr/local/lib/python3.10/site-packages/peft/peft_model.py", line 1430, in load_adapter dispatch_model( File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 383, in dispatch_model raise ValueError( ValueError: We need an `offload_dir` to dispatch this model according to this `device_map`, the following submodules need to be offloaded: base_model.model.model.layers.30, base_model.model.model.layers.31, base_model.model.model.norm, base_model.model.model.rotary_emb, base_model.model.lm_head.

Container logs:

Fetching error logs...