runtime error

Exit code: 1. Reason: odel-00001-of-00002.safetensors: 95%|█████████▍| 4.65G/4.90G [00:14<00:00, 400MB/s] model-00001-of-00002.safetensors: 100%|██████████| 4.90G/4.90G [00:15<00:00, 326MB/s] model-00002-of-00002.safetensors: 0%| | 0.00/2.77G [00:00<?, ?B/s] model-00002-of-00002.safetensors: 1%| | 33.8M/2.77G [00:01<01:55, 23.7MB/s] model-00002-of-00002.safetensors: 7%|▋ | 202M/2.77G [00:02<00:30, 85.4MB/s]  model-00002-of-00002.safetensors: 27%|██▋ | 740M/2.77G [00:03<00:07, 259MB/s]  model-00002-of-00002.safetensors: 39%|███▉ | 1.08G/2.77G [00:05<00:07, 225MB/s] model-00002-of-00002.safetensors: 61%|██████▏ | 1.70G/2.77G [00:06<00:03, 335MB/s] model-00002-of-00002.safetensors: 86%|████████▌ | 2.37G/2.77G [00:07<00:00, 424MB/s] model-00002-of-00002.safetensors: 100%|██████████| 2.77G/2.77G [00:08<00:00, 344MB/s] Loading checkpoint shards: 0%| | 0/2 [00:00<?, ?it/s] Loading checkpoint shards: 100%|██████████| 2/2 [00:00<00:00, 1468.59it/s] Traceback (most recent call last): File "/home/user/app/app.py", line 8, in <module> model = AutoModelForCausalLM.from_pretrained(MODEL_NAME, torch_dtype=torch.float16, device_map="auto") File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 571, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 279, in _wrapper return func(*args, **kwargs) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4475, in from_pretrained dispatch_model(model, **device_map_kwargs) File "/usr/local/lib/python3.10/site-packages/accelerate/big_modeling.py", line 501, in dispatch_model raise ValueError( ValueError: You are trying to offload the whole model to the disk. Please use the `disk_offload` function instead.

Container logs: