runtime error
Exit code: 1. Reason: ncomplete total...): 82%|βββββββββ | 34.3G/41.8G [00:26<00:05, 1.50GB/s][A Downloading (incomplete total...): 89%|βββββββββ | 37.2G/41.8G [00:27<00:02, 1.64GB/s][A Downloading (incomplete total...): 96%|ββββββββββ| 40.0G/41.8G [00:30<00:01, 1.53GB/s][A Fetching 9 files: 89%|βββββββββ | 8/9 [00:31<00:03, 3.10s/it][A Fetching 9 files: 100%|ββββββββββ| 9/9 [00:31<00:00, 3.50s/it] Download complete: 100%|ββββββββββ| 41.8G/41.8G [00:31<00:00, 1.53GB/s] [ATraceback (most recent call last): File "/home/user/app/app.py", line 18, in <module> model = AutoModelForCausalLM.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/models/auto/auto_factory.py", line 405, in from_pretrained return model_class.from_pretrained( File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4296, in from_pretrained loading_info, disk_offload_index = cls._load_pretrained_model(model, state_dict, checkpoint_files, load_config) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 4377, in _load_pretrained_model caching_allocator_warmup(model, expanded_device_map, load_config.hf_quantizer) File "/usr/local/lib/python3.10/site-packages/transformers/modeling_utils.py", line 5020, in caching_allocator_warmup free_device_memory, total_device_memory = accelerator_module.mem_get_info(index) File "/usr/local/lib/python3.10/site-packages/torch/cuda/memory.py", line 842, in mem_get_info return torch.cuda.cudart().cudaMemGetInfo(device) File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 555, in cudart _lazy_init() File "/usr/local/lib/python3.10/site-packages/torch/cuda/__init__.py", line 478, in _lazy_init torch._C._cuda_init() RuntimeError: No CUDA GPUs are available Download complete: 100%|ββββββββββ| 41.8G/41.8G [00:31<00:00, 1.32GB/s]
Container logs:
Fetching error logs...