cotyle-fix commited on
Commit
c8e20d5
·
1 Parent(s): 01d8d06

Use CUDA 12.8 PyTorch for ZeroGPU Blackwell GPUs

Browse files

ZeroGPU now runs on NVIDIA RTX PRO 6000 Blackwell (sm_120), which the cu126
torch wheels don't support -> "no kernel image is available for execution on
the device" at GPU call time.

- install.sh: install torch 2.8.0 + torchvision 0.23.0 from the cu128 index
- my_req.txt: drop torch/torchvision/triton and all nvidia-*-cu12 (12.6.x)
pins so the cu128 torch owns the CUDA stack and mmcv/mmgen compile against it

Files changed (2) hide show
  1. install.sh +9 -5
  2. my_req.txt +1 -19
install.sh CHANGED
@@ -7,11 +7,15 @@ set -e
7
  # it). Keep a pre-82 setuptools, plus the tools needed to build native exts.
8
  pip install "setuptools<82" wheel ninja
9
 
10
- # Install torch first, at the SAME versions pinned in my_req.txt, so mmcv/mmgen
11
- # are compiled against the exact torch used at runtime (otherwise their compiled
12
- # extensions raise ABI / "undefined symbol" errors), and torch isn't downloaded
13
- # twice.
14
- pip install torch==2.7.1 torchvision==0.22.1
 
 
 
 
15
 
16
  # --- piFlow (lakonlab) -------------------------------------------------------
17
  # Install ONLY the `lakonlab` package, not piFlow's own dependencies: piFlow's
 
7
  # it). Keep a pre-82 setuptools, plus the tools needed to build native exts.
8
  pip install "setuptools<82" wheel ninja
9
 
10
+ # Install torch first. ZeroGPU now runs on NVIDIA RTX PRO 6000 Blackwell
11
+ # (compute capability sm_120), which is ONLY supported by CUDA 12.8+ builds of
12
+ # PyTorch -- the default cu126 wheels raise "no kernel image is available for
13
+ # execution on the device". Use the cu128 build (torch 2.8.x is the minimum
14
+ # version supported by HF ZeroGPU). torch/torchvision/triton/nvidia-* are
15
+ # intentionally NOT pinned in my_req.txt so this install owns the CUDA stack,
16
+ # and mmcv/mmgen below compile against this exact torch.
17
+ pip install --index-url https://download.pytorch.org/whl/cu128 \
18
+ torch==2.8.0 torchvision==0.23.0
19
 
20
  # --- piFlow (lakonlab) -------------------------------------------------------
21
  # Install ONLY the `lakonlab` package, not piFlow's own dependencies: piFlow's
my_req.txt CHANGED
@@ -1,4 +1,3 @@
1
- torchvision==0.22.1
2
  numpy==2.2.6
3
  accelerate==1.9.0
4
  diffusers @ git+https://github.com/huggingface/diffusers@7a2b78bf0f788d311cc96b61e660a8e13e3b1e63
@@ -72,20 +71,6 @@ multidict==6.7.0
72
  multiprocess==0.70.16
73
  networkx==3.4.2
74
  ninja==1.13.0
75
- nvidia-cublas-cu12==12.6.4.1
76
- nvidia-cuda-cupti-cu12==12.6.80
77
- nvidia-cuda-nvrtc-cu12==12.6.77
78
- nvidia-cuda-runtime-cu12==12.6.77
79
- nvidia-cudnn-cu12==9.5.1.17
80
- nvidia-cufft-cu12==11.3.0.4
81
- nvidia-cufile-cu12==1.11.1.6
82
- nvidia-curand-cu12==10.3.7.77
83
- nvidia-cusolver-cu12==11.7.1.2
84
- nvidia-cusparse-cu12==12.5.4.2
85
- nvidia-cusparselt-cu12==0.6.3
86
- nvidia-nccl-cu12==2.26.2
87
- nvidia-nvjitlink-cu12==12.6.85
88
- nvidia-nvtx-cu12==12.6.77
89
  omegaconf==2.3.0
90
  onnxruntime==1.22.1
91
  opencv-python==4.12.0.88
@@ -123,10 +108,7 @@ sympy==1.14.0
123
  timm==1.0.19
124
  tokenizers==0.21.4
125
  tomlkit==0.13.3
126
- torch==2.7.1
127
- torchvision==0.22.1
128
  tqdm==4.67.1
129
- triton==3.3.1
130
  typer==0.19.2
131
  typing-inspection==0.4.2
132
  typing_extensions==4.15.0
@@ -136,4 +118,4 @@ uvicorn==0.37.0
136
  websockets==15.0.1
137
  xxhash==3.6.0
138
  yarl==1.22.0
139
- zipp==3.23.0
 
 
1
  numpy==2.2.6
2
  accelerate==1.9.0
3
  diffusers @ git+https://github.com/huggingface/diffusers@7a2b78bf0f788d311cc96b61e660a8e13e3b1e63
 
71
  multiprocess==0.70.16
72
  networkx==3.4.2
73
  ninja==1.13.0
 
 
 
 
 
 
 
 
 
 
 
 
 
 
74
  omegaconf==2.3.0
75
  onnxruntime==1.22.1
76
  opencv-python==4.12.0.88
 
108
  timm==1.0.19
109
  tokenizers==0.21.4
110
  tomlkit==0.13.3
 
 
111
  tqdm==4.67.1
 
112
  typer==0.19.2
113
  typing-inspection==0.4.2
114
  typing_extensions==4.15.0
 
118
  websockets==15.0.1
119
  xxhash==3.6.0
120
  yarl==1.22.0
121
+ zipp==3.23.0