LordNeel/DeepSeek-V4-Flash-Acti-MTP-W4A16-FP8 at main

DeepSeek-V4-Flash-Acti-MTP-W4A16-FP8 / docker

20.9 kB

Ctrl+K

1 contributor

docker: end-to-end verified — runtime base is cudnn-devel (nvcc) + python3.12-dev + gcc for Triton JIT; image launches vLLM and serves /v1/models + /v1/chat/completions

c9ab0c1 verified 2 months ago

Dockerfile

5.99 kB
docker: end-to-end verified — runtime base is cudnn-devel (nvcc) + python3.12-dev + gcc for Triton JIT; image launches vLLM and serves /v1/models + /v1/chat/completions 2 months ago
README.md

4.66 kB
docker: working build (10.5 GB image, all patches verified) — docker/README.md 2 months ago
apply_mtp_patches.py

3.21 kB
Add Docker build assets: Dockerfile + entrypoint + patcher + compose + README 2 months ago
docker-compose.yml

1.02 kB
Add Docker build assets: Dockerfile + entrypoint + patcher + compose + README 2 months ago
entrypoint.sh

1.47 kB
Add Docker build assets: Dockerfile + entrypoint + patcher + compose + README 2 months ago
kyle-ct-quant.patch

4.61 kB
docker: working build (10.5 GB image, all patches verified) — docker/kyle-ct-quant.patch 2 months ago