Instructions to use Chunjiang-Intelligence/DeepSeek-v4-Fable with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use Chunjiang-Intelligence/DeepSeek-v4-Fable with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("text-generation", model="Chunjiang-Intelligence/DeepSeek-v4-Fable")

# Load model directly
from transformers import AutoTokenizer, AutoModelForCausalLM

tokenizer = AutoTokenizer.from_pretrained("Chunjiang-Intelligence/DeepSeek-v4-Fable")
model = AutoModelForCausalLM.from_pretrained("Chunjiang-Intelligence/DeepSeek-v4-Fable", device_map="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use Chunjiang-Intelligence/DeepSeek-v4-Fable with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "Chunjiang-Intelligence/DeepSeek-v4-Fable"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Chunjiang-Intelligence/DeepSeek-v4-Fable",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker

docker model run hf.co/Chunjiang-Intelligence/DeepSeek-v4-Fable

SGLang

How to use Chunjiang-Intelligence/DeepSeek-v4-Fable with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "Chunjiang-Intelligence/DeepSeek-v4-Fable" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Chunjiang-Intelligence/DeepSeek-v4-Fable",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "Chunjiang-Intelligence/DeepSeek-v4-Fable" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "Chunjiang-Intelligence/DeepSeek-v4-Fable",
		"prompt": "Once upon a time,",
		"max_tokens": 512,
		"temperature": 0.5
	}'

Docker Model Runner
How to use Chunjiang-Intelligence/DeepSeek-v4-Fable with Docker Model Runner:
```
docker model run hf.co/Chunjiang-Intelligence/DeepSeek-v4-Fable
```

nekocyrene commited on Jun 23

Commit

1fb2ee0

verified ·

1 Parent(s): 4c7f1fa

Upload folder using huggingface_hub

Browse files

Files changed (32) hide show

DeepSeek-V4-Flash-00001-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00002-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00003-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00004-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00005-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00006-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00007-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00008-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00009-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00010-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00011-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00012-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00013-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00014-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00015-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00016-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00017-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00018-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00019-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00020-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00021-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00022-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00023-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00024-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00025-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00026-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00027-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00028-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00029-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00030-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00031-of-00032.safetensors +3 -0
DeepSeek-V4-Flash-00032-of-00032.safetensors +3 -0

DeepSeek-V4-Flash-00001-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:411c43ef078682a2615ba06d4d5e1e244dbea01cdf7c19c34b9550265a1b212a
+size 5536667532

DeepSeek-V4-Flash-00002-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a3a783824f6cdff686adf7a065e1e6e4c79c1f9f828fa7d156c1596a866b3652
+size 4827519552

DeepSeek-V4-Flash-00003-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:33cb9fc746c80cc5411d728a94090d500e80151f11eb71ae17ba75ab5bdbb17a
+size 5159802592

DeepSeek-V4-Flash-00004-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:042675403c8a77b93abaf958226a4f3c294b620c12fffcaae9e95e3ff69f3872
+size 4827696280

DeepSeek-V4-Flash-00005-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c5de59c1f8a51258a3aea74c5dbcba5b16b1c9773522e57ad4d188ed5fc48ae5
+size 5141210720

DeepSeek-V4-Flash-00006-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:dc98bb2caf5a65e35200fbd4dc746e5bc6d66ca65f6f21911e6411966b4b3ccf
+size 5159802240

DeepSeek-V4-Flash-00007-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ccd7cf433064d9a56a95837eae11f7ddd16ebf1cb53c9d1c7d471e1c5eeb1a13
+size 4827696640

DeepSeek-V4-Flash-00008-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:b94e7dcda2b95f20f274f33b2dd43cd9c254a943173ca490e9098e05bcbde781
+size 5141210600

DeepSeek-V4-Flash-00009-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:93b3b59366b7ab6ace285ef3e5c4cfe1d51b35c7537a9b0967f95927fcee9c64
+size 4827696152

DeepSeek-V4-Flash-00010-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:a8212e6bc934e924d000578e59f9c57fa6544edf1c1de446dbe633242de4b4cf
+size 5142957104

DeepSeek-V4-Flash-00011-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:6c2306ab6e5f0674f0e1531bf549d4bb05447c065fda26ebf0d5a7a1498c87ce
+size 5159802232

DeepSeek-V4-Flash-00012-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:c74901cbcbd74a69353bf63c51e78f2b4ce5b220e6eab8fea9aa99bc8ea9d8a7
+size 4827696648

DeepSeek-V4-Flash-00013-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1be0f685f888f38e703a5b7cfe88e692193a4040ac8c6cc0160feb8fb2febbe8
+size 5141210592

DeepSeek-V4-Flash-00014-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:f0b2d76f32d8935867ad43956614ebfcdf4d63536283e223a9aaf90790680a54
+size 4827696304

DeepSeek-V4-Flash-00015-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:8b6b8716737a444c9db35415c6066ad1b4bc8965238183ad0b6a98b37af7b15a
+size 5160064952

DeepSeek-V4-Flash-00016-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:148a74ee0253754c8b702067c85561e4b25acfd490d3b409bcd2dbb81a5bfd55
+size 5129414720

DeepSeek-V4-Flash-00017-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:885c5ffdc20645a888cf56a7b04ac290ded677560895d5143c114a8a46575fb7
+size 4844975888

DeepSeek-V4-Flash-00018-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:5015fd39023526b061392805129730e6a70d2e3b2ab59239b61daec40a48999d
+size 5140947264

DeepSeek-V4-Flash-00019-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:113976f29722ca603766e620039b10278dc2c215e7b5a60b7abb7c84f766d477
+size 4827696328

DeepSeek-V4-Flash-00020-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:501c801a62de57460b88abc09284c2e59da1666f37ad5246e5671142bf9501ae
+size 5160064960

DeepSeek-V4-Flash-00021-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:ae5f774db1f2e17dcdc448f0393ee0e6fd2e62dee53a66b0759d25dc32725c41
+size 5088256680

DeepSeek-V4-Flash-00022-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:0f379b160240b30ab782d301f6eed11f306a4b9327aec71b6073c3683984330a
+size 4867017952

DeepSeek-V4-Flash-00023-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e5063eb7dca91a2f02795adcb211ca23d11dd6d13b4e5cb761ead465f19fa83c
+size 5160064768

DeepSeek-V4-Flash-00024-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:49fb937201661f9c1b7b7f9bb9991d62dd4d595a4a324da878b6f6a9a5c116f2
+size 4827696360

DeepSeek-V4-Flash-00025-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:54cf078857935355abf909c66eb2bb5f37cb0a156e9f7487068b1b400fb13840
+size 5141209808

DeepSeek-V4-Flash-00026-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:71ae8c170f1691c4439e57ba7cd44d0a2329b00d0048daf490a69cd5f3e2b204
+size 5082236560

DeepSeek-V4-Flash-00027-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:cf03aa51de38ededd725352d27ce7a9ba6dd283728d0da0badbda12f88507393
+size 4886669688

DeepSeek-V4-Flash-00028-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:846a7887ed6daa674c91a8f53b3540ac23008ee4d1340d3e5cab4feb6d86a750
+size 5159801240

DeepSeek-V4-Flash-00029-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:38ccb4d46022261e286a8adf23a8de0e2d530c8839680fb74db74609a7317ec4
+size 4827694272

DeepSeek-V4-Flash-00030-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:1dde4d37b971b32a44b441ffe76a6b3ca488e2b73c718e8bb818f8b1ed308aec
+size 5141208440

DeepSeek-V4-Flash-00031-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:96d6cccc0efb49b78a5470446e2a20194852aa679816cf1017ee6a52fd9288f5
+size 5031621984

DeepSeek-V4-Flash-00032-of-00032.safetensors ADDED Viewed

	@@ -0,0 +1,3 @@

+version https://git-lfs.github.com/spec/v1
+oid sha256:e7ce5c1797ecc5618e2e31429bca8c05f49c8544ab7b4efa32fb6863b6d52282
+size 3591861188