primitive-ai
/

Qwen3.8-Flash-Next-PLE-quant

qwen3.8-flash-next

Model card Files Files and versions

Qwen3.8-Flash-Next-PLE-quant

Ctrl+K

Ctrl+K

3 contributors

History: 22 commits

jagat-primitive-org's picture

jagat-primitive-org

mgabor3141's picture

Optional resident mode for the quantized tables (VLLM_PLE_QUANT_RESIDENT) (#2)

a0fa93f about 13 hours ago

assets
Add Primitive brand banner, logo and card thumbnail 17 days ago
ples_fp8
Upload folder using huggingface_hub 18 days ago
ples_int4
Upload folder using huggingface_hub 18 days ago
ples_nvfp4
Upload folder using huggingface_hub 18 days ago
.gitattributes

1.57 kB
Add Primitive brand banner, logo and card thumbnail 17 days ago
README.md

13 kB
Optional resident mode for the quantized tables (VLLM_PLE_QUANT_RESIDENT) (#2) about 13 hours ago
connector_mrv2.py

19.2 kB
ship the async-MRV2 connector fix as an overlay (upstream 4e8b849) 15 days ago
ple_layer_quant.py

52.4 kB
Overlay: build the n-gram table parameter on the meta device when VLLM_PLE_QUANT_DIR is set, and swap the stub Parameter instead of set_data — removes the 102 GB virtual reservation that the kernel's overcommit heuristic refuses on hosts with less RAM+swap than the table (field report, 64 GB host); validated under an emulated 67/99 GiB commit limit, sanity PASS, tool-calling 77.0 (n=3), 81 tok/s c1 9 days ago
worker_image_quant.py

47.4 kB
Optional resident mode for the quantized tables (VLLM_PLE_QUANT_RESIDENT) (#2) about 13 hours ago