primitive-ai
/

Qwen3.8-Flash-Next-PLE-quant

qwen3.8-flash-next

Model card Files Files and versions

Qwen3.8-Flash-Next-PLE-quant

Ctrl+K

Ctrl+K

3 contributors

History: 17 commits

jagat-primitive-org's picture

jagat-primitive-org

Card: defaults failures reproduced on our box; meta-device overlay revision shipped, sysctl now only for the BF16 disk path

7490249 verified 10 days ago

assets
Add Primitive brand banner, logo and card thumbnail 18 days ago
ples_fp8
Upload folder using huggingface_hub 20 days ago
ples_int4
Upload folder using huggingface_hub 20 days ago
ples_nvfp4
Upload folder using huggingface_hub 19 days ago
.gitattributes

1.57 kB
Add Primitive brand banner, logo and card thumbnail 18 days ago
README.md

9.7 kB
Card: defaults failures reproduced on our box; meta-device overlay revision shipped, sysctl now only for the BF16 disk path 10 days ago
connector_mrv2.py

19.2 kB
ship the async-MRV2 connector fix as an overlay (upstream 4e8b849) 16 days ago
ple_layer_quant.py

52.4 kB
Overlay: build the n-gram table parameter on the meta device when VLLM_PLE_QUANT_DIR is set, and swap the stub Parameter instead of set_data — removes the 102 GB virtual reservation that the kernel's overcommit heuristic refuses on hosts with less RAM+swap than the table (field report, 64 GB host); validated under an emulated 67/99 GiB commit limit, sanity PASS, tool-calling 77.0 (n=3), 81 tok/s c1 10 days ago
worker_image_quant.py

40.1 kB
Overlay: build the n-gram table parameter on the meta device when VLLM_PLE_QUANT_DIR is set, and swap the stub Parameter instead of set_data — removes the 102 GB virtual reservation that the kernel's overcommit heuristic refuses on hosts with less RAM+swap than the table (field report, 64 GB host); validated under an emulated 67/99 GiB commit limit, sanity PASS, tool-calling 77.0 (n=3), 81 tok/s c1 10 days ago