DeepSeek-V4-Flash-Acti-MTP-W4A16-FP8 / generation_config.json
LordNeel's picture
Initial release: pasta-paul base + Acti MTP block (RTN INT4 routed experts, FP8_BLOCK attn)
07fed2d verified
Raw
History Blame Contribute Delete
174 Bytes
{
"_from_model_config": true,
"bos_token_id": 0,
"do_sample": true,
"eos_token_id": 1,
"temperature": 1.0,
"top_p": 1.0,
"transformers_version": "5.8.0.dev0"
}