Asilarkness's picture
Expert-pruned 288->80, 62GB, with model card
e2032a6 verified
Raw History Blame Contribute Delete
194 Bytes
{
"_from_model_config": true,
"eos_token_id": [
154820,
154827,
154829
],
"pad_token_id": 154820,
"temperature": 1.0,
"top_p": 0.95,
"transformers_version": "5.16.0"
}