Add SRLM-1M
#39
by Martico2432 - opened
SRLM-1M
Wikitext v2 byte_perplexity: 4.4553
Arc_easy acc_norm: 28.66%
Arc_easy acc: 26.39%
Blimp acc: 53.1%
lm_eval_harness v0.4.12
Training data: smollm-corpus, subset fineweb-edu-dedup
I did accept to terms
CompactAI changed pull request status to merged