From Babble to Words
Collection
The models, tokenizers and datasets used in From Babble to Words, one of the winning BabyLM 2024 submissions, exploring phoneme-based training. • 12 items • Updated
GPT2 trained on the BabyLM 2024 training set using a BPE tokenizer.
Model trained for From Babble to Words: Pre-Training Language Models on Continuous Streams of Phonemes.
- Downloads last month
- 49
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for phonemetransformers/GPT2-85M-BPE-TXT
Base model
openai-community/gpt2