Structured Direct-Sum study
Collection
Controlled Strict-Small study of syntax, lexical, and conceptual priors. • 13 items • Updated
How to use miguelcsx/tolm-structured-ds-conceptual with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("fill-mask", model="miguelcsx/tolm-structured-ds-conceptual", trust_remote_code=True) # Load model directly
from transformers import AutoModelForMaskedLM
model = AutoModelForMaskedLM.from_pretrained("miguelcsx/tolm-structured-ds-conceptual", trust_remote_code=True, device_map="auto")This repository preserves an already-trained checkpoint from the controlled BabyLM research tournament. No training or evaluation was run for this release.
main is identical to chck_100M, selected from the existing local tournament
record. Other revisions, when present, are archived checkpoints rather than new
experiments.
| Evaluation | Score |
|---|---|
| BLiMP | 65.10 |
| Supp | 59.60 |
| EWoK | 51.00 |
| ET | 19.18 |
| COMPS | 52.38 |
| GlobalPIQA | 38.16 |
The canonical code is maintained at
miguelcsx/tolm. Remote code is required to
load this custom Transformers model; review tolm.py before use.