Structured Direct-Sum study
Collection
Controlled Strict-Small study of syntax, lexical, and conceptual priors. • 13 items • Updated
How to use miguelcsx/tolm-structured-ds-syntax-lexical with Transformers:
# Use a pipeline as a high-level helper
from transformers import pipeline
pipe = pipeline("fill-mask", model="miguelcsx/tolm-structured-ds-syntax-lexical", trust_remote_code=True) # Load model directly
from transformers import AutoModelForMaskedLM
model = AutoModelForMaskedLM.from_pretrained("miguelcsx/tolm-structured-ds-syntax-lexical", trust_remote_code=True, device_map="auto")This repository preserves an already-trained checkpoint from the controlled BabyLM research tournament. No training or evaluation was run for this release.
main is identical to chck_100M, selected from the existing local tournament
record. Other revisions, when present, are archived checkpoints rather than new
experiments.
| Evaluation | Score |
|---|---|
| BLiMP | 65.51 |
| Supp | 59.60 |
| EWoK | 49.09 |
| ET | 19.23 |
| COMPS | 52.15 |
| GlobalPIQA | 39.58 |
The canonical code is maintained at
miguelcsx/tolm. Remote code is required to
load this custom Transformers model; review tolm.py before use.