EleutherAI/bergson-smollm2-lds-32k
Leave-k-out model bank for an EK-FAC linear-datamodeling-score (LDS) study of
how attribution quality scales with training-set size N (this repo: N=32k
512-token chunks). GPT-2 fine-tuned on the 32k subset of
EleutherAI/bergson-smollm2-lds-chunks (packed from
EleutherAI/SmolLM2-135M-10B).
base/: GPT-2 fine-tuned on the full N-chunk training set (no leave-out).subset_0/…subset_99/: each retrains from scratch with a random 1%% of the training chunks held out, forming the LDS leave-k-out bank.
Queries: the query config of the dataset repo (50 held-out chunks).
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for EleutherAI/bergson-smollm2-lds-32k
Base model
openai-community/gpt2