functions/sae_pretrain/datasets/README.md

Datasets

The datasets used for SAE pretraining are all publicly available and can be constructed directly following the instructions in the paper.

Due to the large storage size of the pretraining corpus, we do not host the full dataset in this repository.
After the paper is accepted, we will release a download link via a cloud drive to facilitate reproduction.