Commit ·
bae1a37
1
Parent(s): 8669022
Updated readme.
Browse files
README.md
CHANGED
|
@@ -24,7 +24,7 @@ PLDR-LLM-v51G-106M-test is a large language model from power law decoder represe
|
|
| 24 |
|
| 25 |
## Training data
|
| 26 |
|
| 27 |
-
PLDR-LLM-v51G-106M-
|
| 28 |
|
| 29 |
## Training procedure
|
| 30 |
|
|
|
|
| 24 |
|
| 25 |
## Training data
|
| 26 |
|
| 27 |
+
PLDR-LLM-v51G-106M-test was pretrained on the [RefinedWeb](https://huggingface.co/datasets/tiiuae/falcon-refinedweb), a publicly available English web dataset with extensive filtering and deduplication.
|
| 28 |
|
| 29 |
## Training procedure
|
| 30 |
|