Upload README.md with huggingface_hub
Browse files
README.md
CHANGED
|
@@ -125,6 +125,7 @@ Input tokens
|
|
| 125 |
| `train_tiny.yaml` | 0.8KB | Training config: LR, batch, QLoRA, CFT settings |
|
| 126 |
| `best.pt` | 2.6MB | Best checkpoint (QLoRA, NF4 quantized) |
|
| 127 |
| `best_fp32.pt` | 3.8MB | Dequantized fp32 checkpoint (~970K params) |
|
|
|
|
| 128 |
| `tokenizer.json` | 125KB | BPE tokenizer (4096 vocab, 3874 merges) |
|
| 129 |
| `tokenizer_config.json` | 0.6KB | Tokenizer config with chat template |
|
| 130 |
| `gen_tokenizer.py` | 3.5KB | BPE tokenizer trainer (58 textbooks) |
|
|
|
|
| 125 |
| `train_tiny.yaml` | 0.8KB | Training config: LR, batch, QLoRA, CFT settings |
|
| 126 |
| `best.pt` | 2.6MB | Best checkpoint (QLoRA, NF4 quantized) |
|
| 127 |
| `best_fp32.pt` | 3.8MB | Dequantized fp32 checkpoint (~970K params) |
|
| 128 |
+
| `dequantize_qlora.py` | 2KB | Utility to dequantize QLoRA → fp32 |
|
| 129 |
| `tokenizer.json` | 125KB | BPE tokenizer (4096 vocab, 3874 merges) |
|
| 130 |
| `tokenizer_config.json` | 0.6KB | Tokenizer config with chat template |
|
| 131 |
| `gen_tokenizer.py` | 3.5KB | BPE tokenizer trainer (58 textbooks) |
|