samcheng0 commited on
Commit
bf15fe4
·
verified ·
1 Parent(s): d94fc9d

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -125,6 +125,7 @@ Input tokens
125
  | `train_tiny.yaml` | 0.8KB | Training config: LR, batch, QLoRA, CFT settings |
126
  | `best.pt` | 2.6MB | Best checkpoint (QLoRA, NF4 quantized) |
127
  | `best_fp32.pt` | 3.8MB | Dequantized fp32 checkpoint (~970K params) |
 
128
  | `tokenizer.json` | 125KB | BPE tokenizer (4096 vocab, 3874 merges) |
129
  | `tokenizer_config.json` | 0.6KB | Tokenizer config with chat template |
130
  | `gen_tokenizer.py` | 3.5KB | BPE tokenizer trainer (58 textbooks) |
 
125
  | `train_tiny.yaml` | 0.8KB | Training config: LR, batch, QLoRA, CFT settings |
126
  | `best.pt` | 2.6MB | Best checkpoint (QLoRA, NF4 quantized) |
127
  | `best_fp32.pt` | 3.8MB | Dequantized fp32 checkpoint (~970K params) |
128
+ | `dequantize_qlora.py` | 2KB | Utility to dequantize QLoRA → fp32 |
129
  | `tokenizer.json` | 125KB | BPE tokenizer (4096 vocab, 3874 merges) |
130
  | `tokenizer_config.json` | 0.6KB | Tokenizer config with chat template |
131
  | `gen_tokenizer.py` | 3.5KB | BPE tokenizer trainer (58 textbooks) |