File size: 529 Bytes
93eecae | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 | ---
library_name: pytorch
tags:
- custom-gpt
- small-language-model
- continued-training
- embedded-systems
---
# Continued SLM Checkpoint
Base model: `ishu-newaz/EmbedXPT`
Continued training dataset: `SkunkworksAI/reasoning-0.01`
Training format: `### Instruction` + `### Reasoning` + `### Answer`
Tokenizer: `tiktoken` GPT-2 encoding
Parameters: approximately 505.2M
This is a custom PyTorch checkpoint, not a Transformers `AutoModel` checkpoint. Load it with the custom `GPT` and `GPTConfig` classes from the notebook.
|