File size: 1,720 Bytes
17c042b 810fd7e c3b75d3 810fd7e 6998275 810fd7e 6998275 d74c89d | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 | ---
license: mit
---
<div align="center">
# 🤖 SmallDront-60M
*A lightweight conversational AI model designed for natural small talk*
[](https://opensource.org/licenses/MIT)
[](https://huggingface.co/)
[]()
[]()
</div>
---
## 📝 Overview
**SmallDront-60M** is a compact language model specifically fine-tuned for engaging small talk conversations. With 60 million parameters in F32 precision, it strikes a balance between performance and efficiency — delivering coherent, natural dialogue without the overhead of larger models.
> *Compared to its predecessor (SmallDront-20M), this model properly ends its responses and hallucinates significantly less.*
---
## ✨ Features
| Feature | Detail |
|---------|--------|
| 🧠 **Architecture** | Transformer-based |
| 🔢 **Parameters** | +-60,000,000 |
| 📐 **Precision** | F32 (Full float32) |
| 🔤 **Tokenizer** | **GPT-2 Tokenizer** |
| 📦 **Format** | Hugging Face |
| 🏷️ **Special Tokens** | `<\|user\|>` `<\|assistant\|>` |
---
## 🎓 Training
The model was trained on the **[VDC-team/DialoguesEN-4k](https://huggingface.co/datasets/VDC-team/DialoguesEN-4k)** dataset until reaching a loss of **0.9**.
---
## 💬 Example Conversations
*Temperature: 0.3*
```text
You: Who are you?
Assistant: Just a friendly chat. You?
You: Hello!
Assistant: Hey! What's a place you feel at?
You: Where you?
Assistant: Hi, for a chat. You?
```
**use.py** - use model example
|