MishaGGG commited on
Commit
810fd7e
Β·
verified Β·
1 Parent(s): 17c042b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +45 -0
README.md CHANGED
@@ -1,3 +1,48 @@
1
  ---
2
  license: mit
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: mit
3
  ---
4
+ <div align="center">
5
+
6
+ # πŸ€– SmallDront-60M
7
+
8
+ *A lightweight conversational AI model designed for natural small talk*
9
+
10
+ [![License: MIT](https://img.shields.io/badge/License-MIT-yellow.svg)](https://opensource.org/licenses/MIT)
11
+ [![Hugging Face](https://img.shields.io/badge/πŸ€—%20Hugging%20Face-Model-blue)](https://huggingface.co/)
12
+ [![Parameters](https://img.shields.io/badge/Parameters-60M-green)]()
13
+ [![Format](https://img.shields.io/badge/Format-F32-orange)]()
14
+
15
+ </div>
16
+
17
+ ---
18
+
19
+ ## πŸ“ Overview
20
+
21
+ **SmallDront-60M** is a compact language model specifically fine-tuned for engaging small talk conversations. With 60 million parameters in F32 precision, it strikes a balance between performance and efficiency β€” delivering coherent, natural dialogue without the overhead of larger models.
22
+
23
+ > *Compared to its predecessor (SmallDront-20M), this model properly ends its responses and hallucinates significantly less.*
24
+
25
+ ---
26
+
27
+ ## ✨ Features
28
+
29
+ | Feature | Detail |
30
+ |---------|--------|
31
+ | 🧠 **Architecture** | Transformer-based |
32
+ | πŸ”’ **Parameters** | 60,000,000 |
33
+ | πŸ“ **Precision** | F32 (Full float32) |
34
+ | πŸ”€ **Tokenizer** | GPT-2 Tokenizer |
35
+ | πŸ“¦ **Format** | Hugging Face compatible |
36
+ | 🏷️ **Special Tokens** | `<\|user\|>` `<\|assistant\|>` |
37
+
38
+ ---
39
+
40
+ ## πŸŽ“ Training
41
+
42
+ The model was trained on the **[VDC-team/DialoguesEN-4k](https://huggingface.co/datasets/VDC-team/DialoguesEN-4k)** dataset until reaching a loss of **0.9**.
43
+
44
+ ---
45
+
46
+ ## πŸ’¬ Example Conversations
47
+
48
+ *Temperature: 0.3*