Hugging Face's logo

Hailay
/
geez-tokenizer

Token Classification
Transformers
Amharic
Tigrinya
tokenizer
byte-pair-encoding
bpe
geez-script
amharic
tigrinya
low-resource
nlp
morphology-aware
Horn of Africa
Model card Files
xet
 Community
Hailay commited on
Commit
98aeb25
·
verified ·
1 Parent(s): 725597f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -27,7 +27,7 @@ model-index:
27
 
28
  # Geez Tokenizer (`Hailay/geez-tokenizer`)
29
 
30
- A **BPE tokenizer** specifically trained for **Geez-script languages**, including **Tigrinya** and **Amharic**. The tokenizer is trained on monolingual corpora derived from the [HornMT](https://github.com/HornMT) project and supports morphologically rich low-resource languages.
31
 
32
  ## 🧠 Motivation
33
 
 
27
 
28
  # Geez Tokenizer (`Hailay/geez-tokenizer`)
29
 
30
+ A **BPE tokenizer** specifically trained for **Geez-script languages**, including **Tigrinya** and **Amharic**. The tokenizer is trained on monolingual corpora and supports morphologically rich low-resource languages.
31
 
32
  ## 🧠 Motivation
33