Hugging Face
Models
Datasets
Spaces
Buckets
new
Docs
Enterprise
Pricing
Website
Tasks
HuggingChat
Collections
Languages
Organizations
Community
Blog
Posts
Daily Papers
Learn
Discord
Forum
GitHub
Solutions
Team & Enterprise
Hugging Face PRO
Enterprise Support
Inference Providers
Inference Endpoints
Storage Buckets
Log In
Sign Up
Sai5480
/
monolingual-tokenizer-native-san-vocab-128000
like
0
sentencepiece
tokenizer
monolingual
san
vocab-128000
License:
mit
Model card
Files
Files and versions
xet
Community
Copy to bucket
new
main
monolingual-tokenizer-native-san-vocab-128000
7.98 MB
Ctrl+K
Ctrl+K
1 contributor
History:
5 commits
Sai5480
Add README for san tokenizer
d41c880
verified
9 months ago
.gitattributes
Safe
1.52 kB
initial commit
9 months ago
README.md
618 Bytes
Add README for san tokenizer
9 months ago
config.json
227 Bytes
Add config.json for san tokenizer
9 months ago
san.model
4.05 MB
xet
Add san.model for san tokenizer
9 months ago
san.vocab
3.93 MB
Add san.vocab for san tokenizer
9 months ago
