How to use guymorlan/TokenizerLabeller with Transformers:
# Load model directly from transformers import AutoTokenizer, AutoModelForSeq2SeqLM tokenizer = AutoTokenizer.from_pretrained("guymorlan/TokenizerLabeller") model = AutoModelForSeq2SeqLM.from_pretrained("guymorlan/TokenizerLabeller")
b352d7f c679e8d b352d7f
1
2
3
4
version https://git-lfs.github.com/spec/v1 oid sha256:62dc9701b0fabe7beca6d2a021bf914326b13f0525901bff24e792324c8a0594 size 308321413
