Chinese BERT, RoBERTa, MacBERT, LERT series
Collection
9 items β’ Updated β’ 11
# Load model directly
from transformers import AutoTokenizer, AutoModelForMaskedLM
tokenizer = AutoTokenizer.from_pretrained("hfl/chinese-lert-small")
model = AutoModelForMaskedLM.from_pretrained("hfl/chinese-lert-small")Quick Links
LERT
LERT is a linguistically-motivated pre-trained language model.
Further information: https://github.com/ymcui/LERT/blob/main/README_EN.md
- LERT: A Linguistically-motivated Pre-trained Language Model
- Yiming Cui, Wanxiang Che, Shijin Wang, Ting Liu
- Paper link: https://arxiv.org/abs/2211.05344
- Downloads last month
- 734
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="hfl/chinese-lert-small")