# Load model directly
from transformers import AutoTokenizer, AutoModelForMaskedLM
tokenizer = AutoTokenizer.from_pretrained("giant-oak/lsg-roberta-base-4096", trust_remote_code=True)
model = AutoModelForMaskedLM.from_pretrained("giant-oak/lsg-roberta-base-4096", trust_remote_code=True)Quick Links
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Similar to the other publicly available LSG models, this model was created using the LSG conversion script found here then MLM pretrained on a sample of the OSCAR and BookCorpus datasets: https://github.com/ccdv-ai/convert_checkpoint_to_lsg
- Downloads last month
- 4
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("fill-mask", model="giant-oak/lsg-roberta-base-4096", trust_remote_code=True)