NER Próstata XLM-RoBERTa-large
Fine-tuning de xlm-roberta-large (560M params) sobre corpus clínico de cáncer de
próstata, en español. Tarea NER (token classification).
Subfolders
| Batch | F1 | Precision | Recall | Épocas |
|---|---|---|---|---|
| bs8 ⭐ | 0.9808 | 0.9788 | 0.9827 | 6 |
| bs16 | 0.9762 | 0.9738 | 0.9786 | 6 |
| bs32 | (subir cuando termine kernel ner-xlmr-prostata-bs32) | 6 (con grad_accum) |
Uso
from transformers import AutoModelForTokenClassification, AutoTokenizer
model = AutoModelForTokenClassification.from_pretrained(
"cvalenciaunivalle/ner-prostata-xlm-roberta-large", subfolder="bs8"
)
tokenizer = AutoTokenizer.from_pretrained("cvalenciaunivalle/ner-prostata-xlm-roberta-large", subfolder="bs8")
Detalles
- Hardware: Kaggle T4 16GB
- Trainer + EarlyStopping(patience=2)
- Taller PLN - Univalle. Compañeros: Laura Valero, Cristian Valencia
Model tree for cvalenciaunivalle/ner-prostata-xlm-roberta-large
Base model
FacebookAI/xlm-roberta-large