QA_HUIT
Collection
10 items • Updated
YAML Metadata Warning:empty or missing yaml metadata in repo card
Check out the documentation for more information.
Fine-tuned from facebook/mbart-large-50 for Vietnamese
question answering on BaoNhan/FAIR_Dataset_QA.
raw| Metric | Value |
|---|---|
| Exact_Match | 26.81 |
| Token_F1 | 36.51 |
| ROUGE_1_F1 | 36.51 |
| ROUGE_2_F1 | 27.72 |
| ROUGE_L_F1 | 34.35 |
| BLEU | 7.85 |
| chrF | 19.78 |
| BERTScore_F1 | 86.73 |
predict.py is included in this repo:
python predict.py --model BaoNhan/vi-qa-mbart-large-50-noctx --mode raw \
--question "Viet Nam co bao nhieu tinh thanh?"
A paper describing this benchmark is in preparation. If you use this code or the released checkpoints, please cite it once it is available — the entry below is a placeholder and will be updated with the final venue, authors, and year.
@misc{TODO_citation_key,
title = {TODO: paper title},
author = {TODO: author list},
year = {TODO},
howpublished = {TODO: venue / arXiv preprint},
note = {Preprint in preparation},
url = {https://github.com/chaubaonhan/QA_Huit}
}