Osama-Rakan-Al-Mraikhat commited on
Commit
7d31e4a
·
verified ·
1 Parent(s): afbd112

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -0
README.md CHANGED
@@ -96,6 +96,7 @@ If you use the code, model, or the Muradif benchmark, please cite:
96
  address = "San Diego, California, United States",
97
  publisher = "Association for Computational Linguistics",
98
  url = "https://aclanthology.org/2026.findings-acl.1293/",
 
99
  pages = "25952--25968",
100
  ISBN = "979-8-89176-395-1",
101
  abstract = "We present NeoAraBERT, a state-of-the-art open-source Arabic text-embedding model built on the NeoBERT architecture. We pre-train NeoAraBERT on diverse open-source and internal datasets covering modern standard, classical, and dialectal Arabic. We guided our design choices with Arabic tailored ablation studies including text normalization, light stemming, and diacritics-aware tokenization handling. We also performed more general POS-aware token masking and learning-rate scheduling ablation studies. We benchmarked NeoAraBERT against five top-performing Arabic models on 23 tasks, including a novel synonym-based task, ``Muradif'', that directly assesses embedding quality with no additional fine-tuning. NeoAraBERT variants (MSA, dialectal, and mixed) rank first in 18 tasks, second in two, third in two, and fourth in one task. They show strong performance on classical and modern standard Arabic, substantial margins of improvement ($>$7{\%}) in two tasks, and a $+$2.75{\%} improvement on average across all tasks. Our code and links to checkpoints for our model variants are available on our website: \url{https://acr.ps/neoarabert}."
 
96
  address = "San Diego, California, United States",
97
  publisher = "Association for Computational Linguistics",
98
  url = "https://aclanthology.org/2026.findings-acl.1293/",
99
+ doi = "10.18653/v1/2026.findings-acl.1293",
100
  pages = "25952--25968",
101
  ISBN = "979-8-89176-395-1",
102
  abstract = "We present NeoAraBERT, a state-of-the-art open-source Arabic text-embedding model built on the NeoBERT architecture. We pre-train NeoAraBERT on diverse open-source and internal datasets covering modern standard, classical, and dialectal Arabic. We guided our design choices with Arabic tailored ablation studies including text normalization, light stemming, and diacritics-aware tokenization handling. We also performed more general POS-aware token masking and learning-rate scheduling ablation studies. We benchmarked NeoAraBERT against five top-performing Arabic models on 23 tasks, including a novel synonym-based task, ``Muradif'', that directly assesses embedding quality with no additional fine-tuning. NeoAraBERT variants (MSA, dialectal, and mixed) rank first in 18 tasks, second in two, third in two, and fourth in one task. They show strong performance on classical and modern standard Arabic, substantial margins of improvement ($>$7{\%}) in two tasks, and a $+$2.75{\%} improvement on average across all tasks. Our code and links to checkpoints for our model variants are available on our website: \url{https://acr.ps/neoarabert}."