--- license: cc-by-sa-4.0 language: - no tags: - dependency-parsing - combo - universal-dependencies datasets: - universal_dependencies model-name: Combo Nlp Xlm Roberta Base Norwegian Nynorsk Ud2.17 pipeline_tag: token-classification --- # COMBO-NLP Model for Norwegian ## Model Description This is a Norwegian-language model based on [combo-nlp](https://pypi.org/project/combo-nlp/), an open-source natural language preprocessing system. It performs: - sentence segmentation (via [combo-seg](https://pypi.org/project/combo-seg/)) - tokenisation (via [combo-seg](https://pypi.org/project/combo-seg/)) - part-of-speech tagging - morphological analysis - lemmatisation - dependency parsing The Norwegian model uses ``FacebookAI/xlm-roberta-base`` as its base encoder and is trained on [UD_Norwegian-Nynorsk](https://github.com/UniversalDependencies/UD_Norwegian-Nynorsk) (UD v2.17). ## Evaluation Evaluation was performed on the UD_Norwegian-Nynorsk test split using the standard [CoNLL 2018 eval script](https://universaldependencies.org/conll18/conll18_ud_eval.py). Two evaluation rows are reported: - **Full-text (F1)**: raw text is segmented by [combo-seg](https://pypi.org/project/combo-seg/), then parsed and compared against gold — measures end-to-end pipeline performance including segmentation quality. - **Aligned accuracy**: accuracy on correctly segmented (aligned) tokens — measures parsing quality on tokens that were correctly identified by the segmenter. ### Morphosyntactic Tagging | Metric | Tokens | Sentences | Words | UPOS | XPOS | UFeats | AllTags | Lemmas | | ------ | ------ | --------- | ----- | ---- | ---- | ------ | ------- | ------ | | Full-text (F1) | 99.96 | 97.74 | 99.96 | 98.70 | 99.26 | 96.65 | 96.04 | 98.73 | | Aligned accuracy | 0.00 | 0.00 | 0.00 | 98.75 | 99.31 | 96.70 | 96.08 | 98.78 | ### Dependency Parsing | Metric | UAS | LAS | CLAS | MLAS | BLEX | | ------ | --- | --- | ---- | ---- | ---- | | Full-text (F1) | 94.85 | 93.61 | 91.56 | 86.42 | 89.89 | | Aligned accuracy | 94.89 | 93.65 | 91.42 | 86.29 | 89.76 | ## Usage Install the library from PyPI (assuming you have a virtual environment created): ```bash pip install combo-nlp ``` The [combo-seg](https://pypi.org/project/combo-seg/) segmenter (used to split and tokenise raw text) is installed automatically as a dependency of `combo-nlp`, so no extra install step is needed. ```python from combo import COMBO # Load a pre-trained model with the corresponding combo-seg segmenter nlp = COMBO("Norwegian") # Parse raw text (handles sentence splitting + tokenization) result = nlp("Den raske brune reven hopper over den late hunden.") # Inspect results for sentence in result: for token in sentence: print(f"{token.form:<15} {token.lemma:<15} {token.upos:<8} head={token.head} {token.deprel}") ``` Refer to the combo-nlp documentation for installation and usage instructions: - [https://pypi.org/project/combo-nlp/](https://pypi.org/project/combo-nlp/) - [https://pypi.org/project/combo-seg/](https://pypi.org/project/combo-seg/) ## License The training data license: cc-by-sa-4.0 is derived from the Universal Dependencies treebank. For the full license terms of each treebank, please refer to the corresponding `LICENSE.txt` file in the treebank repository: - [UD_Norwegian-Nynorsk LICENSE.txt](https://github.com/UniversalDependencies/UD_Norwegian-Nynorsk/blob/master/LICENSE.txt) ## Citation If you use this model, please cite: Ulewicz, M., Jabłońska, M., Klimaszewski, M., Przybyła, P., Pszenny, Ł., Rybak, P., Wiącek, M., & Wróblewska, A. (2026). *COMBO-NLP Models Trained on UD v2.17*. Zenodo. https://doi.org/10.5281/zenodo.19650523 ```bibtex @software{combo_nlp_2026, author = {Ulewicz, Michał and Jabłońska, Maja and Klimaszewski, Mateusz and Przybyła, Piotr and Pszenny, Łukasz and Rybak, Piotr and Wiącek, Martyna and Wróblewska, Alina}, title = {{COMBO-NLP} Models Trained on {UD} v2.17}, year = {2026}, publisher = {Zenodo}, doi = {10.5281/zenodo.19650523}, url = {https://doi.org/10.5281/zenodo.19650523} } ``` ## Resources - combo-nlp: [https://pypi.org/project/combo-nlp/](https://pypi.org/project/combo-nlp/) - combo-seg: [https://pypi.org/project/combo-seg/](https://pypi.org/project/combo-seg/) - UD_Norwegian-Nynorsk: [https://github.com/UniversalDependencies/UD_Norwegian-Nynorsk](https://github.com/UniversalDependencies/UD_Norwegian-Nynorsk)