Jonandrop commited on
Commit
2648208
ยท
verified ยท
1 Parent(s): 97dd0bd

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +14 -5
README.md CHANGED
@@ -5,17 +5,25 @@ library_name: onnx
5
  tags:
6
  - lemmatization
7
  - token-classification
8
- - camelbert
9
  - onnx
10
  - int8
11
- base_model: CAMeL-Lab/BERT-coarse-NER-Arabic-cased
12
  ---
13
 
14
- # Arabic CAMeLBERT Lemmatizer (int8 ONNX)
15
 
16
- Arabic lemmatizer + UPOS tagger fine-tuned from CAMeLBERT.
17
  Predicts an **edit-tree label** per token; applying it to the surface word yields the lemma.
18
- Dynamic-int8 quantized ONNX.
 
 
 
 
 
 
 
 
 
19
 
20
  ## CRITICAL: valid-label masking
21
 
@@ -26,4 +34,5 @@ Plain argmax over edit-tree labels often picks a label that is structurally inva
26
  - `config.json`, `tokenizer.json`, `tokenizer_config.json`, `special_tokens_map.json`
27
  - `id2label.json` / `label2id.json`: edit-tree lemma labels
28
  - `upos_id2label.json` / `upos_label2id.json`: UPOS labels
 
29
  - `lexicon.json`: fallback {word: lemma} lexicon
 
5
  tags:
6
  - lemmatization
7
  - token-classification
 
8
  - onnx
9
  - int8
10
+ base_model: CAMeL-Lab/bert-base-arabic-camelbert-msa
11
  ---
12
 
13
+ # Arabic Lemmatizer (int8 ONNX)
14
 
15
+ Per-language lemmatizer and UPOS tagger fine-tuned from [CAMeL-Lab/bert-base-arabic-camelbert-msa](https://huggingface.co/CAMeL-Lab/bert-base-arabic-camelbert-msa) on UD Arabic-PADT.
16
  Predicts an **edit-tree label** per token; applying it to the surface word yields the lemma.
17
+ Dynamic-int8 quantized ONNX (~112 MB).
18
+
19
+ ## Accuracy (UD test, dynamic int8, valid-label masking ON)
20
+
21
+ | Metric | int8 | fp (reference) |
22
+ |--------|------|----------------|
23
+ | Lemma accuracy | 43.91% | 43.91% |
24
+ | UPOS accuracy | 68.32% | N/A |
25
+
26
+ int8 trades accuracy for size; the fp16/torch model is several points higher (UPOS head is most affected by quantization).
27
 
28
  ## CRITICAL: valid-label masking
29
 
 
34
  - `config.json`, `tokenizer.json`, `tokenizer_config.json`, `special_tokens_map.json`
35
  - `id2label.json` / `label2id.json`: edit-tree lemma labels
36
  - `upos_id2label.json` / `upos_label2id.json`: UPOS labels
37
+ - `edit_trees.json`: edit-tree label definitions
38
  - `lexicon.json`: fallback {word: lemma} lexicon