Upload model files

README.md

@@ -1,3 +1,58 @@
 ---
+library_name: PyLaia
 license: mit
+tags:
+- PyLaia
+- PyTorch
+- Handwritten text recognition
+metrics:
+- CER
+- WER
+language:
+- 'fr'
+datasets:
+- Teklia/Belfort
 ---
+
+# Belfort handwritten text recognition
+
+This model performs Handwritten Text Recognition in French on historical documents.
+
+## Model description
+
+The model was trained using the PyLaia library on the [Belfort dataset](https://zenodo.org/records/8041668).
+
+For training, text-lines were resized with a fixed height of 128 pixels, keeping the original aspect ratio. Vertical lines are discarded.
+
+| split | N lines | 
+| ----- | ------: | 
+| train | 25,800  |
+| val   |  3,102  |
+| test  |  3,819  |
+
+An external 6-gram character language model can be used to improve recognition. The language model is trained on the text from the NorHand v2 training set.
+
+## Evaluation results
+
+The model achieves the following results:
+
+| set   | Language model | CER (%)    | WER (%) | N lines   |
+|:------|:---------------|:----------:|:-------:|----------:|
+| test  | no             | 10.54      |   28.12 |     3,819 |
+| test  | yes            |  9.52      |   23.73 |     3,819 |
+
+## How to use
+
+Please refer to the [documentation](https://atr.pages.teklia.com/pylaia/).
+
+## Cite us
+
+```bibtex
+@inproceedings{pylaia-lib,
+    author = "Tarride, Solène and Schneider, Yoann and Generali, Marie and Boillet, Melodie and Abadie, Bastien and Kermorvant, Christopher",
+    title = "Improving Automatic Text Recognition with Language Models in the PyLaia Open-Source Library",
+    booktitle = "Submitted at ICDAR2024",
+    year = "2024"
+}
+```
+

language_model.arpa.gz

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:cbb30d655c189a8f13e3a87c47252a65198493ee6d0859dcd289f97cee4ee6fa
+size 11272705

lexicon.txt

@@ -0,0 +1,117 @@
+<ctc> <ctc>
+! !
+" "
+% %
+& &
+' '
+( (
+) )
+* *
++ +
+, ,
+- -
+. .
+/ /
+0 0
+1 1
+2 2
+3 3
+4 4
+5 5
+6 6
+7 7
+8 8
+9 9
+: :
+; ;
+< <
+= =
+> >
+? ?
+A A
+B B
+C C
+D D
+E E
+F F
+G G
+H H
+I I
+J J
+K K
+L L
+M M
+N N
+O O
+P P
+Q Q
+R R
+S S
+T T
+U U
+V V
+W W
+X X
+Y Y
+Z Z
+[ [
+] ]
+_ _
+a a
+b b
+c c
+d d
+e e
+f f
+g g
+h h
+i i
+j j
+k k
+l l
+m m
+n n
+o o
+p p
+q q
+r r
+s s
+t t
+u u
+v v
+w w
+x x
+y y
+z z
+{ {
+| |
+} }
+§ §
+« «
+° °
+² ²
+º º
+» »
+À À
+É É
+Ü Ü
+à à
+â â
+ç ç
+è è
+é é
+ê ê
+ë ë
+î î
+ï ï
+ô ô
+ù ù
+û û
+ü ü
+ÿ ÿ
+Œ Œ
+œ œ
+’ ’
+… …
+<unk> <unk>
+<space> <space>

syms.txt

@@ -0,0 +1,117 @@
+<ctc> 0
+! 1
+" 2
+% 3
+& 4
+' 5
+( 6
+) 7
+* 8
++ 9
+, 10
+- 11
+. 12
+/ 13
+0 14
+1 15
+2 16
+3 17
+4 18
+5 19
+6 20
+7 21
+8 22
+9 23
+: 24
+; 25
+< 26
+= 27
+> 28
+? 29
+A 30
+B 31
+C 32
+D 33
+E 34
+F 35
+G 36
+H 37
+I 38
+J 39
+K 40
+L 41
+M 42
+N 43
+O 44
+P 45
+Q 46
+R 47
+S 48
+T 49
+U 50
+V 51
+W 52
+X 53
+Y 54
+Z 55
+[ 56
+] 57
+_ 58
+a 59
+b 60
+c 61
+d 62
+e 63
+f 64
+g 65
+h 66
+i 67
+j 68
+k 69
+l 70
+m 71
+n 72
+o 73
+p 74
+q 75
+r 76
+s 77
+t 78
+u 79
+v 80
+w 81
+x 82
+y 83
+z 84
+{ 85
+| 86
+} 87
+§ 88
+« 89
+° 90
+² 91
+º 92
+» 93
+À 94
+É 95
+Ü 96
+à 97
+â 98
+ç 99
+è 100
+é 101
+ê 102
+ë 103
+î 104
+ï 105
+ô 106
+ù 107
+û 108
+ü 109
+ÿ 110
+Π111
+œ 112
+’ 113
+… 114
+<unk> 115
+<space> 116

tokens.txt

@@ -0,0 +1,117 @@
+<ctc>
+!
+"
+%
+&
+'
+(
+)
+*
++
+,
+-
+.
+/
+0
+1
+2
+3
+4
+5
+6
+7
+8
+9
+:
+;
+<
+=
+>
+?
+A
+B
+C
+D
+E
+F
+G
+H
+I
+J
+K
+L
+M
+N
+O
+P
+Q
+R
+S
+T
+U
+V
+W
+X
+Y
+Z
+[
+]
+_
+a
+b
+c
+d
+e
+f
+g
+h
+i
+j
+k
+l
+m
+n
+o
+p
+q
+r
+s
+t
+u
+v
+w
+x
+y
+z
+{
+|
+}
+§
+«
+°
+²
+º
+»
+À
+É
+Ü
+à
+â
+ç
+è
+é
+ê
+ë
+î
+ï
+ô
+ù
+û
+ü
+ÿ
+Œ
+œ
+’
+…
+<unk>
+<space>

weights.ckpt

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e73ff66f52effd625d4063b5549755bfa0b69ed9fc28edf6c6d30af111f723cd
+size 42819548