Instructions to use wjbmattingly/LightOnOCR-2-1B-german-shorthand-line with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use wjbmattingly/LightOnOCR-2-1B-german-shorthand-line with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="wjbmattingly/LightOnOCR-2-1B-german-shorthand-line")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoModel
model = AutoModel.from_pretrained("wjbmattingly/LightOnOCR-2-1B-german-shorthand-line", dtype="auto")

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use wjbmattingly/LightOnOCR-2-1B-german-shorthand-line with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "wjbmattingly/LightOnOCR-2-1B-german-shorthand-line"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "wjbmattingly/LightOnOCR-2-1B-german-shorthand-line",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/wjbmattingly/LightOnOCR-2-1B-german-shorthand-line

SGLang

How to use wjbmattingly/LightOnOCR-2-1B-german-shorthand-line with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "wjbmattingly/LightOnOCR-2-1B-german-shorthand-line" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "wjbmattingly/LightOnOCR-2-1B-german-shorthand-line",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "wjbmattingly/LightOnOCR-2-1B-german-shorthand-line" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "wjbmattingly/LightOnOCR-2-1B-german-shorthand-line",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use wjbmattingly/LightOnOCR-2-1B-german-shorthand-line with Docker Model Runner:
```
docker model run hf.co/wjbmattingly/LightOnOCR-2-1B-german-shorthand-line
```

wjbmattingly commited on Jan 23

Commit

e5c9e42

verified ·

1 Parent(s): e6e1fa7

Upload folder using huggingface_hub

Browse files

Files changed (8) hide show

README.md +7 -7
adapter_config.json +3 -3
adapter_model.safetensors +1 -1
optimizer.pt +1 -1
rng_state.pth +1 -1
scheduler.pt +1 -1
trainer_state.json +0 -0
training_args.bin +1 -1

README.md CHANGED Viewed

@@ -42,8 +42,8 @@ Evaluated on 50 samples from the test set:
 | Metric | Base Model | **Finetuned** | Improvement |
 |--------|------------|---------------|-------------|
-| CER (%) | 381.26 | **42.36** | +338.90 |
-| WER (%) | 494.99 | **64.26** | +430.73 |
 | Perfect Matches | 0 | **0** | +0 |
 *Lower CER/WER is better. Higher perfect matches is better.*
@@ -52,13 +52,13 @@ Evaluated on 50 samples from the test set:
 | # | Ground Truth | Base Model | **Finetuned** |
 |---|--------------|------------|---------------|
-| 1 | (Haupt der seligen Irmeng. gefunden. Im ... | 12/12/1998 10:00 AM 10:00 AM 10:00 AM 10... |  (gegeben) der Ministerrate Renerg. gegeb... |
-| 2 | Schw. Reinh.: Ist vom Lagerdienst freige... | Schw. Reinh. : 2d 9.20 16 09 J. 6 |  Schw. Keinh.: Ist vom Bahn Dienst frei g... |
 | 3 | Klage daß im Naz.heim den Kranken die Ko... | $$
 \begin{aligned}
-& \text { 22 e 2 haz.... |  Köllege der im Naz. heimenden den Kranke... |
-| 4 | Irene: Stimmung sehr verschieden. Kommen... |  |  Irene: Stadtsalze verheizt. Mündwochenta... |
-| 5 | Zwei Schwestern Calabrien: M. Cristina u... | 226  *Kolabrie: M. Cisneros, Urode* |  2 Schüler Kalabrien: M. Cristin und Urot... |
 *✓ = exact match*

 | Metric | Base Model | **Finetuned** | Improvement |
 |--------|------------|---------------|-------------|
+| CER (%) | 381.26 | **21.89** | +359.37 |
+| WER (%) | 494.99 | **37.41** | +457.58 |
 | Perfect Matches | 0 | **0** | +0 |
 *Lower CER/WER is better. Higher perfect matches is better.*
 | # | Ground Truth | Base Model | **Finetuned** |
 |---|--------------|------------|---------------|
+| 1 | (Haupt der seligen Irmeng. gefunden. Im ... | 12/12/1998 10:00 AM 10:00 AM 10:00 AM 10... |  (Haupt der seitdem Jänner 12 20 bei Daue... |
+| 2 | Schw. Reinh.: Ist vom Lagerdienst freige... | Schw. Reinh. : 2d 9.20 16 09 J. 6 |  Schw. Reinh.: Ist vom Lagerdienst frei g... |
 | 3 | Klage daß im Naz.heim den Kranken die Ko... | $$
 \begin{aligned}
+& \text { 22 e 2 haz.... |  Klage daß im Naz.heim den Kranken die Ko... |
+| 4 | Irene: Stimmung sehr verschieden. Kommen... |  |  Irene: Stimmung sehr verschiedenes. Münd... |
+| 5 | Zwei Schwestern Calabrien: M. Cristina u... | 226  *Kolabrie: M. Cisneros, Urode* |  Zwei Schwestern Katalrien: M. Cristina u... |
 *✓ = exact match*

adapter_config.json CHANGED Viewed

@@ -29,10 +29,10 @@
   "rank_pattern": {},
   "revision": null,
   "target_modules": [
-    "gate_proj",
     "o_proj",
-    "up_proj",
-    "down_proj"
   ],
   "target_parameters": null,
   "task_type": "CAUSAL_LM",

   "rank_pattern": {},
   "revision": null,
   "target_modules": [
     "o_proj",
+    "gate_proj",
+    "down_proj",
+    "up_proj"
   ],
   "target_parameters": null,
   "task_type": "CAUSAL_LM",

adapter_model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:1ca7b929077ecf070581db47c62ce66d95f003dcc20f74f652e0f9a3e6b07e25
 size 27195864

 version https://git-lfs.github.com/spec/v1
+oid sha256:b9a3f7bbcd733b37e7fade8d080afcdb906c992d8f41f25cc929deeb7c33cf4a
 size 27195864

optimizer.pt CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c1c9facd94cb2e2056de8984cc1aec60348675a1813f69313d4cb2ea1a65ac4f
 size 54619587

 version https://git-lfs.github.com/spec/v1
+oid sha256:39e0446d1b2447d14ae7f9d2c29a06b083607f03d6ea1a9840841c296cfdaf69
 size 54619587

rng_state.pth CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:55f2abdef5cd78fd62feaf412430810fe399fc4c1b3e7789b4a120db0ba23298
 size 14645

 version https://git-lfs.github.com/spec/v1
+oid sha256:a216119dd691a5c4c3cf0919e27729f871b1e66e778348c7af2b1e385a09ffc3
 size 14645

scheduler.pt CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:2c6573d722babc8f6ad9589485f3a65a358c28bebf3df9bbe494de2bf43fcc16
 size 1465

 version https://git-lfs.github.com/spec/v1
+oid sha256:7fd0298d5a94f9b48cacf7130ace0cb1063b3c6e2d7b8233ce3f128cc30d02e9
 size 1465

trainer_state.json CHANGED Viewed

The diff for this file is too large to render. See raw diff

training_args.bin CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:020018416b464a0690194cddc585291f3a5c862cf8df24553e47d165cf3c9f8c
 size 5201

 version https://git-lfs.github.com/spec/v1
+oid sha256:a60cb8bedd244cb81ccf2137e14e0c6d5b71ccad42c31d4e1482adf4b34ccde3
 size 5201