Instructions to use thinkingmachines/Inkling-Small with libraries, inference providers, notebooks, and local apps. Follow these links to get started.

Libraries

How to use thinkingmachines/Inkling-Small with Transformers:

# Use a pipeline as a high-level helper
from transformers import pipeline

pipe = pipeline("image-text-to-text", model="thinkingmachines/Inkling-Small")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
pipe(text=messages)

# Load model directly
from transformers import AutoProcessor, AutoModelForMultimodalLM

processor = AutoProcessor.from_pretrained("thinkingmachines/Inkling-Small")
model = AutoModelForMultimodalLM.from_pretrained("thinkingmachines/Inkling-Small", device_map="auto")
messages = [
    {
        "role": "user",
        "content": [
            {"type": "image", "url": "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/p-blog/candy.JPG"},
            {"type": "text", "text": "What animal is on the candy?"}
        ]
    },
]
inputs = processor.apply_chat_template(
	messages,
	add_generation_prompt=True,
	tokenize=True,
	return_dict=True,
	return_tensors="pt",
).to(model.device)

outputs = model.generate(**inputs, max_new_tokens=40)
print(processor.decode(outputs[0][inputs["input_ids"].shape[-1]:]))

Notebooks
Google Colab
Kaggle
Local Apps Settings

vLLM

How to use thinkingmachines/Inkling-Small with vLLM:

Install from pip and serve model

# Install vLLM from pip:
pip install vllm
# Start the vLLM server:
vllm serve "thinkingmachines/Inkling-Small"
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:8000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "thinkingmachines/Inkling-Small",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker

docker model run hf.co/thinkingmachines/Inkling-Small

SGLang

How to use thinkingmachines/Inkling-Small with SGLang:

Install from pip and serve model

# Install SGLang from pip:
pip install sglang
# Start the SGLang server:
python3 -m sglang.launch_server \
    --model-path "thinkingmachines/Inkling-Small" \
    --host 0.0.0.0 \
    --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "thinkingmachines/Inkling-Small",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Use Docker images

docker run --gpus all \
    --shm-size 32g \
    -p 30000:30000 \
    -v ~/.cache/huggingface:/root/.cache/huggingface \
    --env "HF_TOKEN=<secret>" \
    --ipc=host \
    lmsysorg/sglang:latest \
    python3 -m sglang.launch_server \
        --model-path "thinkingmachines/Inkling-Small" \
        --host 0.0.0.0 \
        --port 30000
# Call the server using curl (OpenAI-compatible API):
curl -X POST "http://localhost:30000/v1/chat/completions" \
	-H "Content-Type: application/json" \
	--data '{
		"model": "thinkingmachines/Inkling-Small",
		"messages": [
			{
				"role": "user",
				"content": [
					{
						"type": "text",
						"text": "Describe this image in one sentence."
					},
					{
						"type": "image_url",
						"image_url": {
							"url": "https://cdn.britannica.com/61/93061-050-99147DCE/Statue-of-Liberty-Island-New-York-Bay.jpg"
						}
					}
				]
			}
		]
	}'

Docker Model Runner
How to use thinkingmachines/Inkling-Small with Docker Model Runner:
```
docker model run hf.co/thinkingmachines/Inkling-Small
```

Inkling-Small

Commit History

Add community evaluation results for AIME_2026, GPQA, HLE, HMMT_FEB_2026, MMMU_PRO, SWE-BENCH_PRO, SWE-BENCH_VERIFIED (#2)

8cc5877

aurick

nielsr HF Staff commited on about 19 hours ago

Update README.md

b2d4f22
verified

aurick commited on 1 day ago

Update README.md

4024fac
verified

aurick commited on 1 day ago

Update README.md

173638a
verified

aurick commited on 1 day ago

Update README.md

d22e7eb
verified

aurick commited on 1 day ago

Update README.md

28da9a6
verified

aurick commited on 1 day ago

Update README.md

faeaccf
verified

aurick commited on 1 day ago

Update README.md

ccd03dc
verified

aurick commited on 1 day ago

Update README.md

191421c
verified

aurick commited on 1 day ago

Update README.md

9881ccf
verified

aurick commited on 2 days ago

Upload Inkling-Small model

21152b5
verified

aurick commited on 4 days ago

initial commit

8de0d24
verified

aurick commited on 4 days ago

Commit History

Add community evaluation results for AIME_2026, GPQA, HLE, HMMT_FEB_2026, MMMU_PRO, SWE-BENCH_PRO, SWE-BENCH_VERIFIED (#2) 8cc5877

Update README.md b2d4f22 verified

Update README.md 4024fac verified

Update README.md 173638a verified

Update README.md d22e7eb verified

Update README.md 28da9a6 verified

Update README.md faeaccf verified

Update README.md ccd03dc verified

Update README.md 191421c verified

Update README.md 9881ccf verified

Upload Inkling-Small model 21152b5 verified

initial commit 8de0d24 verified

Add community evaluation results for AIME_2026, GPQA, HLE, HMMT_FEB_2026, MMMU_PRO, SWE-BENCH_PRO, SWE-BENCH_VERIFIED (#2)

8cc5877

Update README.md

b2d4f22
verified

Update README.md

4024fac
verified

Update README.md

173638a
verified

Update README.md

d22e7eb
verified

Update README.md

28da9a6
verified

Update README.md

faeaccf
verified

Update README.md

ccd03dc
verified

Update README.md

191421c
verified

Update README.md

9881ccf
verified

Upload Inkling-Small model

21152b5
verified

initial commit

8de0d24
verified