Instructions to use litert-community/Vision-RWKV-S-LiteRT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT
How to use litert-community/Vision-RWKV-S-LiteRT with LiteRT:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- RWKV
How to use litert-community/Vision-RWKV-S-LiteRT with RWKV:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Add measured Raspberry Pi 5 (CPU) section
Browse filesNumbers from the 2026-08-31 Raspberry Pi 5 sweep: LiteRT benchmark_model
(litert-cli-nightly 0.2.0.dev20260805), CPU/XNNPACK, 4 threads, 10 warm-up +
50 timed runs x 3 invocations per file, cooldown between invocations, thermal
throttle state verified 0x0 on every run. Median + spread, never single-shot.
Measurements are joined to this repo by exact .tflite file name.
README.md
CHANGED
|
@@ -127,6 +127,14 @@ Measured on a **Samsung Galaxy S26** (Snapdragon 8 Elite Gen 5 / SM8850, Hexagon
|
|
| 127 |
|
| 128 |
The NPU rows here ran artifacts compiled ahead of time for SM8850 with QAIRT 2.47.0; the GPU rows ran the published files as they are. LiteRT can also compile for the NPU on the device at first load, which is what lets you ship the published file unchanged — that path and the ten runtime libraries it needs are in the [NPU recipe](https://github.com/john-rocky/hf-to-litertlm/blob/main/docs/android-npu.md), and we did not measure it here. GPU wiring is in the [GPU recipe](https://github.com/john-rocky/hf-to-litertlm/blob/main/docs/android-gpu.md).
|
| 129 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 130 |
## License
|
| 131 |
|
| 132 |
Apache-2.0 (Vision-RWKV / OpenGVLab). Converted with litert-torch.
|
|
|
|
| 127 |
|
| 128 |
The NPU rows here ran artifacts compiled ahead of time for SM8850 with QAIRT 2.47.0; the GPU rows ran the published files as they are. LiteRT can also compile for the NPU on the device at first load, which is what lets you ship the published file unchanged — that path and the ten runtime libraries it needs are in the [NPU recipe](https://github.com/john-rocky/hf-to-litertlm/blob/main/docs/android-npu.md), and we did not measure it here. GPU wiring is in the [GPU recipe](https://github.com/john-rocky/hf-to-litertlm/blob/main/docs/android-gpu.md).
|
| 129 |
|
| 130 |
+
## Raspberry Pi 5 (CPU)
|
| 131 |
+
|
| 132 |
+
Measured on a Raspberry Pi 5 Model B Rev 1.1 (8 GB, Raspberry Pi OS 64-bit) with the LiteRT [`benchmark_model`](https://ai.google.dev/edge/litert/models/measurement) tool from litert-cli-nightly 0.2.0.dev20260805: CPU inference (XNNPACK, 4 threads), 3 invocations per file of 10 warm-up plus 50 timed runs (the tool caps a phase at 150 s, so very slow graphs run fewer — the Runs column is the actual timed total). The latency is the median across invocations; the spread is the min–max over all timed runs. No thermal throttling occurred during these runs (`vcgencmd get_throttled` stayed `0x0`).
|
| 133 |
+
|
| 134 |
+
| File | Inference (median) | Spread (min–max) | Runs | Peak memory |
|
| 135 |
+
|---|---:|---:|---:|---:|
|
| 136 |
+
| `vrwkv_s_fp16.tflite` | 1,082.6 ms | 1,075.0–1,128.4 ms | 150 | 277 MB |
|
| 137 |
+
|
| 138 |
## License
|
| 139 |
|
| 140 |
Apache-2.0 (Vision-RWKV / OpenGVLab). Converted with litert-torch.
|