Instructions to use litert-community/gemma-4-E2B-it-litert-lm with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- LiteRT-LM
How to use litert-community/gemma-4-E2B-it-litert-lm with LiteRT-LM:
# LiteRT-LM runs on various platforms (Android, iOS, Windows, Linux, macOS, IoT, Web/WASM) # and supports many APIs (C++, Python, Kotlin, Swift, JavaScript, Flutter). # For platform-specific integration guides, please refer to the official developer website: # https://ai.google.dev/edge/litert-lm # To try LiteRT-LM, the easiest way is to use our CLI tool. # 1. Install the LiteRT-LM CLI tool: pip install litert-lm # 2. Download and run this model locally: # See: https://ai.google.dev/edge/litert-lm/cli litert-lm run \ --from-huggingface-repo=litert-community/gemma-4-E2B-it-litert-lm \ model.litertlm \ --prompt="Write me a poem"
- Notebooks
- Google Colab
- Kaggle
NPU Inference Support for SM8845
#34 opened 3 days ago
by
huajingzhou
NPU models with larger KV-cache (8K/16K/32K) for SM8845
1
#33 opened 9 days ago
by
yellowredfish
Any chacne for a release of a 128k KV-CACHE version of the .litertlm gemma4 E2B-E4B models?
❤️ 2
2
#31 opened 10 days ago
by
A-L-01
Model with QAT?
🤗 1
7
#30 opened 13 days ago
by
4ntoine
How can I quantize/convert the model to support Qualcomm SM8850 platform?
👀 1
#29 opened 13 days ago
by
jattanyiip
الاسفار المحذوفة
1
#27 opened 21 days ago
by
FrBotros
does gemma-4-E2B-it_qualcomm_sm8750.litertlm run on NPU with chipset sm8750 , how to use it with android application?
1
#25 opened about 1 month ago
by
umakant-2026
Custom app with gemma model on android ,especially snapdragon gen 2
#22 opened about 1 month ago
by
vkvishal23
Model card
#21 opened about 1 month ago
by
QSCB
The latest model has no precision In GPU/CPU
#20 opened about 1 month ago
by
jeisonvendetta
gemma-4-E2B-it_qualcomm_qcs8275.litertlm vision encoder not optimized for NPU!
#19 opened about 1 month ago
by
sanoopsadheerthan
New gemma-4-E2B-it.litertlm broken!
4
#16 opened about 2 months ago
by
lktinhtemp
Convert finetuned google/gemma-4-E2B-it model to liteRT-LM
➕ 12
#15 opened about 2 months ago
by
SalihHub
Conversion from fine tuned merged model to litertlm
➕ 9
#14 opened about 2 months ago
by
darahask
Request for conversion flow of Gemma-4 Qualcomm NPU model
👀 2
4
#13 opened about 2 months ago
by
sanoopsadheerthan
does this litertlm support vision also, and how can i use for image on android application?
1
#11 opened about 2 months ago
by
piyushsinha0908
Upload 3 files
#10 opened about 2 months ago
by
sysia48
Are there plans to support Qualcomm 8550 NPU?
🤝 1
#8 opened 2 months ago
by
MrrrKing
How to convert Gemma-4 model to litertlm format?
5
#7 opened 2 months ago
by
hpkim0512
SM-8650 Model
1
#6 opened 2 months ago
by
HarshTri007
How did you LiteRT Gemma4 ?
3
#5 opened 2 months ago
by
Handyfff
GPU precision bug
2
#4 opened 2 months ago
by
jeisonvendetta
litertlm for qcs6490
1
#3 opened 3 months ago
by
suneetk