Foundation Text-Generation Models Below 360M Parameters
Great candidates for fine-tuning targeting Wllama and Transformers.js for mobile devices, ordered by number of parameters.
Text Generation • 0.4B • Updated • 484k • 128Note License: apache-2.0 Context Length: 8k
facebook/MobileLLM-R1-360M-base
Text Generation • 0.4B • Updated • 81 • 14Note License: fair-noncommercial-research Context Length: 4k
LiquidAI/LFM2.5-350M-Base
Text Generation • 0.4B • Updated • 11.9k • 32Note License: lfm1.0 Context Length: 32k
PleIAs/Pleias-350m-Preview
0.4B • Updated • 353k • 27Note License: apache-2.0 Context Length: 2k
OuteAI/Lite-Oute-1-300M
Text Generation • 0.3B • Updated • 38.2k • 9Note License: apache-2.0 Context Length: 4k
keeeeenw/MicroLlama
Text Generation • 0.3B • Updated • 420 • 53Note License: apache-2.0 Context Length: 2k
google/gemma-3-270m
Text Generation • 0.3B • Updated • 1.14M • 1.09kNote License: gemma Context Length: 32k
UUFO-Aigis/Pico-OpenLAiNN-250M
0.3B • Updated • 15 • 3Note License: apache-2.0 Context Length: 2k
upstage/TinySolar-248m-4k
Text Generation • 0.2B • Updated • 354 • 12Note License: apache-2.0 Context Length: 4k
M4-ai/TinyMistral-248M-v3
Text Generation • 0.2B • Updated • 103 • 8Note License: apache-2.0 Context Length: 2k
LiquidAI/LFM2.5-230M-Base
Text Generation • 0.2B • Updated • 17.2k • 19Note License: lfm1.0 Context Length: 32k
MiniLLM/MiniPLM-llama3.1-212M
Text Generation • 0.2B • Updated • 19 • 6Note License: apache-2.0 Context Length: 1k
MiniLLM/MiniPLM-Qwen-200M
Text Generation • 0.2B • Updated • 1.31k • 9Note License: apache-2.0 Context Length: 1k
xTimeCrystal/MiniModel-200M-Base
Text Generation • 0.2B • Updated • 58 • 30Note License: apache-2.0 Context Length: 2k
princeton-nlp/Sheared-Pythia-160m
Text Generation • Updated • 66 • 4Note License: apache-2.0 Context Length: 2k
JackFram/llama-160m
Text Generation • 0.2B • Updated • 84.5k • 37Note License: apache-2.0 Context Length: 2k
SmallDoge/Doge-160M
Text Generation • 0.2B • Updated • 53 • 7Note License: apache-2.0 Context Length: 2k
EleutherAI/pythia-160m
Text Generation • 0.2B • Updated • 3.44M • 45Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Pro-Preview
Text Generation • 0.2B • Updated • 820 • 24Note License: other (bananamind-community-license-1.0) Context Length: 3k
Harikrish2727/BetterGPT-150M
Text Generation • 0.2B • Updated • 219 • 1Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-150m
Fill-Mask • Updated • 1.39k • 6Note License: mit Context Length: 8k
StentorLabs/Portimbria-150M
Text Generation • 0.2B • Updated • 138 • 11Note License: apache-2.0 Context Length: 4k
facebook/MobileLLM-R1-140M-base
Text Generation • 0.1B • Updated • 296 • 22Note License: fair-noncommercial-research Context Length: 4k
joelhenwang/OdinNext-138M-Base
Text Generation • 0.1B • Updated • 96 • 2Note License: apache-2.0 Context Length: 2k
openai-community/gpt2
Text Generation • 0.1B • Updated • 14.8M • 3.82kNote License: mit Context Length: 1k
HuggingFaceTB/SmolLM2-135M
Text Generation • 0.1B • Updated • 2.55M • 231Note License: apache-2.0 Context Length: 8k
amd/AMD-Llama-135m
Text Generation • 0.1B • Updated • 12.5k • 120Note License: apache-2.0 Context Length: 2k
AxiomicLabs/GPT-X2.5-135M
Text Generation • 0.1B • Updated • 2.33k • 64Note License: apache-2.0 Context Length: 8k
MaliosDark/Nexus-Erebus-135M
Text Generation • 0.1B • Updated • 339 • 10Note License: other Context Length: 1k
MiniLLM/MiniPLM-Mamba-130M
Text Generation • 0.1B • Updated • 46 • 4Note License: apache-2.0 Context Length: 1k
Nikity/lille-130m-base
Text Generation • 0.1B • Updated • 102 • 18Note License: apache-2.0 Context Length: 0.5k
EleutherAI/gpt-neo-125m
Text Generation • 0.2B • Updated • 523k • 229Note License: mit Context Length: 2k
opencerebral/Boris-1.3-125M
Text Generation • 0.1B • Updated • 465 • 4Note License: apache-2.0 Context Length: 1k
TobiasLogic/Museko-125M
Text Generation • 0.1B • Updated • 443 • 9Note License: apache-2.0 Context Length: 2k
facebook/opt-125m
Text Generation • Updated • 8.82M • 296Note License: other (OPT-175B License Agreement, non-commercial research only) Context Length: 2k
BEE-spoke-data/smol_llama-101M-GQA
Text Generation • 0.1B • Updated • 440 • 33Note License: apache-2.0 Context Length: 1k
UUFO-Aigis/Pico-OpenLAiNN-100M
0.1B • Updated • 29 • 2Note License: apache-2.0 Context Length: 2k
SupraLabs/Supra2-100M-Base
Text Generation • 0.1B • Updated • 853 • 23Note License: apache-2.0 Context Length: 1k
raincandy-u/Rain-100M
Text Generation • 97.2M • Updated • 121 • 23Note License: apache-2.0 Context Length: 4k
FlameF0X/TinyMoE-100m-2x8-retrained
Text Generation • 99.8M • Updated • 424 • 3Note License: mit Context Length: 1k
Sandroeth/cali-0.1B
Text Generation • 0.1B • Updated • 100 • 5Note License: apache-2.0 Context Length: 1k
HuggingFaceTB/nanowhale-100m-base
Text Generation • 0.1B • Updated • 767 • 22Note License: apache-2.0 Context Length: 2k
Felladrin/Minueza-2-96M
Text Generation • 96M • Updated • 67 • 6Note License: apache-2.0 Context Length: 4k
Felladrin/Minueza-3-95M-Base
Text Generation • 94.7M • Updated • 218 • 3Note License: apache-2.0 Context Length: 8k
finnianx/Gros-Michel-90m-Base-v2
94.9M • Updated • 482 • 6Note License: not specified Context Length: 1k
appvoid/palmer-006
Text Generation • 91.1M • Updated • 320 • 10Note License: other (appvoid-noncommercial-model-license-1.0) Context Length: 256k
distilbert/distilgpt2
Text Generation • 88.2M • Updated • 1.91M • 640Note License: apache-2.0 Context Length: 1k
Quazim0t0/Escarda-86M-Base
Text Generation • 97.3M • Updated • 358 • 4Note License: apache-2.0 Context Length: 4k
Quazim0t0/Byrne-86M-Base
Text Generation • 96.9M • Updated • 126 • 3Note License: apache-2.0 Context Length: 4k
weiser/82M-0.4
Text Generation • 82.1M • Updated • 32Note License: apache-2.0 Context Length: 1k
BEE-spoke-data/smol_llama-81M-tied
Text Generation • 81.3M • Updated • 125 • 10Note License: apache-2.0 Context Length: 1k
opencerebral/Boris-1.3-75M
Text Generation • 77.4M • Updated • 371 • 1Note License: apache-2.0 Context Length: 1k
MinimaLabs/KeyLM-75M
Text Generation • 75.3M • Updated • 229 • 18Note License: apache-2.0 Context Length: 2k
GODELEV/Archaea-74M-V1.1
Text Generation • 74M • Updated • 287 • 4Note License: mit Context Length: 1k
EleutherAI/pythia-70m
95.6M • Updated • 464k • 85Note License: apache-2.0 Context Length: 2k
JackFram/llama-68m
Text Generation • Updated • 114k • 38Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-68m
Fill-Mask • Updated • 153 • 1Note License: mit Context Length: 8k
OuteAI/Lite-Oute-1-65M
Text Generation • 65M • Updated • 49 • 12Note License: apache-2.0 Context Length: 2k
WhirlwindAI/MetaNova-1-60M
62.7M • Updated • 158 • 7Note License: apache-2.0 Context Length: 3k
SmallDoge/Doge-60M
Text Generation • 54.6M • Updated • 74 • 5Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Medium
Text Generation • 55.9M • Updated • 2.22k • 18Note License: apache-2.0 Context Length: 3k
MaliosDark/Nexus-Erebus-50M
Text Generation • 54.1M • Updated • 292 • 8Note License: apache-2.0 Context Length: 1k
MaliosDark/Isabel-50M
Text Generation • 54.1M • Updated • 103 • 11Note License: apache-2.0 Context Length: 1k
SupraLabs/Supra-50M-Base
Text Generation • 51.8M • Updated • 1.75k • 41Note License: apache-2.0 Context Length: 1k
veyra-ai/Veyra2-Apricot-50M-Base
Text Generation • 49.3M • Updated • 913 • 12Note License: apache-2.0 Context Length: 2k
StentorLabs/Stentor3-50M
Text Generation • 49.4M • Updated • 818 • 6Note License: apache-2.0 Context Length: 4k
GODELEV/Rose-Mini
Text Generation • 49.4M • Updated • 492 • 15Note License: apache-2.0 Context Length: 1k
harrrshall/BarunLM-35M
Text Generation • 35.1M • Updated • 53Note License: apache-2.0 Context Length: 2k
sabari2005/cyberslm-33m-base
Text Generation • 33.5M • Updated • 130 • 1Note License: apache-2.0 Context Length: 4k
Felladrin/Minueza-32M-Base
Text Generation • 32.8M • Updated • 905 • 19Note License: apache-2.0 Context Length: 2k
GerbilLab/Gerbil-A-32m
Text Generation • Updated • 14 • 2Note License: apache-2.0 Context Length: 2k
jhu-clsp/ettin-decoder-32m
Text Generation • Updated • 637Note License: mit Context Length: 8k
fromziro/Er-Large-30M
31.9M • Updated • 173 • 4Note License: apache-2.0 Context Length: 1k
EleutherAI/pythia-31m-deduped
Text Generation • 55.7M • Updated • 2.33k • 5Note License: apache-2.0 Context Length: 2k
BananaMind/BananaMind-2-Mini
Text Generation • 28.3M • Updated • 436 • 16Note License: apache-2.0 Context Length: 4k
BananaMind/BananaMind-2-MoE
Text Generation • 26.1M • Updated • 1.49k • 12Note License: apache-2.0 Context Length: 4k
SmallDoge/Doge-20M
Text Generation • 13.1M • Updated • 971 • 13Note License: apache-2.0 Context Length: 2k
StentorLabs/Stentor3-20M
Text Generation • 20.3M • Updated • 156 • 6Note License: apache-2.0 Context Length: 4k
jhu-clsp/ettin-decoder-17m
Fill-Mask • Updated • 2.65k • 2Note License: mit Context Length: 8k
MultivexAI/Plyx-15M
Text Generation • 16.1M • Updated • 123 • 7Note License: apache-2.0 Context Length: 512
EleutherAI/pythia-14m-deduped
Text Generation • 39.2M • Updated • 31.4k • 30Note License: apache-2.0 Context Length: 2k
fromziro/Er-Medium-12.5M
12.5M • Updated • 49 • 11Note License: apache-2.0 Context Length: 384
BananaMind/BananaMind-2-Nano
Text Generation • 12.1M • Updated • 3.96k • 15Note License: apache-2.0 Context Length: 4k
liodon-ai/slm-10m
Text Generation • 12.1M • Updated • 97 • 13Note License: apache-2.0 Context Length: 1k
Dream-W/ObsidianSmall-Base
Text Generation • 9.77M • Updated • 222 • 4Note License: not specified Context Length: 1k
User01110/CMA-8M
Text Generation • 9.08M • Updated • 383 • 20Note License: apache-2.0 Context Length: 1k
DedeProGames/DynamicMind-Mini
8.88M • Updated • 150 • 4Note License: apache-2.0 Context Length: 1k
Harley-ml/Tenete-8M
Text Generation • 8.29M • Updated • 36 • 7Note License: mit Context Length: 1k
AtomixLabs/AtomixS2-5M-v1.0
Text Generation • 5.98M • Updated • 849 • 3Note License: apache-2.0 Context Length: 512
LH-Tech-AI/Spark-5M-Base-v4
Text Generation • 4.98M • Updated • 66 • 3Note License: not specified Context Length: 512
MaliosDark/Nexus-Erebus-3M
Text Generation • 3M • Updated • 167 • 3Note License: mit Context Length: 512
UniversalComputingResearch/Atom2.7m
Text Generation • 2.74M • Updated • 115 • 16Note License: apache-2.0 Context Length: 512
MihaiPopa-1/CinnabarLM-1.4M-Base
Text Generation • 1.51M • Updated • 54Note License: apache-2.0 Context Length: 2k
Harley-ml/Dillionv2-1.3M
Text Generation • 1.29M • Updated • 410 • 4Note License: mit Context Length: 384
fromziro/Er-Tiny-1.3M
1.33M • Updated • 106 • 7Note License: apache-2.0 Context Length: 384
56m/Dumb-1.2-RC1
Text Generation • 34.6M • Updated • 249Note License: apache-2.0 Context Length: 1k
AtomixLabs/Photon-2.0-1M
Text Generation • 1.05M • Updated • 617 • 8Note License: apache-2.0 Context Length: 512
Glint-Research/Glint-1.3
Updated • 101 • 13Note License: mit Context Length: 256