| <!DOCTYPE html> |
| <html lang="en"> |
| <head> |
| <meta charset="utf-8"> |
| <meta name="viewport" content="width=device-width, initial-scale=1"> |
| <title>Inkling · xai</title> |
| <link rel="stylesheet" href="style.css"> |
| </head> |
| <body> |
|
|
| <h1>Inkling</h1> |
| <p class="meta">Thinking Machines · open MoE · weights public</p> |
| <nav class="meta"> |
| <a href="index.html">home</a> |
| <a href="inkling.html">Inkling</a> |
| <a href="kimi-k3.html">Kimi K3</a> |
| <a href="compare.html">compare</a> |
| <a href="study.html">study</a> |
| <a href="sources.html">sources</a> |
| <a href="msc.html">MSc</a> |
| </nav> |
|
|
| <hr> |
|
|
| <p> |
| ~<b>975B</b> total / <b>41B</b> active · <b>1M</b> ctx · native image+audio → text. |
| Apache 2.0. Released 2026-07-15. |
| </p> |
|
|
| <table> |
| <tr><th>piece</th><th>choice</th></tr> |
| <tr><td>body</td><td>66 layers · hidden 6144</td></tr> |
| <tr><td>FFN</td><td>dense L0–1 · MoE L2–65</td></tr> |
| <tr><td>MoE</td><td>256 routed · top-6 · 2 shared · sink</td></tr> |
| <tr><td>attn</td><td>55 SWA (512) · 11 global</td></tr> |
| <tr><td>position</td><td>relative PE (d_rel=16) · not RoPE</td></tr> |
| <tr><td>local</td><td>SConv k=4 · 4 states/layer</td></tr> |
| <tr><td>vision/audio</td><td>hMLP p=40 · dMel 80×16</td></tr> |
| </table> |
|
|
| <pre>text|image|audio → d=6144 |
| → SWA/global + relative R + SConv |
| → MoE 6/256+2 |
| → text (+ effort)</pre> |
|
|
| <p> |
| <a href="https://huggingface.co/thinkingmachines/Inkling">Hub</a> · |
| <a href="https://huggingface.co/datasets/lyffseba/xai-studies/tree/main/studies/models/inkling">package</a> · |
| <a href="compare.html">vs Kimi K3</a> |
| </p> |
|
|
| <p class="meta"><a href="index.html">← home</a></p> |
| </body> |
| </html> |
| |
|
|
