File size: 1,678 Bytes
5b6f50d d12ce70 5b6f50d d12ce70 5b6f50d d12ce70 5f56d31 5b6f50d d12ce70 5b6f50d d12ce70 5b6f50d d12ce70 5b6f50d d12ce70 5b6f50d d12ce70 5b6f50d d12ce70 5b6f50d 1aa424e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 | <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>Inkling · xai</title>
<link rel="stylesheet" href="style.css">
</head>
<body>
<h1>Inkling</h1>
<p class="meta">Thinking Machines · open MoE · weights public</p>
<nav class="meta">
<a href="index.html">home</a>
<a href="inkling.html">Inkling</a>
<a href="kimi-k3.html">Kimi K3</a>
<a href="compare.html">compare</a>
<a href="study.html">study</a>
<a href="sources.html">sources</a>
<a href="msc.html">MSc</a>
</nav>
<hr>
<p>
~<b>975B</b> total / <b>41B</b> active · <b>1M</b> ctx · native image+audio → text.
Apache 2.0. Released 2026-07-15.
</p>
<table>
<tr><th>piece</th><th>choice</th></tr>
<tr><td>body</td><td>66 layers · hidden 6144</td></tr>
<tr><td>FFN</td><td>dense L0–1 · MoE L2–65</td></tr>
<tr><td>MoE</td><td>256 routed · top-6 · 2 shared · sink</td></tr>
<tr><td>attn</td><td>55 SWA (512) · 11 global</td></tr>
<tr><td>position</td><td>relative PE (d_rel=16) · not RoPE</td></tr>
<tr><td>local</td><td>SConv k=4 · 4 states/layer</td></tr>
<tr><td>vision/audio</td><td>hMLP p=40 · dMel 80×16</td></tr>
</table>
<pre>text|image|audio → d=6144
→ SWA/global + relative R + SConv
→ MoE 6/256+2
→ text (+ effort)</pre>
<p>
<a href="https://huggingface.co/thinkingmachines/Inkling">Hub</a> ·
<a href="https://huggingface.co/datasets/lyffseba/xai-studies/tree/main/studies/models/inkling">package</a> ·
<a href="compare.html">vs Kimi K3</a>
</p>
<p class="meta"><a href="index.html">← home</a></p>
</body>
</html>
<!-- xai-rev:20260717T161813Z -->
|