File size: 2,087 Bytes
5b6f50d 2e86173 5b6f50d 2e86173 5b6f50d 2e86173 5f56d31 5b6f50d 2e86173 5b6f50d 2e86173 5b6f50d 2e86173 5b6f50d 2e86173 5b6f50d 2e86173 5b6f50d 2e86173 5b6f50d 2e86173 5b6f50d 2e86173 5b6f50d 1aa424e | 1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20 21 22 23 24 25 26 27 28 29 30 31 32 33 34 35 36 37 38 39 40 41 42 43 44 45 46 47 48 49 50 51 52 53 54 55 56 57 58 59 60 61 62 63 64 65 66 67 68 | <!DOCTYPE html>
<html lang="en">
<head>
<meta charset="utf-8">
<meta name="viewport" content="width=device-width, initial-scale=1">
<title>Kimi K3 · xai</title>
<link rel="stylesheet" href="style.css">
</head>
<body>
<h1>Kimi K3</h1>
<p class="meta">Moonshot · API live · weights pending</p>
<nav class="meta">
<a href="index.html">home</a>
<a href="inkling.html">Inkling</a>
<a href="kimi-k3.html">Kimi K3</a>
<a href="compare.html">compare</a>
<a href="study.html">study</a>
<a href="sources.html">sources</a>
<a href="msc.html">MSc</a>
</nav>
<hr>
<p>
<b>2.8T</b> · Stable LatentMoE <b>16/896</b> · <b>KDA + AttnRes</b> · vision/video · <b>1M</b> ctx.
API <code>kimi-k3</code>. Weights ETA <b>2026-07-27</b>. Active params undisclosed.
</p>
<table>
<tr><th>piece</th><th>claim</th></tr>
<tr><td>MoE</td><td>16 of 896 · Quantile Balancing</td></tr>
<tr><td>length</td><td>KDA (hybrid linear)</td></tr>
<tr><td>depth</td><td>AttnRes</td></tr>
<tr><td>vs K2</td><td>~2.5× scaling efficiency</td></tr>
<tr><td>QAT</td><td>MXFP4 W / MXFP8 A from SFT</td></tr>
<tr><td>thinking</td><td>always-on · effort=max at launch</td></tr>
</table>
<pre>text|vision|video
→ KDA (length) + AttnRes (depth)
→ LatentMoE 16/896
→ thinking → text/tools</pre>
<p>
Footgun: <b>preserved thinking history</b> required multi-turn, or quality collapses.
</p>
<table>
<tr><th></th><th>K2.6</th><th>K3</th></tr>
<tr><td>total</td><td>1T</td><td>2.8T</td></tr>
<tr><td>active</td><td>32B</td><td>undisclosed</td></tr>
<tr><td>experts</td><td>8/384+1</td><td>16/896</td></tr>
<tr><td>ctx</td><td>256K</td><td>1M</td></tr>
<tr><td>attn</td><td>MLA</td><td>KDA+AttnRes</td></tr>
</table>
<p>
<a href="https://www.kimi.com/blog/kimi-k3">blog</a> ·
<a href="https://arxiv.org/abs/2510.26692">arXiv:2510.26692</a> ·
<a href="https://huggingface.co/datasets/lyffseba/xai-studies/tree/main/studies/models/kimi-k3">package</a>
</p>
<p class="meta"><a href="index.html">← home</a></p>
</body>
</html>
<!-- xai-rev:20260717T161813Z -->
|