| <!DOCTYPE html> |
| <html lang="en"> |
| <head> |
| <meta charset="utf-8"> |
| <meta name="viewport" content="width=device-width, initial-scale=1"> |
| <title>Kimi K3 · xai</title> |
| <link rel="stylesheet" href="style.css"> |
| </head> |
| <body> |
|
|
| <h1>Kimi K3</h1> |
| <p class="meta">Moonshot · API live · weights pending</p> |
| <nav class="meta"> |
| <a href="index.html">home</a> |
| <a href="inkling.html">Inkling</a> |
| <a href="kimi-k3.html">Kimi K3</a> |
| <a href="compare.html">compare</a> |
| <a href="study.html">study</a> |
| <a href="sources.html">sources</a> |
| <a href="msc.html">MSc</a> |
| </nav> |
|
|
| <hr> |
|
|
| <p> |
| <b>2.8T</b> · Stable LatentMoE <b>16/896</b> · <b>KDA + AttnRes</b> · vision/video · <b>1M</b> ctx. |
| API <code>kimi-k3</code>. Weights ETA <b>2026-07-27</b>. Active params undisclosed. |
| </p> |
|
|
| <table> |
| <tr><th>piece</th><th>claim</th></tr> |
| <tr><td>MoE</td><td>16 of 896 · Quantile Balancing</td></tr> |
| <tr><td>length</td><td>KDA (hybrid linear)</td></tr> |
| <tr><td>depth</td><td>AttnRes</td></tr> |
| <tr><td>vs K2</td><td>~2.5× scaling efficiency</td></tr> |
| <tr><td>QAT</td><td>MXFP4 W / MXFP8 A from SFT</td></tr> |
| <tr><td>thinking</td><td>always-on · effort=max at launch</td></tr> |
| </table> |
|
|
| <pre>text|vision|video |
| → KDA (length) + AttnRes (depth) |
| → LatentMoE 16/896 |
| → thinking → text/tools</pre> |
|
|
| <p> |
| Footgun: <b>preserved thinking history</b> required multi-turn, or quality collapses. |
| </p> |
|
|
| <table> |
| <tr><th></th><th>K2.6</th><th>K3</th></tr> |
| <tr><td>total</td><td>1T</td><td>2.8T</td></tr> |
| <tr><td>active</td><td>32B</td><td>undisclosed</td></tr> |
| <tr><td>experts</td><td>8/384+1</td><td>16/896</td></tr> |
| <tr><td>ctx</td><td>256K</td><td>1M</td></tr> |
| <tr><td>attn</td><td>MLA</td><td>KDA+AttnRes</td></tr> |
| </table> |
|
|
| <p> |
| <a href="https://www.kimi.com/blog/kimi-k3">blog</a> · |
| <a href="https://arxiv.org/abs/2510.26692">arXiv:2510.26692</a> · |
| <a href="https://huggingface.co/datasets/lyffseba/xai-studies/tree/main/studies/models/kimi-k3">package</a> |
| </p> |
|
|
| <p class="meta"><a href="index.html">← home</a></p> |
| </body> |
| </html> |
| |
|
|
