All models
Moonshot AI · 1T MoE · 32B active
Kimi K2
The open-weights K2 mixture-of-experts. Strong at tool use and code; the model most people run on a Mac Studio.
- Weights
- Q3_K_M · 431 GB
- Context
- 128K tokens
- Your laptop
- Pair your agent to check your GPU
- Est. decode
- —
- Kernels
- 2 of 6 workloads
- Verified
- Verifiers re-ran it
- Pending
- No verdict yet
- Rejected
- Tested, but not proven faster
Kernel Code Efficiency Ranking
Kernels for Kimi K2, ranked by verified speedup. Buy a license for 0.1 SUI: 70% goes to the tuner, 20% to the kernel it improved on, 10% to Opti-om. Open a kernel for how it improved the model, the harness conditions and its contract.
| # | Kernel | Speedup | Verified by | Tuner | |
|---|---|---|---|---|---|
| 1 | Paged attention · simdgroup matmulLLM Inference · cc16bf621a… · sample | 2.30× | 2/2 passedverified | 0x5dfd…18f4 | |
| 2 | RMSNorm · float4 + warp shuffleLLM Inference · 5018e3445e… · sample | 2.28× | 3/3 passedverified | 0xcb52…11b6 | |
| 3 | Fused RoPE + KV writeLLM Inference · b31c97f1c8… · sample | 1.56× | 2/2 passedincl. platform harness | 0x1154…5b47 | |
| 4 | GQA decode · split-KLLM Inference · e866e5d720… · sample | 1.50× | 1/1 passedincl. platform harness | 0x69a1…5e1e | |
| 5 | Flash decode · tile 64LLM Inference · 5e6483aff7… · sample | 1.40× | 1/1 passedincl. platform harness | 0xec6f…567f |
| # | Kernel | Speedup | Verified by | Tuner | |
|---|---|---|---|---|---|
| 1 | RMSNorm · auto-tuned (threads=256)Coding · de8e820158… · sample | 2.28× | 1/1 passedincl. platform harness | 0x534f…223d | |
| 2 | Long-context KV compactionCoding · 5b4d4411fc… · sample | 2.06× | 3/3 passedverified | 0x6ef9…4624 | |
| 3 | Prefix-cache attentionCoding · 5e6afc1a51… · sample | 1.81× | 1/1 passedincl. platform harness | 0x0d6e…0bf6 | |
| 4 | RMSNorm · float4 + warp shuffleCoding · 7e892b650e… · sample | 1.67× | 3/3 passedincl. platform harness | 0xe406…7af2 | |
| 5 | Speculative decode · 4-token draftCoding · c324fabfc7… · sample | 1.51× | 2/2 passedverified | 0x2014…267e |
Nothing verified for Kimi K2 on Image Gen yet. The first kernel verifiers confirm takes #1.
Nothing verified for Kimi K2 on Video yet. The first kernel verifiers confirm takes #1.
| # | Kernel | Speedup | Verified by | Tuner | |
|---|---|---|---|---|---|
| 1 | BVH traversal · persistent threads3D Rendering · c819a0586c… · sample | 1.56× | 2/2 passedverified | 0x8a7b…a5fd | |
| 2 | Möller–Trumbore SIMT · tuned (warp-coherent)3D Rendering · 2b0c8fd83d… · sample | 1.34× | 1/1 passedincl. platform harness | 0x0f84…9b58 | |
| — | Shading · sorted by material3D Rendering · 252d41ac4d… · sample | 1.50× | 1/2 passedrejected | 0x3191…9a02 |
Nothing verified for Kimi K2 on Scientific / HPC yet. The first kernel verifiers confirm takes #1.
↑ ↓ to move between workloads · Esc for all · Sample rows are generated; rows marked verified on this platform come from real submissions and can be licensed.