Inkling 2 Small vs open-weight peers
Thinking Machines' Inkling 2 Small against the four models its launch post compares it with, on agentic coding and autoresearch, plus the independent evals our catalog holds.
| Coding and Autoresearch | Inkling 2 Small | GLM-5.3-Flash | DeepSeek-V4.1-Flash-1017 | Muse Spark Open | Kimi K3 |
|---|---|---|---|---|---|
| FrontierCode v2.0stirrup v0.2.1 | 25.4% (Second-highest reported score in this row) | 17.6% | 28.5% (Highest reported score in this row) | 7.6% | 17.3% |
| DeepSWE v1.1mini-swe-agent v2.4.6 | 72.1% (Second-highest reported score in this row) | 63.4% | 77.0% (Highest reported score in this row) | 60.0% | 68.5% |
| SWE-Atlas v1.1mini-swe-agent v2.4.6 | 61.9% (Second-highest reported score in this row) | – | 62.1% (Highest reported score in this row) | 42.3% | 61.0% |
| SWEBench Pro v2 (Hard/Full)mini-swe-agent v2.4.6 | 86.3/97.7% | 82.8%/– | 89.7%/– (Highest reported score in this row) | 82.4/95.0% | 88.2/97.7% (Second-highest reported score in this row) |
| Vibe Code Bench v1.1openhands (vals) | 81.6% | 30.8% | 87.7% (Highest reported score in this row) | 76.2% | 85.0% (Second-highest reported score in this row) |
| PostTrainBench v1.2Inkling 2 Small in Claude Code | 31.9% (Second-highest reported score in this row) | 36.8% (Highest reported score in this row) | 30.5% | – | 31.5% |
| Terminal Bench Science v0.1mini-swe-agent v2.4.6 | 5.7% | 4.8% | 12.9% (Highest reported score in this row) | 1.9% | 8.1% (Second-highest reported score in this row) |
DeepSeek-V3.2 sparse attention, forward + backward. Best of four sessions on one B300 GPU.
Final speedups verified on hidden tests. The source shows each session's full step curve; it publishes only these endpoints as numbers. Source: Introducing Inkling 2 Small (Thinking Machines Lab), as of 2026-11-18.
Mean score against price or time. Lower and to the left is cheaper or faster; the dashed line joins the models nothing else beats on both.
The mean counts only the percent rows a model reports; (n/total) shows when it misses some.
How much room each benchmark has left for these models. Headroom is 100% minus the best score here; the grey band runs from the worst to the best model.
Sources: Introducing Inkling 2 Small (Thinking Machines Lab) (vendor-reported, as of 2026-11-18); catalog benchmarks from Artificial Analysis, Epoch AI. A dash means the source reports no value.
Benchmark data from Epoch AI (CC-BY 4.0).
Updated 2026-11-18.