Skip to content
Compare

Inkling 2 Mini vs open-weight peers

Thinking Machines' Inkling 2 Mini against the four models its launch post compares it with, across coding, agentic search, vision, reasoning and safety, plus the independent evals our catalog holds.

Vendor benchmarksInkling 2 MiniGemma 4 31BMuse Glimmer 30BQwen3.8-27BNemotron 3.5 Super VL 120B A12B
Model info
Inkling 2 Mini has 3.4B unique active parameters. The vendor's 'activated' column below counts weight activations per token (5.4B), which includes the three loop passes.
Params (B)activated per token (incl. loops) / total5.4/26.430.7/30.7 (Highest reported score in this row)30.0/30.0 (Second-highest reported score in this row)27.0/27.012.0/124.5
Third party index
AA Index (v5.0)20.1 (Highest reported score in this row)4.46.320.1 (Highest reported score in this row)13.6 (Second-highest reported score in this row)
Vals Index (v2.2)46.5% (Highest reported score in this row)–––29.8% (Second-highest reported score in this row)
Coding and autoresearch
FrontierCode v2.0stirrup v0.2.115.1% (Highest reported score in this row)0.0%1.5%14.9% (Second-highest reported score in this row)6.1%
DeepSWE v1.1mini-swe-agent v2.4.648.2% (Highest reported score in this row)0.3%4.4%42.2% (Second-highest reported score in this row)24.7%
Terminal Bench v4.0mini-swe-agent v2.4.65.6% (Highest reported score in this row)0.0%0.5% (Second-highest reported score in this row)5.6% (Highest reported score in this row)0.0%
Terminal Bench v2.1Inkling 2 Mini in pi v0.83.071.6% (Second-highest reported score in this row)43.4%51.7%73.0% (Highest reported score in this row)60.7%
SWEBench Pro v2 (Hard)mini-swe-agent v2.4.677.9% (Highest reported score in this row)14.2%44.3%73.8% (Second-highest reported score in this row)44.1%
SWEBench MultilingualInkling 2 Mini with bash only73.7% (Highest reported score in this row)43.0%66.9%70.0% (Second-highest reported score in this row)67.7%
SWEBench Verifiedbash only79.2% (Highest reported score in this row)46.1%76.0%77.8% (Second-highest reported score in this row)71.1%
Vibe Code Bench v1.1openhands (vals)77.9% (Highest reported score in this row)––64.9% (Second-highest reported score in this row)3.5%
PMPP-Hard (AUC, 0-10h)pi v0.83.0455.8 (Highest reported score in this row)––262.5 (Second-highest reported score in this row)–
Agentic search, tool use and knowledge work
BrowseCompInkling 2 Mini with compaction79.0% (Highest reported score in this row)37.0%63.9%61.6%78.9% (Second-highest reported score in this row)
DeepSearchQAInkling 2 Mini with compaction85.3% (Highest reported score in this row)61.7%74.6%79.7% (Second-highest reported score in this row)77.7%
MCP AtlasPublic82.7% (Highest reported score in this row)54.2%75.5%77.3% (Second-highest reported score in this row)67.7%
AA-Briefcase v1.11263.0 (Second-highest reported score in this row)369.0478.01391.0 (Highest reported score in this row)999.0
GDPVal-AA v2.11319.0 (Second-highest reported score in this row)627.0792.01427.0 (Highest reported score in this row)1162.0
JobBench49.6% (Highest reported score in this row)8.2%16.1%33.4%36.5% (Second-highest reported score in this row)
AutomationBench-AA v1.0.641.8% (Second-highest reported score in this row)4.9%6.8%48.2% (Highest reported score in this row)14.8%
EnterpriseOps-Gym42.0% (Second-highest reported score in this row)28.4%34.7%44.2% (Highest reported score in this row)28.1%
Vals Finance Index50.1% (Highest reported score in this row)–––41.0% (Second-highest reported score in this row)
AA-AnalystAgent46.3% (Highest reported score in this row)–20.0% (Second-highest reported score in this row)––
Diligence Benchbest harness48.6% (Highest reported score in this row)–40.9%46.4% (Second-highest reported score in this row)45.0%
Vision interpretation and creation
GDP.pdf16.8% (Highest reported score in this row)6.0%11.8%16.4% (Second-highest reported score in this row)8.0%
PerceptionBench57.5% (Highest reported score in this row)40.7%42.8%52.4% (Second-highest reported score in this row)36.8%
MMMU Prostandard 1074.9% (Second-highest reported score in this row)73.4%74.3%76.3% (Highest reported score in this row)72.3%
OmniDocBench v1.692.8% (Highest reported score in this row)82.5%90.4%91.5% (Second-highest reported score in this row)77.9%
ScreenSpot Prooriginal / with Python76.5/87.7% (Highest reported score in this row)5.9%/–75.4%/– (Second-highest reported score in this row)57.6/78.9%43.5%/–
Chartographyoriginal / with Python22.1/72.5% (Highest reported score in this row)12.0/11.8%17.4/25.1% (Second-highest reported score in this row)12.2/52.1%9.7/29.3%
ZeroBench (main)original / with Python17.0/34.0% (Highest reported score in this row)9.0/12.0%9.0/17.0%12.0%/– (Second-highest reported score in this row)11.0/12.0%
MuirBench77.5% (Second-highest reported score in this row)72.3%77.6% (Highest reported score in this row)65.9%72.7%
BVB68.4% (Second-highest reported score in this row)47.0%50.5%70.7% (Highest reported score in this row)52.1%
Reasoning, knowledge and epistemics
HLE-Diamond15.2% (Second-highest reported score in this row)7.2%9.1%15.3% (Highest reported score in this row)8.8%
CritPt v2full / hard31.4/17.0% (Second-highest reported score in this row)–/4.0%–/7.0%10.6/4.0%36.9/13.5% (Highest reported score in this row)
Apex 202534.4% (Highest reported score in this row)5.2%4.2%18.8%22.9% (Second-highest reported score in this row)
ARC-AGIv1 / v284.5/49.3% (Second-highest reported score in this row)––87.5/42.4% (Highest reported score in this row)22.7/1.5%
LongBench v266.9% (Highest reported score in this row)52.9%33.1%52.3%62.1% (Second-highest reported score in this row)
GraphWalks BFS256K69.7% (Highest reported score in this row)––50.4%63.3% (Second-highest reported score in this row)
MRCR v28-needle 256K-512K46.4% (Highest reported score in this row)––38.0% (Second-highest reported score in this row)5.7%
AA-Omniscience v1.1score-8.6-48.5-32.2-6.4 (Second-highest reported score in this row)-2.9 (Highest reported score in this row)
AA-Omniscience v1.1non-hallucination rate63.4%14.5%16.4%71.4% (Highest reported score in this row)69.5% (Second-highest reported score in this row)
ComplexConstraints v1.1openhands v1.45.033.4% (Second-highest reported score in this row)31.6%35.6% (Highest reported score in this row)30.1%30.1%
Safety and alignment
FORTRESSadversarial public89.5% (Second-highest reported score in this row)67.8%90.3% (Highest reported score in this row)78.8%79.6%
FORTRESSbenign public96.4%97.6% (Second-highest reported score in this row)89.1%97.8% (Highest reported score in this row)92.7%
StrongREJECTnone97.8%98.1%99.0% (Second-highest reported score in this row)99.0% (Second-highest reported score in this row)99.4% (Highest reported score in this row)
Misbehavior (internal)lower is better9.8% (Highest reported score in this row)27.6% (Second-highest reported score in this row)46.4%57.7%52.8%
Covert misbehavior (internal)lower is better8.3% (Highest reported score in this row)24.3% (Second-highest reported score in this row)45.6%33.2%43.4%
Destructive actions (internal)lower is better10.2% (Highest reported score in this row)75.8%68.8%35.2% (Second-highest reported score in this row)65.6%
DeepSWE v1.1

Coding score against theoretical decoding speed for models under 100B total parameters.

Inkling 2 Mini · 48.2%Ripple-65B (Preview) · 44.3%Qwen3.8-27B · 42.2%Recursive Flint · 10.81%Muse Glimmer · 4.4%Gemma 4 31B · 0.3%Gemma 4 26B A4B · 0%0%25%50%75%100%050100150200Theoretical tokens per second (vendor chart uses a log scale)Tasks resolvedInkling 2 Mini: 48.2%Ripple-65B (Preview): 44.3%Qwen3.8-27B: 42.2%Recursive Flint: 10.81%Muse Glimmer: 4.4%Gemma 4 31B: 0.3%Gemma 4 26B A4B: 0%

Decoding speed is a theoretical ceiling at 614 GB/s with BF16 weights, batch size one, including repeated reads across loops. Evaluation setups vary by model. Source: Introducing Inkling 2 Mini (Thinking Machines Lab), as of 2026-11-21.

SWE-bench Pro v2 Hard (51 tasks)

Coding score against theoretical decoding speed for models under 100B total parameters.

Inkling 2 Mini · 77.9%Ripple-65B (Preview) · 79.1%Qwen3.8-27B · 73.8%Muse Glimmer · 44.3%Qwen3.6-27B · 37.25%Qwen3.6-35B-A3B · 28.1%Gemma 4 31B · 14.2%Gemma 4 26B A4B · 11.8%0%25%50%75%100%050100150200Theoretical tokens per second (vendor chart uses a log scale)Tasks resolvedInkling 2 Mini: 77.9%Ripple-65B (Preview): 79.1%Qwen3.8-27B: 73.8%Muse Glimmer: 44.3%Qwen3.6-27B: 37.25%Qwen3.6-35B-A3B: 28.1%Gemma 4 31B: 14.2%Gemma 4 26B A4B: 11.8%

Decoding speed is a theoretical ceiling at 614 GB/s with BF16 weights, batch size one, including repeated reads across loops. Evaluation setups vary by model. Source: Introducing Inkling 2 Mini (Thinking Machines Lab), as of 2026-11-21.

Sources: Introducing Inkling 2 Mini (Thinking Machines Lab) (vendor-reported, as of 2026-11-21); catalog benchmarks from Artificial Analysis, Epoch AI. A dash means the source reports no value.

Benchmark data from Epoch AI (CC-BY 4.0).

Updated 2026-11-21.