Skip to content
All posts

Inkling 2 Mini: a looped transformer you can run on a laptop

Thinking Machines' new open-weights model loops its middle layers three times per token. It leads open-weights models under 100B on agentic coding, runs in about 20GB, and is live on AnyRouter through Tinker and OpenRouter BYOK.


A small model that thinks more per token

Inkling 2 Mini is a 26.4B-parameter mixture-of-experts model with 3.4B active parameters. Its unusual trick is looping: the middle layers of the network run three times for every token, so the model does more serial computation without storing more parameters. Thinking Machines reports that it leads every open-weights model under 100B total parameters on agentic coding, including 48.2% on DeepSWE v1.1 and 46.5% on the Vals Index v2.2.

It runs natively in NVFP4 and its whole footprint is about 20GB. That is small enough for a consumer laptop: the lab ran it offline on an M5 Pro MacBook Pro and built a playable flight simulator in a few minutes.

DeepSWE v1.1 — tasks resolved

mini-swe-agent v2.4.6. Source: Thinking Machines launch post.

Inkling 2 Mini48.2%
Qwen3.8-27B42.2%
Nemotron 3.5 Super VL24.7%
Muse Glimmer4.4%
Gemma 4 31B0.3%
Figure 1: DeepSWE v1.1 scores from the Thinking Machines comparison table.

The benchmark table, made interactive

The launch post compares Inkling 2 Mini with Gemma 4 31B, Muse Glimmer, Qwen3.8-27B and Nemotron 3.5 Super VL across coding, agentic search, vision, reasoning and safety. We copied every published number into a compare collection. Switch between the table and the Pareto and saturation charts, sort by model, and share a direct link to any view.

Inkling 2 Mini vs open-weight peers

Thinking Machines' Inkling 2 Mini against the four models its launch post compares it with, across coding, agentic search, vision, reasoning and safety, plus the independent evals our catalog holds.

Vendor benchmarksInkling 2 MiniGemma 4 31BMuse Glimmer 30BQwen3.8-27BNemotron 3.5 Super VL 120B A12B
Model info
Inkling 2 Mini has 3.4B unique active parameters. The vendor's 'activated' column below counts weight activations per token (5.4B), which includes the three loop passes.
Params (B)activated per token (incl. loops) / total5.4/26.430.7/30.7 (Highest reported score in this row)30.0/30.0 (Second-highest reported score in this row)27.0/27.012.0/124.5
Third party index
AA Index (v5.0)20.1 (Highest reported score in this row)4.46.320.1 (Highest reported score in this row)13.6 (Second-highest reported score in this row)
Vals Index (v2.2)46.5% (Highest reported score in this row)–––29.8% (Second-highest reported score in this row)
Coding and autoresearch
FrontierCode v2.0stirrup v0.2.115.1% (Highest reported score in this row)0.0%1.5%14.9% (Second-highest reported score in this row)6.1%
DeepSWE v1.1mini-swe-agent v2.4.648.2% (Highest reported score in this row)0.3%4.4%42.2% (Second-highest reported score in this row)24.7%
Terminal Bench v4.0mini-swe-agent v2.4.65.6% (Highest reported score in this row)0.0%0.5% (Second-highest reported score in this row)5.6% (Highest reported score in this row)0.0%
Terminal Bench v2.1Inkling 2 Mini in pi v0.83.071.6% (Second-highest reported score in this row)43.4%51.7%73.0% (Highest reported score in this row)60.7%
SWEBench Pro v2 (Hard)mini-swe-agent v2.4.677.9% (Highest reported score in this row)14.2%44.3%73.8% (Second-highest reported score in this row)44.1%
SWEBench MultilingualInkling 2 Mini with bash only73.7% (Highest reported score in this row)43.0%66.9%70.0% (Second-highest reported score in this row)67.7%
SWEBench Verifiedbash only79.2% (Highest reported score in this row)46.1%76.0%77.8% (Second-highest reported score in this row)71.1%
Vibe Code Bench v1.1openhands (vals)77.9% (Highest reported score in this row)––64.9% (Second-highest reported score in this row)3.5%
PMPP-Hard (AUC, 0-10h)pi v0.83.0455.8 (Highest reported score in this row)––262.5 (Second-highest reported score in this row)–
Agentic search, tool use and knowledge work
BrowseCompInkling 2 Mini with compaction79.0% (Highest reported score in this row)37.0%63.9%61.6%78.9% (Second-highest reported score in this row)
DeepSearchQAInkling 2 Mini with compaction85.3% (Highest reported score in this row)61.7%74.6%79.7% (Second-highest reported score in this row)77.7%
MCP AtlasPublic82.7% (Highest reported score in this row)54.2%75.5%77.3% (Second-highest reported score in this row)67.7%
AA-Briefcase v1.11263.0 (Second-highest reported score in this row)369.0478.01391.0 (Highest reported score in this row)999.0
GDPVal-AA v2.11319.0 (Second-highest reported score in this row)627.0792.01427.0 (Highest reported score in this row)1162.0
JobBench49.6% (Highest reported score in this row)8.2%16.1%33.4%36.5% (Second-highest reported score in this row)
AutomationBench-AA v1.0.641.8% (Second-highest reported score in this row)4.9%6.8%48.2% (Highest reported score in this row)14.8%
EnterpriseOps-Gym42.0% (Second-highest reported score in this row)28.4%34.7%44.2% (Highest reported score in this row)28.1%
Vals Finance Index50.1% (Highest reported score in this row)–––41.0% (Second-highest reported score in this row)
AA-AnalystAgent46.3% (Highest reported score in this row)–20.0% (Second-highest reported score in this row)––
Diligence Benchbest harness48.6% (Highest reported score in this row)–40.9%46.4% (Second-highest reported score in this row)45.0%
Vision interpretation and creation
GDP.pdf16.8% (Highest reported score in this row)6.0%11.8%16.4% (Second-highest reported score in this row)8.0%
PerceptionBench57.5% (Highest reported score in this row)40.7%42.8%52.4% (Second-highest reported score in this row)36.8%
MMMU Prostandard 1074.9% (Second-highest reported score in this row)73.4%74.3%76.3% (Highest reported score in this row)72.3%
OmniDocBench v1.692.8% (Highest reported score in this row)82.5%90.4%91.5% (Second-highest reported score in this row)77.9%
ScreenSpot Prooriginal / with Python76.5/87.7% (Highest reported score in this row)5.9%/–75.4%/– (Second-highest reported score in this row)57.6/78.9%43.5%/–
Chartographyoriginal / with Python22.1/72.5% (Highest reported score in this row)12.0/11.8%17.4/25.1% (Second-highest reported score in this row)12.2/52.1%9.7/29.3%
ZeroBench (main)original / with Python17.0/34.0% (Highest reported score in this row)9.0/12.0%9.0/17.0%12.0%/– (Second-highest reported score in this row)11.0/12.0%
MuirBench77.5% (Second-highest reported score in this row)72.3%77.6% (Highest reported score in this row)65.9%72.7%
BVB68.4% (Second-highest reported score in this row)47.0%50.5%70.7% (Highest reported score in this row)52.1%
Reasoning, knowledge and epistemics
HLE-Diamond15.2% (Second-highest reported score in this row)7.2%9.1%15.3% (Highest reported score in this row)8.8%
CritPt v2full / hard31.4/17.0% (Second-highest reported score in this row)–/4.0%–/7.0%10.6/4.0%36.9/13.5% (Highest reported score in this row)
Apex 202534.4% (Highest reported score in this row)5.2%4.2%18.8%22.9% (Second-highest reported score in this row)
ARC-AGIv1 / v284.5/49.3% (Second-highest reported score in this row)––87.5/42.4% (Highest reported score in this row)22.7/1.5%
LongBench v266.9% (Highest reported score in this row)52.9%33.1%52.3%62.1% (Second-highest reported score in this row)
GraphWalks BFS256K69.7% (Highest reported score in this row)––50.4%63.3% (Second-highest reported score in this row)
MRCR v28-needle 256K-512K46.4% (Highest reported score in this row)––38.0% (Second-highest reported score in this row)5.7%
AA-Omniscience v1.1score-8.6-48.5-32.2-6.4 (Second-highest reported score in this row)-2.9 (Highest reported score in this row)
AA-Omniscience v1.1non-hallucination rate63.4%14.5%16.4%71.4% (Highest reported score in this row)69.5% (Second-highest reported score in this row)
ComplexConstraints v1.1openhands v1.45.033.4% (Second-highest reported score in this row)31.6%35.6% (Highest reported score in this row)30.1%30.1%
Safety and alignment
FORTRESSadversarial public89.5% (Second-highest reported score in this row)67.8%90.3% (Highest reported score in this row)78.8%79.6%
FORTRESSbenign public96.4%97.6% (Second-highest reported score in this row)89.1%97.8% (Highest reported score in this row)92.7%
StrongREJECTnone97.8%98.1%99.0% (Second-highest reported score in this row)99.0% (Second-highest reported score in this row)99.4% (Highest reported score in this row)
Misbehavior (internal)lower is better9.8% (Highest reported score in this row)27.6% (Second-highest reported score in this row)46.4%57.7%52.8%
Covert misbehavior (internal)lower is better8.3% (Highest reported score in this row)24.3% (Second-highest reported score in this row)45.6%33.2%43.4%
Destructive actions (internal)lower is better10.2% (Highest reported score in this row)75.8%68.8%35.2% (Second-highest reported score in this row)65.6%
Independent evalsInkling 2 MiniGemma 4 31BMuse Glimmer 30BQwen3.8-27BNemotron 3.5 Super VL 120B A12B
GPQA DiamondArtificial Analysis–76.3%–––
ARC-AGI-2Epoch AI–––42.4%–
CursorBench–––––
SciCodeArtificial Analysis, Epoch AI–41.1% (Second-highest reported score in this row)–46.6% (Highest reported score in this row)–
SimpleQA (verified)–––––

Sources: Introducing Inkling 2 Mini (Thinking Machines Lab) (vendor-reported, as of 2026-11-21); catalog benchmarks from Artificial Analysis, Epoch AI. A dash means the source reports no value.

Benchmark data from Epoch AI (CC-BY 4.0).

Updated 2026-11-21.

What looping actually changes

The model has 24 layers in four blocks of six. The first and last blocks run once; the two middle blocks run three times. The lab compared loop position on its scaling ladder and found that looping the middle layers bought more compute-equivalent gain than looping the last layers.

Loop positionCompute-equivalent gainLayer span
Middle layers1.51–1.91×Blocks 2 and 3, layers 6–18
Last layers1.24–1.36×Last 12 layers
Figure 2: Compute-equivalent gain by loop position at training step 2,000.

The attention-residual design lets each pass read the outputs of earlier blocks, and the loop's message is gated so the model learns when to use it. Roughly 20 of the 24 layers are deployed in NVFP4 and the final four in MXFP8, the same precision used during training, so there is no quantization conversion loss.

Use it on AnyRouter

Inkling 2 Mini is available as thinkingmachines/inkling-2-mini. Both routes are BYOK: add a Tinker key or an OpenRouter key under Dashboard → BYOK and your provider bills you directly. AnyRouter adds no charge for a BYOK route. Tinker lists the 256K train / 1M sample wire at $0.15 per 1M input tokens and $0.50 per 1M output tokens.

AI SDK
import { createAnyRouter } from "@anyr/ai-sdk-provider"
import { generateText } from "ai"

const anyrouter = createAnyRouter()
const { text } = await generateText({
  model: anyrouter("thinkingmachines/inkling-2-mini"),
  prompt: "Explain the difference between looping and chain of thought.",
})
console.log(text)
Coding agent
anyr claude --model "thinkingmachines/inkling-2-mini"

Where it still falls short

The lab is candid about the limits. It is not the strongest small model for multi-turn chat or instructions with many constraints, scoring 50.0% on MultiChallenge and 33.4% on ComplexConstraints v1.1. Looping adds reasoning depth but not stored facts, so factuality stays in line with other same-size models, and it trails larger models on reasoning-heavy benchmarks such as CritPt v2 and HLE-Diamond. For knowledge work it leans on search and tools instead.

Route your first request in 2 minutes

Start free with your own keys, or top up and pay per token. Get $4/mo in credits and free models on Go — $2/mo, or free when you donate a provider key.