Skip to main content
ModelScale
TM

Inkling

Thinking Machines Lab · Open Weight · rank 58 · bench-align-v5

Canonical idinkling
Overall score60.52
Context window1M tokens
Release date2026-07-15
Access typeOpen Weight
Blended $/1M$2.5775% input / 25% output

Capability shape

Seven axes from the ranking source. A missing axis is drawn as a gap.

Capability evidence

Agentic57.6
Coding49
Knowledge65.1
Reasoning74.1
Multimodal & Grounded49.2
Instruction Following85.2
Math78.9

Runtime service evidence

Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim.

Time to first token: latency to the first answer chunk (Artificial Analysis, via BenchLM). Reasoning models include thinking time, so values can run to tens or hundreds of seconds.

Evidence key: Observed

Runtime measurements
MeasurementValueObservedLast goodEvidence
Time to first token25.01 s2026-09-172026-09-17
Throughput90 tok/s2026-09-172026-09-17

Regional or per-endpoint measurements appear only when the API supplies them; none are modelled here.

Endpoint and price matrix

Every published price component, including cache reads and writes.

Price components
ComponentUSDEvidence
Input / 1M tokens$1.87
Output / 1M tokens$4.68
Cache read / 1M tokens$0.37
Cache write / 1M tokensUnavailable
Blended / 1M (75% input / 25% output)$2.57
Self-hosted listingThinking Machines Lab's Tinker pricing docs list the 64K Inkling tier at $1.87 prefill / $0.374 cached prefill / $4.68 sample per million tokens during a limited-time 50% discount. The hosted 256K tier costs $3.74 / $0.748 cached / $9.36, while the released checkpoint supports up to 1M tokens when self-hosted. BenchLM stores the lower-context hosted tier as the headline API rate and the model's architectural context ceiling separately.The rates above are a hosted price matched from another provider, not a first-party list price.

Workload-aware monthly cost example

10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. This uses the same calculator as the cost simulator, so an unavailable applicable rate makes the example unavailable too.

Modelled monthly cost$7.24
Modelled tokens2.82M
Open the simulatorChange this workload

Benchmark record

39 matched benchmark rows with their published value, unit, and provenance.

Knowledge

Knowledge benchmarks
BenchmarkValueTasksDifficultyProvenance
GPQA
Graduate-Level Google-Proof Q&A
87.9448 questionsGraduate levelGPQA: A Graduate-Level Google-Proof Q&A Benchmark
GPQA-D
GPQA Diamond
87.9Graduate-level science questionsGraduate levelTrinity-Large-Thinking: Scaling an Open Source Frontier Agent
HLE
Humanity's Last Exam
46Expert-level questionsFrontier expert levelHumanity's Last Exam
Artificial Analysis Intelligence Index
Artificial Analysis Intelligence Index
25.5Cross-benchmark intelligence indexDisplay-only external referenceArtificial Analysis
AA-GPQA Diamond
Artificial Analysis GPQA Diamond
87.2Graduate-level science questionsGraduate-level science reasoningArtificial Analysis GPQA Diamond Benchmark Leaderboard
AA-HLE
Artificial Analysis Humanity's Last Exam
31.9Expert-level questionsFrontier expert reasoningArtificial Analysis Humanity's Last Exam Benchmark Leaderboard
AA-Omniscience Index
Artificial Analysis Omniscience Index
2.0Knowledge questionsBroad factual knowledgeAA-Omniscience: Knowledge and Hallucination Benchmark
AA-Omniscience Accuracy
Artificial Analysis Omniscience Accuracy
41.6Knowledge questionsBroad knowledgeArtificial Analysis model benchmarks
AA-Omniscience Hallucination Rate
Artificial Analysis Omniscience Hallucination Rate
67.7Knowledge questionsFactualityArtificial Analysis model benchmarks
HLE w/o tools
Humanity's Last Exam without tools
30Expert-level questionsFrontier expert levelIntroducing GPT-5.4 mini and nano
GPQA Diamond (Vals)
GPQA Diamond, Vals AI run
87.1Graduate-level science questionsExpert reasoningVals AI GPQA Diamond, Vals AI run leaderboard
MMLU-Pro (Vals)
MMLU-Pro, Vals AI run
86.3Academic multiple-choice questionsBroad academic knowledgeVals AI MMLU-Pro, Vals AI run leaderboard

Coding

Coding benchmarks
BenchmarkValueTasksDifficultyProvenance
Terminal-Bench 2.0
Terminal-Bench 2.0
63.8Terminal-based software tasksProfessional software engineeringTerminal-Bench 2.0
SWE-bench Verified
Software Engineering Benchmark Verified
77.6500 verified issuesProfessional software engineeringSWE-bench: Can Language Models Resolve Real-World GitHub Issues?
SWE-bench Pro
SWE-bench Pro
54.31,865 repository problemsLong-horizon professional engineeringSWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
FrontierSWE v2
FrontierSWE v2
4.134 ultra-long-horizon engineering and research tasksUltra-long-horizon frontier software engineeringFrontierSWE v2
AA Coding Index
Artificial Analysis Coding Index
52.1Cross-benchmark coding indexDisplay-only external referenceArtificial Analysis model leaderboards
AA-SciCode
Artificial Analysis SciCode
47.0Scientific coding subproblemsScientific programmingArtificial Analysis SciCode Benchmark Leaderboard
LiveCodeBench (Vals)
LiveCodeBench, Vals AI run
85.5Competitive programming problems (easy, medium, hard)Frontier codingVals AI LiveCodeBench, Vals AI run leaderboard
SWE-bench (Vals)
SWE-bench, Vals AI run
77.6Real repository issues by human time bucketFrontier coding agentsVals AI SWE-bench, Vals AI run leaderboard

Mathematics

Mathematics benchmarks
BenchmarkValueTasksDifficultyProvenance
AIME26
AIME 2026
97.1Competition math problemsOlympiad-style mathematicsQwen3.6 launch benchmarks

Reasoning

Reasoning benchmarks
BenchmarkValueTasksDifficultyProvenance
AA-LCR
Artificial Analysis Long Context Reasoning
77.3Long-context reasoning tasksLong-context reasoningArtificial Analysis model benchmarks
CritPt
Critical Physics Tasks
5.4Research-level physics questionsResearch-level physics reasoningCritPt Benchmark Leaderboard

Instruction Following

Instruction Following benchmarks
BenchmarkValueTasksDifficultyProvenance
IFBench
Instruction Following Benchmark
79.8BenchLM

Agentic

Agentic benchmarks
BenchmarkValueTasksDifficultyProvenance
Design Arena Agentic Web Dev
Design Arena Agentic Web Dev Elo
1257Multi-file web application developmentAgentic frontend developmentDesign Arena Web Dev (Agentic) Leaderboard
AA EnterpriseOps-Gym
Artificial Analysis EnterpriseOps-Gym
38.0Enterprise operations workflowsEnterprise agent operationsArtificial Analysis EnterpriseOps-Gym Benchmark Leaderboard
Terminal-Bench 2.0
Terminal-Bench 2.0
63.8Terminal-based software tasksProfessional software engineeringTerminal-Bench 2.0
BrowseComp
BrowseComp
77.1Research questions requiring browsingHard web researchBrowseComp
GDPval-AA
GDPval-AA
1165Agentic real-world work tasksProfessional agentic workflowsDeepSeek-V4 Technical Report
GDPval-AA
GDPval-AA normalized
33.3Economically valuable tasksProfessional agentic workflowsArtificial Analysis model benchmarks
AA Agentic Index
Artificial Analysis Agentic Index
24.3Cross-benchmark agentic indexDisplay-only external referenceArtificial Analysis model leaderboards
AA-AnalystAgent
Artificial Analysis AnalystAgent
23.8Spreadsheet and document analysis questionsBusiness and data analysisAA-AnalystAgent Benchmark Leaderboard
MCP Atlas
MCP Atlas
74.1Tool-integrated agent tasksAdvanced tool useIntroducing GPT-5.4 mini and nano
Terminal-Bench 2.1 (Vals)
Terminal-Bench 2.1, Vals AI run
47.6Difficult terminal tasksFrontier agenticVals AI Terminal-Bench 2.1, Vals AI run leaderboard

Multimodal & Grounded

Multimodal & Grounded benchmarks
BenchmarkValueTasksDifficultyProvenance
MMMU-Pro
Massive Multi-discipline Multimodal Understanding Pro
73.5Multimodal academic reasoningFrontier multimodalMMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark
AA-MMMU-Pro
Artificial Analysis MMMU-Pro
73.5Multimodal academic reasoningFrontier multimodalArtificial Analysis MMMU-Pro Benchmark Leaderboard
Design Arena Website
Design Arena Website Elo
1228Website generation comparisonsDesign and website generationOpenRouter Grok 4.3 benchmarks
CharXiv
CharXiv Reasoning
82Scientific chart reasoningScientific visualization reasoningCharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs
CharXiv w/o tools
CharXiv Reasoning without tools
78.1Scientific chart reasoning (tool-free)Scientific visualization reasoningCharXiv: Charting Gaps in Realistic Chart Understanding in Multimodal LLMs

Lifecycle and limitations log

Lifecycle events the source associates with this model, plus what this profile does not claim.

No lifecycle event references this model.

That is not evidence the model has no lifecycle plan — only that this source published none.

What this profile does not claimValues are reproduced exactly as their sources published them, in the units those sources declared; none are converted, interpolated, or averaged across providers. Any field marked unavailable was attempted and not returned — the attempt timestamp is in each badge. Last attempted fetch for this model’s score: 2026-09-17 17:17 UTC.