Skip to main content
ModelScale

GPT-5.6 Sol

OpenAI · Proprietary · rank 5 · bench-align-v5

Canonical idgpt-5-6-sol
Overall score80.7
Context window1.05M tokens
Release date2026-07-09
Access typeProprietary
Blended $/1M$8.0075% input / 25% output

Capability shape

Seven axes from the ranking source. A missing axis is drawn as a gap.

Capability evidence

Agentic93.6
Coding62
Knowledge84.6
Reasoning70.4
Multimodal & Grounded87.5
Instruction Following89.1
Math97

Runtime service evidence

Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim.

Time to first token: latency to the first answer chunk (Artificial Analysis, via BenchLM). Reasoning models include thinking time, so values can run to tens or hundreds of seconds.

Evidence key: Observed

Runtime measurements
MeasurementValueObservedLast goodEvidence
Time to first token110.94 s2026-09-172026-09-17
Throughput64 tok/s2026-09-172026-09-17

Regional or per-endpoint measurements appear only when the API supplies them; none are modelled here.

Endpoint and price matrix

Every published price component, including cache reads and writes.

Price components
ComponentUSDEvidence
Input / 1M tokens$4.00
Output / 1M tokens$20.00
Cache read / 1M tokens$0.40
Cache write / 1M tokensUnavailable
Blended / 1M (75% input / 25% output)$8.00
Self-hosted listingOpenAI's API pricing page lists GPT-5.6 Sol at $4.00 input / $0.40 cached input / $20.00 output per million tokens for short-context requests, and states this promotional pricing is available at least through November 21, 2026. Prompts above 272K input tokens use the published $8.00 input / $0.80 cached input / $30.00 output long-context tier; cache writes cost 1.25x uncached input. Observed September 11, 2026; the earlier $5.00 / $30.00 list rate is retained in the price history.The rates above are a hosted price matched from another provider, not a first-party list price.

Workload-aware monthly cost example

10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. This uses the same calculator as the cost simulator, so an unavailable applicable rate makes the example unavailable too.

Modelled monthly cost$22.53
Modelled tokens2.82M
Open the simulatorChange this workload

Benchmark record

72 matched benchmark rows with their published value, unit, and provenance.

Knowledge

Knowledge benchmarks
BenchmarkValueTasksDifficultyProvenance
GPQA
Graduate-Level Google-Proof Q&A
94.6448 questionsGraduate levelGPQA: A Graduate-Level Google-Proof Q&A Benchmark
GPQA-D
GPQA Diamond
94.6Graduate-level science questionsGraduate levelTrinity-Large-Thinking: Scaling an Open Source Frontier Agent
HLE-Verified
HLE-Verified
54.51,811 verified or revised expert questionsFrontier multidisciplinary expert reasoningHLE-Verified: A Systematic Verification and Structured Revision of Humanity's Last Exam
LABBench2
LABBench2: An Improved Benchmark for AI Systems Performing Biology Research
82.1Nearly 1,900 biology-research tasksReal-world biology researchLABBench2: An Improved Benchmark for AI Systems Performing Biology Research
Artificial Analysis Intelligence Index
Artificial Analysis Intelligence Index
58.9Cross-benchmark intelligence indexDisplay-only external referenceArtificial Analysis
AA-GPQA Diamond
Artificial Analysis GPQA Diamond
94.1Graduate-level science questionsGraduate-level science reasoningArtificial Analysis GPQA Diamond Benchmark Leaderboard
AA-HLE
Artificial Analysis Humanity's Last Exam
49.5Expert-level questionsFrontier expert reasoningArtificial Analysis Humanity's Last Exam Benchmark Leaderboard
AA-Omniscience Index
Artificial Analysis Omniscience Index
22.0Knowledge questionsBroad factual knowledgeAA-Omniscience: Knowledge and Hallucination Benchmark
AA-Omniscience Accuracy
Artificial Analysis Omniscience Accuracy
59.4Knowledge questionsBroad knowledgeArtificial Analysis model benchmarks
AA-Omniscience Hallucination Rate
Artificial Analysis Omniscience Hallucination Rate
92.2Knowledge questionsFactualityArtificial Analysis model benchmarks
HealthBench Hard
HealthBench Hard
33.11,000 health promptsAdvanced health reasoningMuse Spark Eval Methodology
HealthBench Professional
HealthBench Professional
60.5Clinician chat tasksProfessional clinical workflowsHealthBench Professional: Evaluating Large Language Models on Real Clinician Chats
GPQA Diamond (Vals)
GPQA Diamond, Vals AI run
95.2Graduate-level science questionsExpert reasoningVals AI GPQA Diamond, Vals AI run leaderboard
MMLU-Pro (Vals)
MMLU-Pro, Vals AI run
89.1Academic multiple-choice questionsBroad academic knowledgeVals AI MMLU-Pro, Vals AI run leaderboard

Coding

Coding benchmarks
BenchmarkValueTasksDifficultyProvenance
Terminal-Bench 2.0
Terminal-Bench 2.0
91.9Terminal-based software tasksProfessional software engineeringTerminal-Bench 2.0
SWE-bench Pro
SWE-bench Pro
64.61,865 repository problemsLong-horizon professional engineeringSWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?
VulcanBench v3
VulcanBench v3
87.023 post-cutoff repository tasks in the v3 reportProfessional multi-file software engineeringVulcanBench
VulcanBench CII v1
VulcanBench Coding Intelligence Index v1
86.538 validated post-cutoff repository tasksMid-band frontier software engineeringCII v1 frontier results
FrontierCode 1.1 Extended
FrontierCode 1.1 Extended
60.6150 private software-engineering tasksFrontier coding-agent qualityGPT-5.6 models are now available in Devin
FrontierSWE v2
FrontierSWE v2
32.234 ultra-long-horizon engineering and research tasksUltra-long-horizon frontier software engineeringFrontierSWE v2
Bug Hunt Bench
Bug Hunt Bench
42105 planted bugs across two production TypeScript repositoriesBlind production-repository bug finding and repairBug Hunt Bench method, caveats, and definitions
AA Coding Index
Artificial Analysis Coding Index
77.4Cross-benchmark coding indexDisplay-only external referenceArtificial Analysis model leaderboards
AA-SciCode
Artificial Analysis SciCode
57.1Scientific coding subproblemsScientific programmingArtificial Analysis SciCode Benchmark Leaderboard
LiveCodeBench (Vals)
LiveCodeBench, Vals AI run
82.6Competitive programming problems (easy, medium, hard)Frontier codingVals AI LiveCodeBench, Vals AI run leaderboard
SWE-bench (Vals)
SWE-bench, Vals AI run
96.2Real repository issues by human time bucketFrontier coding agentsVals AI SWE-bench, Vals AI run leaderboard
DeepSWE
DeepSWE
72.7113 software engineering tasks across 91 repositories and 5 languagesLong-horizon software engineeringDeepSWE benchmark blog

Mathematics

Mathematics benchmarks
BenchmarkValueTasksDifficultyProvenance
FrontierMath (legacy)
FrontierMath legacy aggregate
89Historical aggregateResearch-level mathematicsFrontierMath: A Benchmark for Evaluating Advanced Mathematical Reasoning in AI
FrontierMath v2 (Tiers 1-3)
FrontierMath v2 Tiers 1-3
89.000295 private advanced mathematics problemsFrom olympiad-plus to early research mathematicsFrontierMath v2 benchmark hub
FrontierMath v2 (Tier 4)
FrontierMath v2 Tier 4
83.00043 private extreme-difficulty mathematics problemsResearch-level mathematics requiring hours or days of expert workFrontierMath Tier 4 v2 leaderboard

Reasoning

Reasoning benchmarks
BenchmarkValueTasksDifficultyProvenance
ARC-AGI-2
Abstraction and Reasoning Corpus for AGI v2
92.5Visual pattern completion and abstract reasoningExpert-level — hardest public reasoning benchmarkARC-AGI-2: A Harder General Intelligence Benchmark
ARC-AGI-3
Abstraction and Reasoning Corpus for AGI v3
7.78Interactive game-like tasks with hidden rulesFrontier agentic reasoningARC-AGI-3: A New Challenge for Frontier Agentic Intelligence
GeneBench-Pro
GeneBench-Pro
28.7129 genomics statistical-analysis workflowsLong-horizon scientific reasoningGeneBench-Pro: Evaluating Multistage Statistical Reasoning
AA-LCR
Artificial Analysis Long Context Reasoning
84.0Long-context reasoning tasksLong-context reasoningArtificial Analysis model benchmarks
MLCR-AA
Medical Long Context Reasoning (MLCR-AA)
26.1Long, fragmented medical-record reasoningLong-context medical reasoningMedical Long Context Reasoning (MLCR-AA)
CritPt
Critical Physics Tasks
32.3Research-level physics questionsResearch-level physics reasoningCritPt Benchmark Leaderboard

Instruction Following

Instruction Following benchmarks
BenchmarkValueTasksDifficultyProvenance
AA-IFBench
Artificial Analysis IFBench
72.7Verifiable instruction constraintsInstruction precisionArtificial Analysis IFBench Benchmark Leaderboard

Agentic

Agentic benchmarks
BenchmarkValueTasksDifficultyProvenance
Terminal-Bench 3.0
Terminal-Bench 3.0
34.674 professional computer-work tasks across 7 domainsFrontier autonomous knowledge workTerminal-Bench 3.0
AA Briefcase
Artificial Analysis Briefcase
1475Professional knowledge-work tasksProfessional workArtificial Analysis Briefcase Benchmark Leaderboard
AA AutomationBench
Artificial Analysis AutomationBench
60.1Business-process automation tasksAgentic automationArtificial Analysis AutomationBench Benchmark Leaderboard
AA EnterpriseOps-Gym
Artificial Analysis EnterpriseOps-Gym
42.9Enterprise operations workflowsEnterprise agent operationsArtificial Analysis EnterpriseOps-Gym Benchmark Leaderboard
AA Harvey LAB
Artificial Analysis Harvey LAB-AA
87.2Legal agent tasksProfessional legal workArtificial Analysis Harvey LAB-AA Benchmark Leaderboard
AA ITBench
Artificial Analysis ITBench-AA
56.2IT incident-response tasksEnterprise IT operationsArtificial Analysis ITBench-AA Benchmark Leaderboard
AA Tau3 Banking
Artificial Analysis Tau3-Banking
44.3Banking tool-use workflowsAgentic banking workflowsArtificial Analysis Tau3-Banking Benchmark Leaderboard
Terminal-Bench 2.0
Terminal-Bench 2.0
91.9Terminal-based software tasksProfessional software engineeringTerminal-Bench 2.0
BrowseComp
BrowseComp
92.2Research questions requiring browsingHard web researchBrowseComp
GDPval-AA
GDPval-AA
1735Agentic real-world work tasksProfessional agentic workflowsDeepSeek-V4 Technical Report
GDPval-AA
GDPval-AA normalized
56.2Economically valuable tasksProfessional agentic workflowsArtificial Analysis model benchmarks
AA Agentic Index
Artificial Analysis Agentic Index
50.5Cross-benchmark agentic indexDisplay-only external referenceArtificial Analysis model leaderboards
AA Terminal-Bench 4.0
Artificial Analysis Terminal-Bench v4.0
39.9Terminal-based agent tasksAgentic software engineeringArtificial Analysis Terminal-Bench v4.0 Benchmark Leaderboard
GDP.pdf
Artificial Analysis GDP.pdf
27.2Professional document-production tasksProfessional knowledge workGDP.pdf Benchmark Leaderboard
AA-AnalystAgent
Artificial Analysis AnalystAgent
47.5Spreadsheet and document analysis questionsBusiness and data analysisAA-AnalystAgent Benchmark Leaderboard
OSWorld 2.0
OSWorld 2.0
62.6108 long-horizon computer-use workflowsLong-horizon professional workflowsOSWorld2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks
CyberGym
CyberGym
84.51,507 vulnerability analysis instancesReal-world cybersecurityCyberGym: Evaluating AI Agents' Real-World Cybersecurity Capabilities at Scale
ExploitGym
ExploitGym
33.7898 exploitation tasksAdvanced cybersecurity exploitationExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks?
Toolathlon
Toolathlon
58Multi-tool workflowsAdvanced tool useIntroducing GPT-5.4 mini and nano
τ²-bench results
τ²-Bench Tool-Agent-User Evaluation
85.1Airline, retail, and telecom customer-service task setsDual-control customer-service workflowsτ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment
Terminal-Bench 2.1 (Vals)
Terminal-Bench 2.1, Vals AI run
85.8Difficult terminal tasksFrontier agenticVals AI Terminal-Bench 2.1, Vals AI run leaderboard
ApprenticeBench
ApprenticeBench: end-to-end computer use, continual learning, and long-horizon agency on a real accounts-payable job
26100 vendor bills processed in sequence inside a simulated construction companyLong-horizon computer use with offline and online continual learningApprenticeBench: a step change in AI's job readiness

Multimodal & Grounded

Multimodal & Grounded benchmarks
BenchmarkValueTasksDifficultyProvenance
MMMU-Pro
Massive Multi-discipline Multimodal Understanding Pro
83Multimodal academic reasoningFrontier multimodalMMMU-Pro: A More Robust Multi-discipline Multimodal Understanding Benchmark
AA-MMMU-Pro
Artificial Analysis MMMU-Pro
83.4Multimodal academic reasoningFrontier multimodalArtificial Analysis MMMU-Pro Benchmark Leaderboard
MMMU-Pro w/ Python
MMMU-Pro with Python
84.6Multimodal academic reasoningFrontier multimodalIntroducing GPT-5.4 mini and nano

external

external benchmarks
BenchmarkValueTasksDifficultyProvenance
ExploitBench
ExploitBench v8-bench
74V8 exploit synthesis runsBrowser exploitation and cybersecurityExploitBench
The Last Ones completion
The Last Ones Cyber Range Completion Rate
7010 long-horizon runsLong-horizon cyber operationsUK AISI and CAISI Preliminary Assessment of Kimi K3's Cyber Capabilities
ACCR standard
Advanced Cyber Completion Rate — Standard Access
1.5Internal advanced-cyber request setCyber access and safeguardsExpanding Daybreak as the cyber defense window narrows
ACCR Daybreak Blue
Advanced Cyber Completion Rate — Daybreak Blue
2.0Internal advanced-cyber request setCyber access and safeguardsExpanding Daybreak as the cyber defense window narrows
SEC-Bench Pro
SEC-Bench Pro
71.2Security engineering tasksAdvanced cybersecurityIntroducing GPT-5.6
FrontierCyber
FrontierCyber
9.6197 dynamic cyber tasksEasy through elite cyber operationsFrontierCyber
CyScenarioBench success
CyScenarioBench Average Success Rate
2811 cyber scenariosLong-horizon cybersecurityAssessing GPT-5.6 Sol
CyScenarioBench solved
CyScenarioBench Scenarios Ever Solved
711 cyber scenariosLong-horizon cybersecurityAssessing GPT-5.6 Sol
Atomic network attacks
Atomic Network Attack Simulation
98Atomic cyber tasksNetwork attack simulationAssessing GPT-5.6 Sol
Atomic vulnerability research
Atomic Vulnerability Research and Exploitation
91Atomic cyber tasksVulnerability research and exploitationAssessing GPT-5.6 Sol
Atomic evasion
Atomic Evasion
56Atomic cyber tasksCybersecurity evasionAssessing GPT-5.6 Sol

Lifecycle and limitations log

Lifecycle events the source associates with this model, plus what this profile does not claim.

No lifecycle event references this model.

That is not evidence the model has no lifecycle plan — only that this source published none.

What this profile does not claimValues are reproduced exactly as their sources published them, in the units those sources declared; none are converted, interpolated, or averaged across providers. Any field marked unavailable was attempted and not returned — the attempt timestamp is in each badge. Last attempted fetch for this model’s score: 2026-09-17 17:17 UTC.