GPT-6 Astra
OpenAI · Proprietary · rank 2 · bench-align-v5
Capability shape
Seven axes from the ranking source. A missing axis is drawn as a gap.
Runtime service evidence
Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim.
Time to first token: latency to the first answer chunk (Artificial Analysis, via BenchLM). Reasoning models include thinking time, so values can run to tens or hundreds of seconds.
Evidence key: Observed
| Measurement | Value | Observed | Last good | Evidence |
|---|---|---|---|---|
| Time to first token | 334.04 s | 2026-09-17 | 2026-09-17 | |
| Throughput | 60 tok/s | 2026-09-17 | 2026-09-17 |
Regional or per-endpoint measurements appear only when the API supplies them; none are modelled here.
Endpoint and price matrix
Every published price component, including cache reads and writes.
| Component | USD | Evidence |
|---|---|---|
| Input / 1M tokens | $10.00 | |
| Output / 1M tokens | $50.00 | |
| Cache read / 1M tokens | $1.00 | |
| Cache write / 1M tokens | $12.50 | |
| Blended / 1M (75% input / 25% output) | $20.00 |
Workload-aware monthly cost example
10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. This uses the same calculator as the cost simulator, so an unavailable applicable rate makes the example unavailable too.
Benchmark record
58 matched benchmark rows with their published value, unit, and provenance.
Knowledge
| Benchmark | Value | Tasks | Difficulty | Provenance |
|---|---|---|---|---|
| GPQA Graduate-Level Google-Proof Q&A | 96 | 448 questions | Graduate level | GPQA: A Graduate-Level Google-Proof Q&A Benchmark |
| GPQA-D GPQA Diamond | 96.0 | Graduate-level science questions | Graduate level | Trinity-Large-Thinking: Scaling an Open Source Frontier Agent |
| Artificial Analysis Intelligence Index Artificial Analysis Intelligence Index | 52.8 | Cross-benchmark intelligence index | Display-only external reference | Artificial Analysis |
| AA-GPQA Diamond Artificial Analysis GPQA Diamond | 96.1 | Graduate-level science questions | Graduate-level science reasoning | Artificial Analysis GPQA Diamond Benchmark Leaderboard |
| AA-HLE Artificial Analysis Humanity's Last Exam | 54.7 | Expert-level questions | Frontier expert reasoning | Artificial Analysis Humanity's Last Exam Benchmark Leaderboard |
| AA-Omniscience Index Artificial Analysis Omniscience Index | 43.4 | Knowledge questions | Broad factual knowledge | AA-Omniscience: Knowledge and Hallucination Benchmark |
| AA-Omniscience Accuracy Artificial Analysis Omniscience Accuracy | 62.6 | Knowledge questions | Broad knowledge | Artificial Analysis model benchmarks |
| AA-Omniscience Hallucination Rate Artificial Analysis Omniscience Hallucination Rate | 51.3 | Knowledge questions | Factuality | Artificial Analysis model benchmarks |
| HealthBench Hard HealthBench Hard | 36.3 | 1,000 health prompts | Advanced health reasoning | Muse Spark Eval Methodology |
| HealthBench Professional HealthBench Professional | 63.4 | Clinician chat tasks | Professional clinical workflows | HealthBench Professional: Evaluating Large Language Models on Real Clinician Chats |
Coding
| Benchmark | Value | Tasks | Difficulty | Provenance |
|---|---|---|---|---|
| FrontierCode 1.1 Main FrontierCode 1.1 Main | 53.3 | 100 private Main tasks (150 in Extended) | Frontier coding-agent quality | FrontierCode leaderboard |
| FrontierCode 1.1 Extended FrontierCode 1.1 Extended | 64.5 | 150 private software-engineering tasks | Frontier coding-agent quality | GPT-5.6 models are now available in Devin |
| AA Coding Index Artificial Analysis Coding Index | 76.9 | Cross-benchmark coding index | Display-only external reference | Artificial Analysis model leaderboards |
| AA-SciCode Artificial Analysis SciCode | 56.5 | Scientific coding subproblems | Scientific programming | Artificial Analysis SciCode Benchmark Leaderboard |
| DeepSWE DeepSWE | 74.1 | 113 software engineering tasks across 91 repositories and 5 languages | Long-horizon software engineering | DeepSWE benchmark blog |
Mathematics
| Benchmark | Value | Tasks | Difficulty | Provenance |
|---|---|---|---|---|
| FrontierMath v2 (Tier 4) FrontierMath v2 Tier 4 | 97.600 | 43 private extreme-difficulty mathematics problems | Research-level mathematics requiring hours or days of expert work | FrontierMath Tier 4 v2 leaderboard |
Reasoning
| Benchmark | Value | Tasks | Difficulty | Provenance |
|---|---|---|---|---|
| ARC-AGI-1 ARC-AGI-1 Semi-Private Evaluation | 98.50 | Semi-private ARC-AGI-1 evaluation set | Abstract visual reasoning | ARC Prize leaderboard |
| MRCR v2 256K-512K OpenAI MRCR v2 8-needle 256K-512K | 100.0 | 100 eight-needle retrieval examples | Very long-context retrieval | Muse Spark 1.3 Evaluation Methodology |
| MRCR v2 512K-1M OpenAI MRCR v2 8-needle 512K-1M | 96.3 | 100 eight-needle retrieval examples | Million-token retrieval | Muse Spark 1.3 Evaluation Methodology |
| ARC-AGI-2 Abstraction and Reasoning Corpus for AGI v2 | 95 | Visual pattern completion and abstract reasoning | Expert-level — hardest public reasoning benchmark | ARC-AGI-2: A Harder General Intelligence Benchmark |
| ARC-AGI-3 Abstraction and Reasoning Corpus for AGI v3 | 62.71 | Interactive game-like tasks with hidden rules | Frontier agentic reasoning | ARC-AGI-3: A New Challenge for Frontier Agentic Intelligence |
| GeneBench-Pro GeneBench-Pro | 37.8 | 129 genomics statistical-analysis workflows | Long-horizon scientific reasoning | GeneBench-Pro: Evaluating Multistage Statistical Reasoning |
| AA-LCR Artificial Analysis Long Context Reasoning | 80.7 | Long-context reasoning tasks | Long-context reasoning | Artificial Analysis model benchmarks |
| MLCR-AA Medical Long Context Reasoning (MLCR-AA) | 35.0 | Long, fragmented medical-record reasoning | Long-context medical reasoning | Medical Long Context Reasoning (MLCR-AA) |
| CritPt Critical Physics Tasks | 31.7 | Research-level physics questions | Research-level physics reasoning | CritPt Benchmark Leaderboard |
Agentic
| Benchmark | Value | Tasks | Difficulty | Provenance |
|---|---|---|---|---|
| Terminal-Bench 4.0 Terminal-Bench 4.0 | 57.90 | 66 professional computer-work tasks | Frontier autonomous knowledge work | Terminal-Bench 4.0 |
| Terminal-Bench-Science 0.1 Terminal-Bench-Science 0.1 | 64.6 | 70 expert-curated scientific research workflows | Frontier scientific research workflows | Terminal-Bench-Science 0.1 |
| AA Briefcase Artificial Analysis Briefcase | 1562 | Professional knowledge-work tasks | Professional work | Artificial Analysis Briefcase Benchmark Leaderboard |
| AA AutomationBench Artificial Analysis AutomationBench | 68.5 | Business-process automation tasks | Agentic automation | Artificial Analysis AutomationBench Benchmark Leaderboard |
| AA Tau3 Banking Artificial Analysis Tau3-Banking | 41.4 | Banking tool-use workflows | Agentic banking workflows | Artificial Analysis Tau3-Banking Benchmark Leaderboard |
| BrowseComp BrowseComp | 91.5 | Research questions requiring browsing | Hard web research | BrowseComp |
| HLE w/ tools Humanity's Last Exam with tools | 57.2 | Expert questions with tool use | Frontier tool-augmented reasoning | DeepSeek-V4 Technical Report |
| GDPval-AA GDPval-AA | 1580 | Agentic real-world work tasks | Professional agentic workflows | DeepSeek-V4 Technical Report |
| GDPval-AA GDPval-AA normalized | 54.0 | Economically valuable tasks | Professional agentic workflows | Artificial Analysis model benchmarks |
| AA Agentic Index Artificial Analysis Agentic Index | 51.5 | Cross-benchmark agentic index | Display-only external reference | Artificial Analysis model leaderboards |
| AA Terminal-Bench 4.0 Artificial Analysis Terminal-Bench v4.0 | 59.1 | Terminal-based agent tasks | Agentic software engineering | Artificial Analysis Terminal-Bench v4.0 Benchmark Leaderboard |
| GDP.pdf Artificial Analysis GDP.pdf | 31.0 | Professional document-production tasks | Professional knowledge work | GDP.pdf Benchmark Leaderboard |
| AA-AnalystAgent Artificial Analysis AnalystAgent | 51.2 | Spreadsheet and document analysis questions | Business and data analysis | AA-AnalystAgent Benchmark Leaderboard |
| OSWorld 2.0 OSWorld 2.0 | 72.6 | 108 long-horizon computer-use workflows | Long-horizon professional workflows | OSWorld2.0: Benchmarking Computer Use Agents on Long-Horizon Real-World Tasks |
| ExploitGym ExploitGym | 42.4 | 898 exploitation tasks | Advanced cybersecurity exploitation | ExploitGym: Can AI Agents Turn Security Vulnerabilities into Real Attacks? |
| AutomationBench AutomationBench | 41.4 | 600 public automation tasks | Long-horizon automation | Kimi K3: Open Frontier Intelligence |
| Agents' Last Exam Agents' Last Exam | 59.3 | Agent tasks | Advanced agentic work | DeepSeek V4 Flash 0731 update |
| Terminal-Bench 2.1 (Vals) Terminal-Bench 2.1, Vals AI run | 87.3 | Difficult terminal tasks | Frontier agentic | Vals AI Terminal-Bench 2.1, Vals AI run leaderboard |
| ApprenticeBench ApprenticeBench: end-to-end computer use, continual learning, and long-horizon agency on a real accounts-payable job | 68 | 100 vendor bills processed in sequence inside a simulated construction company | Long-horizon computer use with offline and online continual learning | ApprenticeBench: a step change in AI's job readiness |
Multimodal & Grounded
| Benchmark | Value | Tasks | Difficulty | Provenance |
|---|---|---|---|---|
| BenchCAD Vision2Code (tools) BenchCAD Vision2Code voxel IoU with tools | 0.959 | 1,000-file Vision2Code subset | Programmatic CAD generation | BenchCAD: A comprehensive, industry-standard benchmark for programmatic CAD |
| AA-MMMU-Pro Artificial Analysis MMMU-Pro | 86.9 | Multimodal academic reasoning | Frontier multimodal | Artificial Analysis MMMU-Pro Benchmark Leaderboard |
| ScreenSpot Pro ScreenSpot Pro | 92.7 | 1,581 grounding instructions | Professional GUI grounding | ScreenSpot-Pro: GUI Grounding for Professional High-Resolution Computer Use |
external
| Benchmark | Value | Tasks | Difficulty | Provenance |
|---|---|---|---|---|
| SRE-Bench SRE-Bench binary reverse engineering | 88.0 | 262 binary reverse-engineering instances | Binary reverse engineering | GPT-6 Astra System Card |
| ExploitBench ExploitBench v8-bench | 100 | V8 exploit synthesis runs | Browser exploitation and cybersecurity | ExploitBench |
| ACCR standard Advanced Cyber Completion Rate — Standard Access | 3.5 | Internal advanced-cyber request set | Cyber access and safeguards | Expanding Daybreak as the cyber defense window narrows |
| ACCR Daybreak Blue Advanced Cyber Completion Rate — Daybreak Blue | 3.5 | Internal advanced-cyber request set | Cyber access and safeguards | Expanding Daybreak as the cyber defense window narrows |
| SEC-Bench Pro SEC-Bench Pro | 85.4 | Security engineering tasks | Advanced cybersecurity | Introducing GPT-5.6 |
| FrontierCyber FrontierCyber | 38.1 | 197 dynamic cyber tasks | Easy through elite cyber operations | FrontierCyber |
| CyScenarioBench success CyScenarioBench Average Success Rate | 59 | 11 cyber scenarios | Long-horizon cybersecurity | Assessing GPT-5.6 Sol |
| CyScenarioBench solved CyScenarioBench Scenarios Ever Solved | 9 | 11 cyber scenarios | Long-horizon cybersecurity | Assessing GPT-5.6 Sol |
| Atomic network attacks Atomic Network Attack Simulation | 100 | Atomic cyber tasks | Network attack simulation | Assessing GPT-5.6 Sol |
| Atomic vulnerability research Atomic Vulnerability Research and Exploitation | 100 | Atomic cyber tasks | Vulnerability research and exploitation | Assessing GPT-5.6 Sol |
| Atomic evasion Atomic Evasion | 52 | Atomic cyber tasks | Cybersecurity evasion | Assessing GPT-5.6 Sol |
Lifecycle and limitations log
Lifecycle events the source associates with this model, plus what this profile does not claim.