TL;DR

Nemotron 3 Ultra by NVIDIA scores 46.45 overall and carries a context window of 1M tokens — observed 2026-10-23.

Nemotron 3 Ultra

NVIDIA · Open Weight · rank 118 · bench-align-v5

Self-hosted

Compare this model Model a workload

Canonical idnemotron-3-ultra-500b

Overall score46.45

Context window1M tokens

Release date2026-06-04

Access typeOpen Weight

Blended $/1MUnavailable75% input / 25% output

Capability shape

Seven axes from the ranking source. A missing axis is drawn as a gap.

Capability evidence

Agentic20.4

Coding58.9

Knowledge57.4

Reasoning69.5

Multimodal & GroundedUnavailable

Instruction Following92.1

Runtime service evidence

Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim.

Time to first token: latency to the first answer chunk (Artificial Analysis, via BenchLM). Reasoning models include thinking time, so values can run to tens or hundreds of seconds.

Evidence key: ObservedUnavailable

Runtime measurements
Measurement	Value	Observed	Last good	Evidence
Time to first token	Unavailable	Unavailable	Unavailable
Throughput	Unavailable	Unavailable	Unavailable

Regional or per-endpoint measurements appear only when the API supplies them; none are modelled here.

Endpoint and price matrix

Every published price component, including cache reads and writes.

Price components
Component	USD	Evidence
Input / 1M tokens	Unavailable
Output / 1M tokens	Unavailable
Cache read / 1M tokens	Unavailable
Cache write / 1M tokens	Unavailable
Blended / 1M (75% input / 25% output)	Unavailable
Cost per successful task (LiveBench)	Unavailable

Self-hosted listingOpen-weight model. Self-hosted or third-party hosted costs vary by provider and infrastructure.No hosted token rate was published for this model, so its per-token price is unavailable rather than zero.

Workload-aware monthly cost example

10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. This uses the same calculator as the cost simulator, so an unavailable applicable rate makes the example unavailable too.

Modelled monthly costUnavailableThe applicable input rate is unavailable.

Modelled tokensUnavailable

Open the simulatorChange this workload

Benchmark record

52 matched benchmark rows with their published value, unit, and provenance.

Knowledge

Knowledge benchmarks
Benchmark	Value	Tasks	Difficulty	Provenance
AA Openness Index Artificial Analysis Openness Index	83.3	Model openness assessment	Display-only external reference	Artificial Analysis Openness Index
GPQA Graduate-Level Google-Proof Q&A	87	448 questions	Graduate level	GPQA: A Graduate-Level Google-Proof Q&A Benchmark
GPQA-D GPQA Diamond	87.0	Graduate-level science questions	Graduate level	GPQA: A Graduate-Level Google-Proof Q&A Benchmark
MMLU-Pro Massive Multitask Language Understanding Professional

Lifecycle and limitations log

Lifecycle events the source associates with this model, plus what this profile does not claim.

No lifecycle event references this model.

That is not evidence the model has no lifecycle plan — only that this source published none.

What this profile does not claimValues are reproduced exactly as their sources published them, in the units those sources declared; none are converted, interpolated, or averaged across providers. Any field marked unavailable was attempted and not returned — the attempt timestamp is in each badge. Last attempted fetch for this model’s score: 2026-10-23 13:17 UTC.

Benchmark

Value

Tasks

Difficulty

Provenance

AA Briefcase

Artificial Analysis Briefcase

876

Professional knowledge-work tasks

Professional work

Artificial Analysis Briefcase Benchmark Leaderboard

AA AutomationBench

Artificial Analysis AutomationBench

3.0

Business-process automation tasks

Agentic automation

Artificial Analysis AutomationBench Benchmark Leaderboard

AA EnterpriseOps-Gym

Artificial Analysis EnterpriseOps-Gym

28.9

Enterprise operations workflows

Enterprise agent operations

Artificial Analysis EnterpriseOps-Gym Benchmark Leaderboard

AA Harvey LAB v1.0

Artificial Analysis Harvey LAB-AA v1.0

81.7

Legal agent tasks

Professional legal work

Artificial Analysis Harvey LAB-AA Benchmark Leaderboard

AA Tau3 Banking

Artificial Analysis Tau3-Banking

14.2

Banking tool-use workflows

Agentic banking workflows

Artificial Analysis Tau3-Banking Benchmark Leaderboard

Terminal-Bench 2.0

Terminal-Bench 2.0

56.4

Terminal-based software tasks

Professional software engineering

Terminal-Bench 2.0

Terminal-Bench 2.1

Terminal-Bench 2.1

56.4

Terminal-based software-agent tasks

Professional software engineering

Terminal-Bench

BrowseComp

BrowseComp

44.4

Research questions requiring browsing

Hard web research

BrowseComp

HLE w/ tools

Humanity's Last Exam with tools

37.4

Expert questions with tool use

Frontier tool-augmented reasoning

DeepSeek-V4 Technical Report

GDPval-AA

GDPval-AA

1091

Agentic real-world work tasks

Professional agentic workflows

DeepSeek-V4 Technical Report

GDPval-AA

GDPval-AA normalized

33.1

Economically valuable tasks

Professional agentic workflows

Artificial Analysis model benchmarks

AA Agentic Index

Artificial Analysis Agentic Index

21.7

Cross-benchmark agentic index

Display-only external reference

Artificial Analysis model leaderboards

AA Terminal-Bench 4.0

Artificial Analysis Terminal-Bench v4.0

0.5

Terminal-based agent tasks

Agentic software engineering

Artificial Analysis Terminal-Bench v4.0 Benchmark Leaderboard

GDP.pdf

Artificial Analysis GDP.pdf

5.0

Professional document-production tasks

Professional knowledge work

GDP.pdf Benchmark Leaderboard

AA-AnalystAgent

Artificial Analysis AnalystAgent

6.3

Spreadsheet and document analysis questions

Business and data analysis

AA-AnalystAgent Benchmark Leaderboard

τ²-bench results

τ²-Bench Tool-Agent-User Evaluation

83.3

Airline, retail, and telecom customer-service task sets

Dual-control customer-service workflows

τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment

PinchBench

PinchBench

90.0

23 OpenClaw agent tasks

Long-horizon agent workflows

About PinchBench

τ³-bench results

τ³-Bench Tool-Agent-User Evaluation

70.9

Corrected customer-service tasks plus knowledge and voice evaluation modes

Long-horizon, multimodal, and knowledge-aware tool use

Official τ³-bench repository and release notes

Terminal-Bench 2.1 (Vals)

Terminal-Bench 2.1, Vals AI run

50.9

Difficult terminal tasks

Frontier agentic

Vals AI Terminal-Bench 2.1, Vals AI run leaderboard

MazeBench

MazeBench: visual spatial reasoning in a 3D open world

100 hidden gems across 256 rooms in one open world

Long-horizon spatial planning, with single puzzles that can take over one hundred moves

MazeBench Results

Benchmark	Value	Tasks	Difficulty	Provenance
Terminal-Bench 2.1 Terminal-Bench 2.1	56.4	Terminal-based software-agent tasks	Professional software engineering	Terminal-Bench
Terminal-Bench 2.0 Terminal-Bench 2.0	56.4	Terminal-based software tasks	Professional software engineering	Terminal-Bench 2.0
SWE-bench Verified Software Engineering Benchmark Verified	71.9	500 verified issues	Professional software engineering	SWE-bench: Can Language Models Resolve Real-World GitHub Issues?
LiveCodeBench v6 LiveCodeBench v6	89.0	Fresh programming problems	Competitive programming level	LiveCodeBench official repository and release documentation
SWE Multilingual SWE Multilingual	67.7	Multilingual software-engineering tasks	Professional software engineering	MiniMax M2.7: Early Echoes of Self-Evolution
SciCode Scientific Code Benchmark	44.6	—	—	BenchLM
AA Coding Index Artificial Analysis Coding Index	49.3	Cross-benchmark coding index	Display-only external reference	Artificial Analysis model leaderboards
AA-SciCode Artificial Analysis SciCode	40.3	Scientific coding subproblems	Scientific programming	Artificial Analysis SciCode Benchmark Leaderboard
LiveCodeBench (Vals) LiveCodeBench, Vals AI run	86.0	Competitive programming problems (easy, medium, hard)	Frontier coding	Vals AI LiveCodeBench, Vals AI run leaderboard
SWE-bench (Vals) SWE-bench, Vals AI run	69.0	Real repository issues by human time bucket	Frontier coding agents	Vals AI SWE-bench, Vals AI run leaderboard

Benchmark	Value	Tasks	Difficulty	Provenance
LongBench v2 LongBench v2	61.9	Long-context tasks	Hard long-context	LongBench v2
AA-LCR Artificial Analysis Long Context Reasoning	67.0	Long-context reasoning tasks	Long-context reasoning	Artificial Analysis model benchmarks
MLCR-AA Medical Long Context Reasoning (MLCR-AA)	11.1	Long, fragmented medical-record reasoning	Long-context medical reasoning	Medical Long Context Reasoning (MLCR-AA)
CritPt Critical Physics Tasks	3.1	Research-level physics questions	Research-level physics reasoning	CritPt Benchmark Leaderboard

Explore models

Top 1-5

Top 6-10

Featured

Capabilities

Benchmarks

Compare

Featured model comparisons

Featured provider comparisons

Articles