Skip to main content
ModelScale

Llama 3.1 405B

Meta · Open Weight · rank 193 · bench-align-v5

Self-hosted
Canonical idllama-3-1-405b
Overall score36.73
Context window128K tokens
Release date2024-07-23
Access typeOpen Weight
Blended $/1MUnavailable75% input / 25% output

Capability shape

Seven axes from the ranking source. A missing axis is drawn as a gap.

Capability evidence

AgenticUnavailable
CodingUnavailable
KnowledgeUnavailable
ReasoningUnavailable
Multimodal & GroundedUnavailable
Instruction FollowingUnavailable
MathUnavailable

Runtime service evidence

Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim.

Time to first token: latency to the first answer chunk (Artificial Analysis, via BenchLM). Reasoning models include thinking time, so values can run to tens or hundreds of seconds.

Evidence key: Observed

Runtime measurements
MeasurementValueObservedLast goodEvidence
Time to first token2.19 s2026-09-172026-09-17
Throughput29 tok/s2026-09-172026-09-17

Regional or per-endpoint measurements appear only when the API supplies them; none are modelled here.

Endpoint and price matrix

Every published price component, including cache reads and writes.

Price components
ComponentUSDEvidence
Input / 1M tokensUnavailable
Output / 1M tokensUnavailable
Cache read / 1M tokensUnavailable
Cache write / 1M tokensUnavailable
Blended / 1M (75% input / 25% output)Unavailable
Self-hosted listingOpen-weight model. Self-hosted or third-party hosted costs vary by provider and infrastructure.No hosted token rate was published for this model, so its per-token price is unavailable rather than zero.

Workload-aware monthly cost example

10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. This uses the same calculator as the cost simulator, so an unavailable applicable rate makes the example unavailable too.

Modelled monthly costUnavailableThe applicable input rate is unavailable.
Modelled tokensUnavailable
Open the simulatorChange this workload

Benchmark record

10 matched benchmark rows with their published value, unit, and provenance.

Knowledge

Knowledge benchmarks
BenchmarkValueTasksDifficultyProvenance
Artificial Analysis Intelligence Index
Artificial Analysis Intelligence Index
7.3Cross-benchmark intelligence indexDisplay-only external referenceArtificial Analysis
AA-GPQA Diamond
Artificial Analysis GPQA Diamond
51.5Graduate-level science questionsGraduate-level science reasoningArtificial Analysis GPQA Diamond Benchmark Leaderboard
AA-HLE
Artificial Analysis Humanity's Last Exam
4.0Expert-level questionsFrontier expert reasoningArtificial Analysis Humanity's Last Exam Benchmark Leaderboard
AA-Omniscience Index
Artificial Analysis Omniscience Index
-17.1Knowledge questionsBroad factual knowledgeAA-Omniscience: Knowledge and Hallucination Benchmark
AA-Omniscience Accuracy
Artificial Analysis Omniscience Accuracy
23.2Knowledge questionsBroad knowledgeArtificial Analysis model benchmarks
AA-Omniscience Hallucination Rate
Artificial Analysis Omniscience Hallucination Rate
52.4Knowledge questionsFactualityArtificial Analysis model benchmarks

Reasoning

Reasoning benchmarks
BenchmarkValueTasksDifficultyProvenance
AA-LCR
Artificial Analysis Long Context Reasoning
25.3Long-context reasoning tasksLong-context reasoningArtificial Analysis model benchmarks
CritPt
Critical Physics Tasks
0.0Research-level physics questionsResearch-level physics reasoningCritPt Benchmark Leaderboard

Instruction Following

Instruction Following benchmarks
BenchmarkValueTasksDifficultyProvenance
AA-IFBench
Artificial Analysis IFBench
39.0Verifiable instruction constraintsInstruction precisionArtificial Analysis IFBench Benchmark Leaderboard

Agentic

Agentic benchmarks
BenchmarkValueTasksDifficultyProvenance
τ²-bench results
τ²-Bench Tool-Agent-User Evaluation
19Airline, retail, and telecom customer-service task setsDual-control customer-service workflowsτ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment

Lifecycle and limitations log

Lifecycle events the source associates with this model, plus what this profile does not claim.

No lifecycle event references this model.

That is not evidence the model has no lifecycle plan — only that this source published none.

What this profile does not claimValues are reproduced exactly as their sources published them, in the units those sources declared; none are converted, interpolated, or averaged across providers. Any field marked unavailable was attempted and not returned — the attempt timestamp is in each badge. Last attempted fetch for this model’s score: 2026-09-17 17:17 UTC.