# Grok 4

xAI · Proprietary · rank 102 · bench-align-v5

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/models/grok-4  
JSON: https://modelscale.dev/api/model/grok-4

## Facts

| Field | Value | Evidence |
| --- | --- | --- |
| Canonical id | `grok-4` | — |
| Overall score | 48.1 | Observed 2026-11-21 · source benchlm:models |
| Verified score (BenchLM): a separate BenchLM figure, not the overall score | 68 | Observed 2026-11-21 · source benchlm:models |
| Context window | 128K tokens | Observed 2026-11-21 · source benchlm:models |
| Release date | 2025-07-09 | Observed 2026-11-21 · source benchlm:models |
| Access type | Proprietary | — |
| Blended $/1M (75% input / 25% output) | Unavailable | Derived from the input and output rates below |

## Capability evidence

Seven axes from the ranking source. An axis the source did not score is unavailable, not zero. Beside each score is BenchLM's separate verified score for that axis; the two are published side by side and are not interchangeable.

| Axis | Score | Evidence | Verified (BenchLM) | Verified evidence |
| --- | --- | --- | --- | --- |
| Agentic | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Coding | 72.5 | Observed 2026-11-21 · source benchlm:models | 72.4 | Observed 2026-11-21 · source benchlm:models |
| Knowledge | 65.7 | Observed 2026-11-21 · source benchlm:models | 65.7 | Observed 2026-11-21 · source benchlm:models |
| Reasoning | 70.9 | Observed 2026-11-21 · source benchlm:models | 70.9 | Observed 2026-11-21 · source benchlm:models |
| Multimodal & Grounded | 65.5 | Observed 2026-11-21 · source benchlm:models | 65.5 | Observed 2026-11-21 · source benchlm:models |
| Instruction Following | 64.2 | Observed 2026-11-21 · source benchlm:models | 64.2 | Observed 2026-11-21 · source benchlm:models |
| Math | 38.3 | Last good 2026-10-08 · source benchlm:models | 38.3 | Last good 2026-10-08 · source benchlm:models |

## Runtime service evidence

Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim. Regional or per-endpoint measurements appear only when the API supplies them; none are modelled.

| Measurement | Value | Observed | Last good | Evidence |
| --- | --- | --- | --- | --- |
| Time to first token | 11.6 s | 2026-11-21 | 2026-11-21 | Observed 2026-11-21 · source benchlm:speed |
| Throughput | 78 tok/s | 2026-11-21 | 2026-11-21 | Observed 2026-11-21 · source benchlm:speed |

## Endpoint and price matrix

Every published price component, including cache reads and writes.

| Component | USD | Evidence |
| --- | --- | --- |
| Input / 1M tokens | Unavailable | Unavailable · source benchlm:pricing |
| Output / 1M tokens | Unavailable | Unavailable · source benchlm:pricing |
| Cache read / 1M tokens | Unavailable | Unavailable · source benchlm:pricing |
| Cache write / 1M tokens | Unavailable | Unavailable · source openrouter:pricing |
| Blended / 1M (75% input / 25% output) | Unavailable | Derived — from the input and output rates above; it has no source record of its own |
| Cost per successful task (LiveBench) | Unavailable | Unavailable · source livebench:table |

**Pricing note.** xAI says Grok 4 is available via API, but the current first-party pricing pages do not expose a clean standalone token-pricing row for the exact `grok-4` alias.

## Workload-aware monthly cost example

10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. Derived here from the published rates above by this site's own calculator — not a figure any source published.

| Field | Value |
| --- | --- |
| Modelled monthly cost | Unavailable |
| Modelled tokens | Unavailable |
| Reason | The applicable input rate is unavailable. |

## Benchmark record

27 matched benchmark rows with their published value, unit, and provenance.

### Knowledge

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AA MMLU-Pro (Artificial Analysis MMLU-Pro) | 86.6 | Professional multi-subject questions | Professional knowledge and reasoning | [Artificial Analysis MMLU-Pro Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/mmlu-pro) |
| Artificial Analysis Intelligence Index | 22.5 | Cross-benchmark intelligence index | Display-only external reference | [Artificial Analysis](https://artificialanalysis.ai/) |
| AA-GPQA Diamond (Artificial Analysis GPQA Diamond) | 87.7 | Graduate-level science questions | Graduate-level science reasoning | [Artificial Analysis GPQA Diamond Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/gpqa-diamond) |
| AA-HLE (Artificial Analysis Humanity's Last Exam) | 26.7 | Expert-level questions | Frontier expert reasoning | [Artificial Analysis Humanity's Last Exam Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/hle) |
| AA-Omniscience Index (Artificial Analysis Omniscience Index) | 2.1 | Knowledge questions | Broad factual knowledge | [AA-Omniscience: Knowledge and Hallucination Benchmark](https://artificialanalysis.ai/evaluations/omniscience) |
| AA-Omniscience Accuracy (Artificial Analysis Omniscience Accuracy) | 40.5 | Knowledge questions | Broad knowledge | [Artificial Analysis model benchmarks](https://artificialanalysis.ai/models/grok-4-3) |
| AA-Omniscience Hallucination Rate (Artificial Analysis Omniscience Hallucination Rate) | 64.5 | Knowledge questions | Factuality | [Artificial Analysis model benchmarks](https://artificialanalysis.ai/models/grok-4-3) |
| GPQA Diamond (Vals) (GPQA Diamond, Vals AI run) | 88.1 | Graduate-level science questions | Expert reasoning | [Vals AI GPQA Diamond, Vals AI run leaderboard](https://www.vals.ai/benchmarks/gpqa) |
| MMLU-Pro (Vals) (MMLU-Pro, Vals AI run) | 85.3 | Academic multiple-choice questions | Broad academic knowledge | [Vals AI MMLU-Pro, Vals AI run leaderboard](https://www.vals.ai/benchmarks/mmlu_pro) |

### Coding

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AA LiveCodeBench (Artificial Analysis LiveCodeBench) | 81.9 | Contamination-resistant coding tasks | Competitive programming | [Artificial Analysis LiveCodeBench Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/livecodebench) |
| React Native Evals | 72.6 | React Native app implementation tasks | Production mobile app engineering | [React Native Evals](https://rn-evals.vercel.app/) |
| LiveCodeBench (Vals) (LiveCodeBench, Vals AI run) | 83.2 | Competitive programming problems (easy, medium, hard) | Frontier coding | [Vals AI LiveCodeBench, Vals AI run leaderboard](https://www.vals.ai/benchmarks/lcb) |
| SWE-bench (Vals) (SWE-bench, Vals AI run) | 57.8 | Real repository issues by human time bucket | Frontier coding agents | [Vals AI SWE-bench, Vals AI run leaderboard](https://www.vals.ai/benchmarks/swebench) |

### Mathematics

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AA AIME 2025 (Artificial Analysis AIME 2025) | 92.7 | 30 AIME 2025 problems | Olympiad mathematics | [Artificial Analysis AIME 2025 Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/aime-2025) |
| AA MATH-500 (Artificial Analysis MATH-500) | 99.0 | 500 competition mathematics problems | High school to undergraduate mathematics | [Artificial Analysis MATH-500 Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/math-500) |
| FrontierMath v2 (Tiers 1-3) (FrontierMath v2 Tiers 1-3) | 19.655 | 285 private advanced mathematics problems | From olympiad-plus to early research mathematics | [FrontierMath v2 benchmark hub](https://epoch.ai/benchmarks/frontiermath-tiers-1-3-v2) |
| FrontierMath v2 (Tier 4) (FrontierMath v2 Tier 4) | 2.083 | 41 private extreme-difficulty mathematics problems | Research-level mathematics requiring hours or days of expert work | [FrontierMath Tier 4 v2 leaderboard](https://epoch.ai/benchmarks/frontiermath-tier-4-v2?view=graph&tab=leaderboard) |

### Reasoning

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AA-LCR (Artificial Analysis Long Context Reasoning) | 68.0 | Long-context reasoning tasks | Long-context reasoning | [Artificial Analysis model benchmarks](https://artificialanalysis.ai/models/grok-4-3) |
| CritPt (Critical Physics Tasks) | 2.0 | Research-level physics questions | Research-level physics reasoning | [CritPt Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/critpt) |

### Instruction Following

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AA-IFBench (Artificial Analysis IFBench) | 53.7 | Verifiable instruction constraints | Instruction precision | [Artificial Analysis IFBench Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/ifbench) |

### Multilingual

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AA Global-MMLU-Lite (Artificial Analysis Global-MMLU-Lite) | 89.5 | Multilingual knowledge questions | Multilingual professional knowledge | [Artificial Analysis Global-MMLU-Lite Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/global-mmlu-lite) |

### Agentic

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| Gert Labs (Gert Labs Composite Game Benchmark) | 42.34 | Novel game environments | Agentic coding and decision-making | [Gert Labs rankings](https://gertlabs.com/rankings) |
| τ²-bench results (τ²-Bench Tool-Agent-User Evaluation) | 74.9 | Airline, retail, and telecom customer-service task sets | Dual-control customer-service workflows | [τ²-Bench: Evaluating Conversational Agents in a Dual-Control Environment](https://arxiv.org/abs/2506.07982) |

### Multimodal & Grounded

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AA-MMMU-Pro (Artificial Analysis MMMU-Pro) | 68.8 | Multimodal academic reasoning | Frontier multimodal | [Artificial Analysis MMMU-Pro Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/mmmu-pro) |

### external

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| BinaryAudit (BinaryAudit (backdoor detection in compiled binaries)) | 8.8 | 19 backdoor and timebomb detection tasks on stripped binaries, three runs each (57 runs); 6 tooling and 8 clean-binary tasks reported alongside | Reverse engineering without source code or symbols | [We hid backdoors in ~40 MB binaries and asked AI + Ghidra to find them (Quesma)](https://quesma.com/blog/introducing-binaryaudit/) |
| OTelBench (OTelBench (OpenTelemetry instrumentation tasks)) | 4.3 | 23 OpenTelemetry instrumentation tasks in 11 languages, three attempts each (69 runs) | Distributed tracing and context propagation across services | [Benchmarking OpenTelemetry: can AI trace your failed login? (Quesma)](https://quesma.com/blog/introducing-otel-bench/) |
| CompileBench (CompileBench (building real projects from source, pass@1)) | 71.1 | 15 build tasks on cowsay, jq, GNU coreutils and curl, three attempts each (45 attempts) | Dependency resolution, legacy toolchains, static linking and cross-compilation | [CompileBench: can AI compile 22-year-old code? (Quesma)](https://quesma.com/blog/introducing-compilebench/) |

## Lifecycle and limitations log

Lifecycle events the source associates with this model.

No lifecycle event references this model. That is not evidence the model has no lifecycle plan — only that this source published none.

## What this profile does not claim

Values are reproduced exactly as their sources published them, in the units those sources declared; none are converted, interpolated, or averaged across providers. Any field marked unavailable was attempted and not returned. Last attempted fetch for this model's score: 2026-11-21 01:17 UTC.
