# Mellum2.1-12B-A2.5B-Thinking

JetBrains · Open Weight · bench-align-v5 · Self-hosted

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/models/mellum2-1-12b-a2-5b-thinking  
JSON: https://modelscale.dev/api/model/mellum2-1-12b-a2-5b-thinking

## Facts

| Field | Value | Evidence |
| --- | --- | --- |
| Canonical id | `mellum2-1-12b-a2-5b-thinking` | — |
| Overall score | Unavailable | Unavailable · source benchlm:models |
| Verified score (BenchLM): a separate BenchLM figure, not the overall score | 39 | Observed 2026-11-21 · source benchlm:models |
| Context window | 128K tokens | Observed 2026-11-21 · source benchlm:models |
| Release date | 2026-10-08 | Observed 2026-11-21 · source benchlm:models |
| Access type | Open Weight | — |
| Blended $/1M (75% input / 25% output) | Unavailable | Derived from the input and output rates below |

**Only a verified score is published.** BenchLM publishes no overall score for this model, so the overall score stays unavailable. The verified score beside it is a separate figure in BenchLM's data. BenchLM does not document how the two are calculated differently, and they can differ widely, so one is never used in place of the other.

## Capability evidence

Seven axes from the ranking source. An axis the source did not score is unavailable, not zero. Beside each score is BenchLM's separate verified score for that axis; the two are published side by side and are not interchangeable.

| Axis | Score | Evidence | Verified (BenchLM) | Verified evidence |
| --- | --- | --- | --- | --- |
| Agentic | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Coding | 21.1 | Observed 2026-11-21 · source benchlm:models | 21 | Observed 2026-11-21 · source benchlm:models |
| Knowledge | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Reasoning | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Multimodal & Grounded | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Instruction Following | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Math | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |

## Runtime service evidence

Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim. Regional or per-endpoint measurements appear only when the API supplies them; none are modelled.

| Measurement | Value | Observed | Last good | Evidence |
| --- | --- | --- | --- | --- |
| Time to first token | Unavailable | Unavailable | Unavailable | Unavailable · source benchlm:speed |
| Throughput | Unavailable | Unavailable | Unavailable | Unavailable · source benchlm:speed |

## Endpoint and price matrix

Every published price component, including cache reads and writes.

| Component | USD | Evidence |
| --- | --- | --- |
| Input / 1M tokens | Unavailable | Unavailable · source benchlm:pricing |
| Output / 1M tokens | Unavailable | Unavailable · source benchlm:pricing |
| Cache read / 1M tokens | Unavailable | Unavailable · source benchlm:pricing |
| Cache write / 1M tokens | Unavailable | Unavailable · source openrouter:pricing |
| Blended / 1M (75% input / 25% output) | Unavailable | Derived — from the input and output rates above; it has no source record of its own |
| Cost per successful task (LiveBench) | Unavailable | Unavailable · source livebench:table |

**Self-hosted listing.** Apache 2.0 open weights for self-hosted inference. Zero token rates represent no provider token fee; hardware and hosting costs still apply. JetBrains does not publish a hosted API token rate for this checkpoint. No hosted token rate was published for this model, so its per-token price is unavailable rather than zero.

## Workload-aware monthly cost example

10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. Derived here from the published rates above by this site's own calculator — not a figure any source published.

| Field | Value |
| --- | --- |
| Modelled monthly cost | Unavailable |
| Modelled tokens | Unavailable |
| Reason | The applicable input rate is unavailable. |

## Benchmark record

7 matched benchmark rows with their published value, unit, and provenance.

### Knowledge

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| GPQA-D (GPQA Diamond) | 64.6 | Graduate-level science questions | Graduate level | [GPQA: A Graduate-Level Google-Proof Q&A Benchmark](https://arxiv.org/abs/2311.12022) |
| MMLU-Redux | 87.8 | Broad academic QA | Advanced general knowledge | [Qwen3.6 launch benchmarks](https://qwen.ai/blog?id=qwen3.6) |

### Coding

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| SWE-bench Verified (Software Engineering Benchmark Verified) | 47 | 500 verified issues | Professional software engineering | [SWE-bench: Can Language Models Resolve Real-World GitHub Issues?](https://arxiv.org/abs/2310.06770) |
| LiveCodeBench v6 | 82.0 | Fresh programming problems | Competitive programming level | [LiveCodeBench official repository and release documentation](https://github.com/LiveCodeBench/LiveCodeBench) |
| SWE-bench Pro | 28 | 1,865 repository problems | Long-horizon professional engineering | [SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?](https://arxiv.org/abs/2509.16941) |

### Instruction Following

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| IFEval (Instruction-Following Eval) | 90.6 | 541 prompts across 25 instruction types | Instruction precision | [Instruction-Following Evaluation for Large Language Models](https://arxiv.org/abs/2311.07911) |

### Agentic

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| Terminal-Bench 2.1 | 17.4 | Terminal-based software-agent tasks | Professional software engineering | [Terminal-Bench](https://www.tbench.ai/) |

## Lifecycle and limitations log

Lifecycle events the source associates with this model.

No lifecycle event references this model. That is not evidence the model has no lifecycle plan — only that this source published none.

## What this profile does not claim

Values are reproduced exactly as their sources published them, in the units those sources declared; none are converted, interpolated, or averaged across providers. Any field marked unavailable was attempted and not returned. Last attempted fetch for this model's score: 2026-11-21 01:17 UTC.
