Mellum2-12B-A2.5B-Thinking
JetBrains · Open Weight · bench-align-v5
Capability shape
Seven axes from the ranking source. A missing axis is drawn as a gap.
Runtime service evidence
Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim.
Time to first token: latency to the first answer chunk (Artificial Analysis, via BenchLM). Reasoning models include thinking time, so values can run to tens or hundreds of seconds.
Evidence key: ObservedUnavailable
| Measurement | Value | Observed | Last good | Evidence |
|---|---|---|---|---|
| Time to first token | Unavailable | Unavailable | Unavailable | |
| Throughput | Unavailable | Unavailable | Unavailable |
Regional or per-endpoint measurements appear only when the API supplies them; none are modelled here.
Endpoint and price matrix
Every published price component, including cache reads and writes.
Workload-aware monthly cost example
10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. This uses the same calculator as the cost simulator, so an unavailable applicable rate makes the example unavailable too.
Benchmark record
6 matched benchmark rows with their published value, unit, and provenance.
Knowledge
| Benchmark | Value | Tasks | Difficulty | Provenance |
|---|---|---|---|---|
| GPQA Graduate-Level Google-Proof Q&A | 57.6 | 448 questions | Graduate level | GPQA: A Graduate-Level Google-Proof Q&A Benchmark |
| GPQA-D GPQA Diamond | 57.6 | Graduate-level science questions | Graduate level | Trinity-Large-Thinking: Scaling an Open Source Frontier Agent |
| MMLU-Redux MMLU-Redux | 86.2 | Broad academic QA | Advanced general knowledge | Qwen3.6 launch benchmarks |
Coding
| Benchmark | Value | Tasks | Difficulty | Provenance |
|---|---|---|---|---|
| LiveCodeBench v6 LiveCodeBench v6 | 69.9 | Fresh programming problems | Competitive programming level | LiveCodeBench official repository and release documentation |
Instruction Following
| Benchmark | Value | Tasks | Difficulty | Provenance |
|---|---|---|---|---|
| IFEval Instruction-Following Eval | 76.5 | 541 prompts across 25 instruction types | Instruction precision | Instruction-Following Evaluation for Large Language Models |
Agentic
| Benchmark | Value | Tasks | Difficulty | Provenance |
|---|---|---|---|---|
| BFCL v4 Berkeley Function Calling Leaderboard v4 | 45.6 | Function-calling tasks | Advanced tool use | Trinity-Large-Thinking: Scaling an Open Source Frontier Agent |
Lifecycle and limitations log
Lifecycle events the source associates with this model, plus what this profile does not claim.
That is not evidence the model has no lifecycle plan — only that this source published none.