# LFM2.5-24B-A2B

LiquidAI · Open Weight · rank 142 · bench-align-v5

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/models/lfm2-5-24b-a2b  
JSON: https://modelscale.dev/api/model/lfm2-5-24b-a2b

## Facts

| Field | Value | Evidence |
| --- | --- | --- |
| Canonical id | `lfm2-5-24b-a2b` | — |
| Overall score | 41.5 | Observed 2026-11-21 · source benchlm:models |
| Verified score (BenchLM): a separate BenchLM figure, not the overall score | 40 | Observed 2026-11-21 · source benchlm:models |
| Context window | 131K tokens | Observed 2026-11-21 · source benchlm:models |
| Release date | 2026-10-13 | Observed 2026-11-21 · source benchlm:models |
| Access type | Open Weight | — |
| Blended $/1M (75% input / 25% output) | $0.33 | Derived from the input and output rates below |

## Capability evidence

Seven axes from the ranking source. An axis the source did not score is unavailable, not zero. Beside each score is BenchLM's separate verified score for that axis; the two are published side by side and are not interchangeable.

| Axis | Score | Evidence | Verified (BenchLM) | Verified evidence |
| --- | --- | --- | --- | --- |
| Agentic | Unavailable | Unavailable · source benchlm:models | 29.8 | Observed 2026-11-21 · source benchlm:models |
| Coding | 25.7 | Observed 2026-11-21 · source benchlm:models | 25.6 | Observed 2026-11-21 · source benchlm:models |
| Knowledge | 28 | Observed 2026-11-21 · source benchlm:models | 28 | Observed 2026-11-21 · source benchlm:models |
| Reasoning | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Multimodal & Grounded | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |
| Instruction Following | 76.5 | Observed 2026-11-21 · source benchlm:models | 76.5 | Observed 2026-11-21 · source benchlm:models |
| Math | Unavailable | Unavailable · source benchlm:models | Unavailable | Unavailable · source benchlm:models |

## Runtime service evidence

Measured values with the date they were observed. Nothing is inferred from a sibling model or a provider claim. Regional or per-endpoint measurements appear only when the API supplies them; none are modelled.

| Measurement | Value | Observed | Last good | Evidence |
| --- | --- | --- | --- | --- |
| Time to first token | Unavailable | Unavailable | Unavailable | Unavailable · source benchlm:speed |
| Throughput | Unavailable | Unavailable | Unavailable | Unavailable · source benchlm:speed |

## Endpoint and price matrix

Every published price component, including cache reads and writes.

| Component | USD | Evidence |
| --- | --- | --- |
| Input / 1M tokens | $0.10 | Observed 2026-11-21 · source benchlm:pricing |
| Output / 1M tokens | $1.00 | Observed 2026-11-21 · source benchlm:pricing |
| Cache read / 1M tokens | $0.05 | Observed 2026-11-21 · source benchlm:pricing |
| Cache write / 1M tokens | Unavailable | Unavailable · source openrouter:pricing |
| Blended / 1M (75% input / 25% output) | $0.33 | Derived — from the input and output rates above; it has no source record of its own |
| Cost per successful task (LiveBench) | Unavailable | Unavailable · source livebench:table |

**Pricing note.** Liquid AI's October 13, 2026 launch post lists Liquid Console pricing at $0.10 per million input tokens, $0.05 per million cached input tokens, and $1.00 per million output tokens. The weights are also available for local self-hosting.

## Workload-aware monthly cost example

10 conversations per day × 8 messages × 22 active days, 1200 input and 400 output tokens per message, no cache. Derived here from the published rates above by this site's own calculator — not a figure any source published.

| Field | Value |
| --- | --- |
| Modelled monthly cost | $0.92 |
| Modelled tokens | 2.82M |

## Benchmark record

14 matched benchmark rows with their published value, unit, and provenance.

### Knowledge

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| GPQA (Graduate-Level Google-Proof Q&A) | 74.42 | 448 questions | Graduate level | [GPQA: A Graduate-Level Google-Proof Q&A Benchmark](https://arxiv.org/abs/2311.12022) |
| GPQA-D (GPQA Diamond) | 74.4 | Graduate-level science questions | Graduate level | [GPQA: A Graduate-Level Google-Proof Q&A Benchmark](https://arxiv.org/abs/2311.12022) |
| HLE (Humanity's Last Exam) | 7.4 | Expert-level questions | Frontier expert level | [Humanity's Last Exam](https://lastexam.ai/) |
| AA-Omniscience Index (Artificial Analysis Omniscience Index) | -24.9 | Knowledge questions | Broad factual knowledge | [AA-Omniscience: Knowledge and Hallucination Benchmark](https://artificialanalysis.ai/evaluations/omniscience) |

### Coding

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| SWE-bench Verified (Software Engineering Benchmark Verified) | 51 | 500 verified issues | Professional software engineering | [SWE-bench: Can Language Models Resolve Real-World GitHub Issues?](https://arxiv.org/abs/2310.06770) |
| SciCode (Scientific Code Benchmark) | 32.71 | — | — | [BenchLM](https://benchlm.ai/benchmarks/scicode) |

### Mathematics

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| MATH-500 (MATH-500 Problem Set) | 96.04 | 500 problems | High school to undergraduate | [Measuring Mathematical Problem Solving With the MATH Dataset](https://arxiv.org/abs/2103.03874) |

### Instruction Following

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| IFEval (Instruction-Following Eval) | 96.75 | 541 prompts across 25 instruction types | Instruction precision | [Instruction-Following Evaluation for Large Language Models](https://arxiv.org/abs/2311.07911) |
| IFBench (Instruction Following Benchmark) | 74.69 | — | — | [BenchLM](https://benchlm.ai/benchmarks/ifbench) |

### Agentic

| Benchmark | Value | Tasks | Difficulty | Provenance |
| --- | --- | --- | --- | --- |
| AutomationBench | 27.7 | 600 public automation tasks | Long-horizon automation | [Kimi K3: Open Frontier Intelligence](https://www.kimi.com/blog/kimi-k3) |
| PinchBench | 83.2 | 23 OpenClaw agent tasks | Long-horizon agent workflows | [About PinchBench](https://pinchbench.com/about) |
| BFCL v4 (Berkeley Function Calling Leaderboard v4) | 65.0 | Function-calling tasks | Advanced tool use | [The Berkeley Function Calling Leaderboard (BFCL): From Tool Use to Agentic Evaluation of Large Language Models](https://gorilla.cs.berkeley.edu/leaderboard.html) |
| τ³-bench results (τ³-Bench Tool-Agent-User Evaluation) | 8.0 | Corrected customer-service tasks plus knowledge and voice evaluation modes | Long-horizon, multimodal, and knowledge-aware tool use | [Official τ³-bench repository and release notes](https://github.com/sierra-research/tau2-bench) |
| WebArena-Verified (WebArena-Verified Browser Agent Benchmark) | 26.75 | 812 verified tasks; separate 258-task Hard subset | Audited stateful browser work | [WebArena-Verified: A Fully Audited Benchmark for Web Agents](https://openreview.net/forum?id=94tlGxmqkN) |

## Lifecycle and limitations log

Lifecycle events the source associates with this model.

No lifecycle event references this model. That is not evidence the model has no lifecycle plan — only that this source published none.

## What this profile does not claim

Values are reproduced exactly as their sources published them, in the units those sources declared; none are converted, interpolated, or averaged across providers. Any field marked unavailable was attempted and not returned. Last attempted fetch for this model's score: 2026-11-21 01:17 UTC.
