# BullshitBench v2 leaderboard

Reasoning benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/reasoning-bullshit-bench-v2

Every model the catalog carries a published BullshitBench v2 value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Reasoning |
| Measure | Prompt challenge and refusal evaluation |
| Tasks | Nonsensical and flawed prompts across multiple domains |
| Difficulty | Robustness and critical reasoning |
| Published by | [BullshitBench: Measuring whether AI models challenge nonsensical prompts](https://petergpt.github.io/bullshit-benchmark/) |

A benchmark that tests whether AI models challenge nonsensical, ill-posed, or logically flawed prompts instead of confidently generating incorrect answers. Measures the critical ability to push back on bad input.

## BullshitBench v2 ranking

No model in the catalog has a published BullshitBench v2 score. The benchmark is defined by BullshitBench: Measuring whether AI models challenge nonsensical prompts, but the catalog carries no value for it yet. An absent value is shown as absent here rather than as a zero.

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
