# BigCodeBench leaderboard

Coding benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/coding-big-code-bench

Every model the catalog carries a published BigCodeBench value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Coding |
| Measure | Pass@1 |
| Tasks | Code generation tasks |
| Difficulty | Software engineering |
| Published by | [DeepSeek-V4 Technical Report](https://huggingface.co/deepseek-ai/DeepSeek-V4-Pro/blob/main/DeepSeek_V4.pdf) |

A code-generation benchmark reported in DeepSeek-V4 base-model evaluations.

## BigCodeBench ranking

1 model with a published BigCodeBench value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Pass@1 | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [Ternary Bonsai 2 27B](https://modelscale.dev/models/ternary-bonsai-2-27b) | Prism ML | 58.1 | Observed 2026-11-21 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
