# DeepsecBench-AA leaderboard

Agentic benchmark

> Every figure below is reproduced as its upstream source published it: nothing is modelled, estimated, interpolated or converted. `Unavailable` means no source published the value — it is never a zero. Each value carries its evidence state and the date it was observed.

Page: https://modelscale.dev/leaderboards/benchmarks/agentic-aa-deepsec-bench

Artificial Analysis DeepsecBench-AA. Every model the catalog carries a published DeepsecBench-AA value for, ranked by that value.

## Benchmark record

| Field | Value |
| --- | --- |
| Category | Agentic |
| Measure | Pass@1 |
| Tasks | Vulnerability discovery in real codebases |
| Difficulty | Security code review |
| Published by | [DeepsecBench-AA Benchmark Leaderboard](https://artificialanalysis.ai/evaluations/deepsecbench-aa) |

Artificial Analysis' implementation of Vercel's DeepsecBench, testing agents on finding security vulnerabilities in real web application code. One of the three components of the AA Cyber Index.

## DeepsecBench-AA ranking

23 models with a published DeepsecBench-AA value, ordered by that value, highest first. Models the source has not scored on this benchmark are not listed — they are unmeasured, not last.

| Rank | Model | Provider | Pass@1 | Evidence |
| --- | --- | --- | --- | --- |
| 1 | [GPT-6.2 Sol](https://modelscale.dev/models/gpt-6-2-sol) | OpenAI | 51.6 | Observed 2026-11-21 · source benchlm:models |
| 2 | [GPT-6.2 Astra](https://modelscale.dev/models/gpt-6-2-astra) | OpenAI | 46.8 | Observed 2026-11-21 · source benchlm:models |
| 3 | [GPT-6 Sol](https://modelscale.dev/models/gpt-6-sol) | OpenAI | 46.3 | Observed 2026-11-21 · source benchlm:models |
| 4 | [GPT-6 Astra](https://modelscale.dev/models/gpt-6-astra) | OpenAI | 36.9 | Observed 2026-11-21 · source benchlm:models |
| 5 | [Kimi K3.1 Pro](https://modelscale.dev/models/kimi-3-1-pro) | Moonshot AI | 36.7 | Observed 2026-11-21 · source benchlm:models |
| 6 | [DeepSeek V4.1 Flash 1017](https://modelscale.dev/models/deepseek-v4-1-flash) | DeepSeek | 31.2 | Observed 2026-11-21 · source benchlm:models |
| 7 | [Claude Opus 5.5](https://modelscale.dev/models/claude-opus-5-5) | Anthropic | 26.9 | Observed 2026-11-21 · source benchlm:models |
| 7 | [Grok 4.7](https://modelscale.dev/models/grok-4-7) | xAI | 26.9 | Observed 2026-11-21 · source benchlm:models |
| 9 | [MiMo-V2.6-Pro](https://modelscale.dev/models/mimo-v2-6-pro) | Xiaomi | 26.2 | Observed 2026-11-21 · source benchlm:models |
| 10 | [Claude Opus 5](https://modelscale.dev/models/claude-opus-5) | Anthropic | 25.9 | Observed 2026-11-21 · source benchlm:models |
| 11 | [GPT-5.6 Terra](https://modelscale.dev/models/gpt-5-6-terra) | OpenAI | 25.1 | Observed 2026-11-21 · source benchlm:models |
| 12 | [GLM-5.3](https://modelscale.dev/models/glm-5-3) | Z.AI | 24.3 | Observed 2026-11-21 · source benchlm:models |
| 13 | [Claude Fable 5.1](https://modelscale.dev/models/claude-fable-5-1) | Anthropic | 23.5 | Observed 2026-11-21 · source benchlm:models |
| 13 | [GPT-6 Luna](https://modelscale.dev/models/gpt-6-luna) | OpenAI | 23.5 | Observed 2026-11-21 · source benchlm:models |
| 15 | [GLM-5.3-Flash](https://modelscale.dev/models/glm-5-3-flash) | Z.AI | 19.9 | Observed 2026-11-21 · source benchlm:models |
| 16 | [Step 5 Preview](https://modelscale.dev/models/step-5-preview) | StepFun | 15.8 | Observed 2026-11-21 · source benchlm:models |
| 17 | [Mistral Large 4](https://modelscale.dev/models/mistral-large-4) | Mistral | 15.0 | Observed 2026-11-21 · source benchlm:models |
| 18 | [Gemini 3.8 Flash](https://modelscale.dev/models/gemini-3-8-flash) | Google | 14.5 | Observed 2026-11-21 · source benchlm:models |
| 19 | [Kimi K3](https://modelscale.dev/models/kimi-3) | Moonshot AI | 12.5 | Observed 2026-11-21 · source benchlm:models |
| 20 | [Qwen3.8-27B](https://modelscale.dev/models/qwen3-8-27b) | Alibaba | 11.5 | Observed 2026-11-21 · source benchlm:models |
| 21 | [Beam 1.0 501B-A23B](https://modelscale.dev/models/reflection-beam) | Reflection AI | 6.9 | Observed 2026-11-21 · source benchlm:models |
| 22 | [MiniMax M3](https://modelscale.dev/models/minimax-m3) | MiniMax | 1.1 | Last good 2026-11-17 · source benchlm:models |
| 23 | [Nemotron 3 Ultra](https://modelscale.dev/models/nemotron-3-ultra-500b) | NVIDIA | 1.0 | Last good 2026-11-17 · source benchlm:models |

Rows are ordered by the value the source published, highest first. The source does not state whether a higher value is the better result, so this document does not either: for a benchmark that measures a rate of failure, read the table from the bottom.
