New Release
Individual benchmark scores plotted by date.
| Organisation | Model | Reported | Top Score | Info | Self Reported | Source |
|---|---|---|---|---|---|---|
| Gemini 2.5 Pro Preview (2025-06-05) | 05 Jun 2025 | 0.62 | - | No | Source | |
| Claude Opus 4.1 | 05 Aug 2025 | 0.60 | - | No | Source | |
| Claude Opus 4 | 21 May 2025 | 0.59 | - | No | Source | |
| GPT 5 | 07 Aug 2025 | 0.57 | High Reasoning Effort | No | Source | |
| o3 | 16 Apr 2025 | 0.53 | High Reasoning Effort | No | Source | |
| Claude 3.7 Sonnet | 24 Feb 2025 | 0.46 | Thinking | No | Source | |
| Claude Sonnet 4 | 21 May 2025 | 0.46 | Thinking | No | Source | |
| o1 preview | 12 Sept 2024 | 0.42 | - | No | Source | |
| Claude 3.5 Sonnet (2024-10-22) | 22 Oct 2024 | 0.41 | - | No | Source | |
| Deepseek R1 (2025-05-28) | 28 May 2025 | 0.41 | - | No | Source | |
| o1 | 17 Dec 2024 | 0.40 | - | No | Source | |
| o4 Mini | 16 Apr 2025 | 0.39 | High Reasoning Effort | No | Source | |
| Grok 3 | 18 Apr 2025 | 0.36 | - | No | Source | |
| GPT 4.5 | 27 Feb 2025 | 0.34 | - | No | Source | |
| Deepseek R1 (2025-01-20) | 20 Jan 2025 | 0.31 | - | No | Source | |
| Gemini 2.0 Flash | 05 Feb 2025 | 0.31 | Thinking | No | Source | |
| Claude 3.5 Sonnet (2024-06-20) | 21 Jun 2024 | 0.28 | - | No | Source | |
| DeepSeek V3 (2025-03-24) | 25 Mar 2025 | 0.27 | - | No | Source | |
| Gemini 1.5 Pro 002 | 24 Sept 2024 | 0.27 | - | No | Source | |
| GPT 4.1 | 14 Apr 2025 | 0.27 | - | No | Source | |
| GPT 4 Turbo (2023-03-14) | 14 Mar 2023 | 0.25 | - | No | Source | |
| Claude 3 Opus | 04 Mar 2024 | 0.23 | - | No | Source | |
| Llama 3.1 405B Instruct | 23 Jul 2024 | 0.23 | - | No | Source | |
| o3 mini | 30 Jan 2025 | 0.23 | High Reasoning Effort | No | Source | |
| Grok 2 | 13 Aug 2024 | 0.23 | - | No | Source | |
| Llama 3.3 70B Instruct | 06 Dec 2024 | 0.20 | - | No | Source | |
| o1 mini | 12 Sept 2024 | 0.18 | - | No | Source | |
| GPT 4o (2024-11-20) | 20 Nov 2024 | 0.18 | - | No | Source | |
| Command R+ | 30 Aug 2024 | 0.17 | - | No | Source | |
| GPT 4o Mini (2024-07-18) | 18 Jul 2024 | 0.11 | - | No | Source |
