New Release
Individual benchmark scores plotted by date.
| Organisation | Model | Reported | Top Score | Info | Self Reported | Source |
|---|---|---|---|---|---|---|
| o3 | 16 Apr 2025 | 0.74 | High Reasoning Effort | No | Source | |
| Claude Opus 4 | 21 May 2025 | 0.73 | 32k Thinking | No | Source | |
| Claude Sonnet 4 | 21 May 2025 | 0.72 | 64k Thinking | No | Source | |
| o4 Mini | 16 Apr 2025 | 0.72 | High Reasoning Effort | No | Source | |
| Deepseek R1 (2025-05-28) | 28 May 2025 | 0.69 | - | No | Source | |
| Claude 3.7 Sonnet | 24 Feb 2025 | 0.67 | 64k Thinking | No | Source | |
| Deepseek R1 (2025-01-20) | 20 Jan 2025 | 0.65 | - | No | Source | |
| Grok 3 Beta | 19 Feb 2025 | 0.62 | High Reasoning Effort | No | Source | |
| GPT 4.5 | 27 Feb 2025 | 0.59 | - | No | Source | |
| GPT 4.1 | 14 Apr 2025 | 0.56 | - | No | Source | |
| Claude 3.5 Sonnet (2024-10-22) | 22 Oct 2024 | 0.52 | - | No | Source | |
| GPT 4.1 Mini | 14 Apr 2025 | 0.52 | - | No | Source | |
| GPT 4.1 Nano | 14 Apr 2025 | 0.40 | - | No | Source | |
| Claude 3.5 Haiku | 04 Nov 2024 | 0.40 | - | No | Source |
