New Release
Individual benchmark scores plotted by date.
| Organisation | Model | Reported | Top Score | Info | Self Reported | Source |
|---|---|---|---|---|---|---|
| Grok 3 Mini Beta | 19 Feb 2025 | 7.03 | High Reasoning Effort | No | Source | |
| Deepseek R1 (2025-05-28) | 28 May 2025 | 6.35 | - | No | Source | |
| Claude 3.7 Sonnet | 24 Feb 2025 | 6.31 | 16k Thinking | No | Source | |
| GPT 4.5 | 27 Feb 2025 | 6.28 | - | No | Source | |
| Claude 3.5 Sonnet (2024-10-22) | 22 Oct 2024 | 6.26 | - | No | Source | |
| Grok 3 Beta | 19 Feb 2025 | 6.20 | No Reasoning | No | Source | |
| Claude Opus 4 | 21 May 2025 | 6.01 | No Reasoning | No | Source | |
| Grok 4 | 10 Jul 2025 | 6.00 | - | No | Source | |
| Claude Sonnet 4 | 21 May 2025 | 5.68 | No Reasoning | No | Source | |
| o3 mini | 30 Jan 2025 | 5.51 | Medium Reasoning Effort | No | Source | |
| Deepseek R1 (2025-01-20) | 20 Jan 2025 | 5.36 | - | No | Source | |
| o1 | 17 Dec 2024 | 5.02 | Medium Reasoning Effort | No | Source | |
| Nova Pro 1.0 | 04 Dec 2024 | 4.75 | - | No | Source | |
| Llama 3.3 70B Instruct | 06 Dec 2024 | 4.75 | - | No | Source | |
| GPT 4o Mini (2024-07-18) | 18 Jul 2024 | 4.60 | - | No | Source | |
| Grok 2 | 13 Aug 2024 | 4.50 | - | No | Source | |
| o4 Mini | 16 Apr 2025 | 4.40 | High Reasoning Effort | No | Source | |
| o3 | 16 Apr 2025 | 4.38 | Medium Reasoning Effort | No | Source | |
| Claude 3.5 Haiku | 04 Nov 2024 | 4.29 | - | No | Source | |
| Phi 4 | 12 Dec 2024 | 4.26 | - | No | Source | |
| Gemini 2.5 Pro Preview (2025-06-05) | 05 Jun 2025 | 4.04 | - | No | Source |
