New Release
Individual benchmark scores plotted by date.
| Organisation | Model | Reported | Top Score | Info | Self Reported | Source |
|---|---|---|---|---|---|---|
| Grok 4 | 10 Jul 2025 | 0.92 | - | No | Source | |
| o3 Pro | 10 Jun 2025 | 0.87 | Medium Reasoning Effort | No | Source | |
| o1 pro | 19 Mar 2025 | 0.82 | Medium Reasoning Effort | No | Source | |
| o3 | 16 Apr 2025 | 0.80 | High Reasoning Effort | No | Source | |
| o4 Mini | 16 Apr 2025 | 0.75 | High Reasoning Effort | No | Source | |
| o1 | 17 Dec 2024 | 0.71 | Medium Reasoning Effort | No | Source | |
| o3 mini | 30 Jan 2025 | 0.61 | High Reasoning Effort | No | Source | |
| Gemini 2.5 Pro Preview (2025-06-05) | 05 Jun 2025 | 0.59 | - | No | Source | |
| Claude Opus 4 | 21 May 2025 | 0.53 | 16k Thinking | No | Source | |
| Deepseek R1 (2025-05-28) | 28 May 2025 | 0.50 | - | No | Source | |
| Gemini 2.5 Pro Preview (2025-05-06) | 06 May 2025 | 0.42 | - | No | Source | |
| Claude Sonnet 4 | 21 May 2025 | 0.41 | 16k Thinking | No | Source | |
| Deepseek R1 (2025-01-20) | 20 Jan 2025 | 0.39 | - | No | Source | |
| GPT 4.5 | 27 Feb 2025 | 0.34 | - | No | Source | |
| Claude 3.7 Sonnet | 24 Feb 2025 | 0.34 | 16k Thinking | No | Source | |
| Grok 3 Mini Beta | 19 Feb 2025 | 0.31 | High Reasoning Effort | No | Source | |
| o1 mini | 12 Sept 2024 | 0.27 | - | No | Source | |
| GPT 4.1 | 14 Apr 2025 | 0.24 | - | No | Source | |
| Grok 3 Beta | 19 Feb 2025 | 0.20 | No Reasoning | No | Source | |
| Grok 2 | 13 Aug 2024 | 0.19 | - | No | Source | |
| Claude 3 Opus | 04 Mar 2024 | 0.19 | - | No | Source | |
| GPT 4o (2024-08-06) | 06 Aug 2024 | 0.19 | - | No | Source | |
| GPT 4o (2024-11-20) | 20 Nov 2024 | 0.18 | - | No | Source | |
| Claude 3.5 Sonnet (2024-10-22) | 22 Oct 2024 | 0.18 | - | No | Source | |
| DeepSeek V3 (2025-03-24) | 25 Mar 2025 | 0.17 | - | No | Source | |
| Llama 3.3 70B Instruct | 06 Dec 2024 | 0.15 | - | No | Source | |
| GPT 4.1 Mini | 14 Apr 2025 | 0.15 | - | No | Source | |
| Command A | 13 Mar 2025 | 0.14 | - | No | Source | |
| Gemma 2 27B | 27 Jun 2024 | 0.12 | - | No | Source | |
| Gemma 3 27B | 12 Mar 2025 | 0.12 | - | No | Source | |
| Claude 3.5 Haiku | 04 Nov 2024 | 0.10 | - | No | Source | |
| Phi 4 | 12 Dec 2024 | 0.10 | - | No | Source | |
| Nova Pro 1.0 | 04 Dec 2024 | 0.10 | - | No | Source | |
| GPT 4o Mini (2024-07-18) | 18 Jul 2024 | 0.10 | - | No | Source | |
| GPT 4.1 Nano | 14 Apr 2025 | 0.09 | - | No | Source | |
| Claude 3 Haiku | 13 Mar 2024 | 0.02 | - | No | Source |
