New Release
Individual benchmark scores plotted by date.
| Organisation | Model | Reported | Top Score | Info | Self Reported | Source |
|---|---|---|---|---|---|---|
| Gemma 2 27B | 27 Jun 2024 | 2.60 | - | No | Source | |
| GPT 4o Mini (2024-07-18) | 18 Jul 2024 | 2.30 | - | No | Source | |
| Claude 3.5 Haiku | 04 Nov 2024 | 2.25 | - | No | Source | |
| Grok 2 | 13 Aug 2024 | 2.21 | - | No | Source | |
| Gemma 3 27B | 12 Mar 2025 | 2.21 | - | No | Source | |
| Llama 3.3 70B Instruct | 06 Dec 2024 | 2.12 | - | No | Source | |
| Nova Pro 1.0 | 04 Dec 2024 | 2.11 | - | No | Source | |
| Phi 4 | 12 Dec 2024 | 2.10 | - | No | Source | |
| Grok 3 Beta | 19 Feb 2025 | 2.07 | No Reasoning | No | Source | |
| GPT 4o (2024-11-20) | 20 Nov 2024 | 1.96 | - | No | Source | |
| DeepSeek V3 (2025-03-24) | 25 Mar 2025 | 1.95 | - | No | Source | |
| o1 mini | 12 Sept 2024 | 1.95 | - | No | Source | |
| GPT 4.5 | 27 Feb 2025 | 1.93 | - | No | Source | |
| Claude 3.5 Sonnet (2024-10-22) | 22 Oct 2024 | 1.93 | - | No | Source | |
| Grok 3 Mini Beta | 19 Feb 2025 | 1.90 | Low Reasoning Effort | No | Source | |
| Claude Sonnet 4 | 21 May 2025 | 1.89 | No Reasoning | No | Source | |
| Claude 3.7 Sonnet | 24 Feb 2025 | 1.88 | - | No | Source | |
| Grok 4 | 10 Jul 2025 | 1.88 | - | No | Source | |
| o3 mini | 30 Jan 2025 | 1.85 | Medium Reasoning Effort | No | Source | |
| o3 | 16 Apr 2025 | 1.83 | Medium Reasoning Effort | No | Source | |
| o4 Mini | 16 Apr 2025 | 1.82 | High Reasoning Effort | No | Source | |
| o3 Pro | 10 Jun 2025 | 1.82 | Medium Reasoning Effort | No | Source | |
| Deepseek R1 (2025-01-20) | 20 Jan 2025 | 1.80 | - | No | Source | |
| o1 | 17 Dec 2024 | 1.80 | Medium Reasoning Effort | No | Source | |
| Gemini 2.5 Pro Preview (2025-06-05) | 05 Jun 2025 | 1.79 | - | No | Source | |
| Gemini 2.5 Pro Preview (2025-05-06) | 06 May 2025 | 1.75 | - | No | Source | |
| Deepseek R1 (2025-05-28) | 28 May 2025 | 1.74 | - | No | Source | |
| Claude Opus 4 | 21 May 2025 | 1.70 | No Reasoning | No | Source |
