New Release
Individual benchmark scores plotted by date.
| Organisation | Model | Reported | Top Score | Info | Self Reported | Source |
|---|---|---|---|---|---|---|
| Claude Opus 4.5 | 24 Nov 2025 | 0.81 | Avg@5, 64k Thinking | Yes | Source | |
| Gemini 3.1 Pro Preview | 19 Feb 2026 | 0.81 | Single Attempt | Yes | - | |
| GPT 5.2 | 11 Dec 2025 | 0.80 | - | Yes | Source | |
| GPT 5 | 07 Aug 2025 | 0.75 | With Thinking, Pass @ 1 | Yes | Source | |
| Claude Opus 4.1 | 05 Aug 2025 | 0.74 | - | Yes | Source | |
| GPT 5 Mini | 07 Aug 2025 | 0.71 | High Reasoning Effort, No Tools | Yes | Source | |
| Nova 2 Pro | 02 Dec 2025 | 0.70 | - | Yes | Source | |
| Gemini 2.5 Pro Preview (2025-06-05) | 05 Jun 2025 | 0.67 | Multiple Attempts | Yes | Source | |
| Nova 2 Lite | 02 Dec 2025 | 0.65 | - | Yes | Source | |
| Gemini 2.5 Pro Preview (2025-05-06) | 06 May 2025 | 0.63 | - | Yes | Source | |
| GPT OSS 120b | 05 Aug 2025 | 0.62 | High Reasoning Effort | Yes | Source | |
| GPT OSS 20b | 05 Aug 2025 | 0.61 | High Reasoning Effort | Yes | Source | |
| Gemini 2.5 Flash Preview (2025-05-20) | 20 May 2025 | 0.60 | - | Yes | Source | |
| GPT 5 Nano | 07 Aug 2025 | 0.55 | High Reasoning Effort, No Tools | Yes | Source | |
| GPT 4.1 | 14 Apr 2025 | 0.55 | - | Yes | Source | |
| Devstral Small 1.1 | 10 Jul 2025 | 0.54 | OpenHands Scaffold | Yes | Source | |
| Gemini 2.5 Flash Lite Preview | 17 Jun 2025 | 0.45 | Thinking, Multiple Attempts | Yes | Source | |
| GPT 4.5 | 27 Feb 2025 | 0.38 | - | Yes | Source | |
| GPT 4o (2024-08-06) | 06 Aug 2024 | 0.33 | - | Yes | Source | |
| Gemini Diffusion | 20 May 2025 | 0.23 | Pass@1 | Yes | Source | |
| GPT 4o Mini (2024-07-18) | 18 Jul 2024 | 0.09 | - | Yes | Source |
