Loading...
Loading...
This website is not yet fully optimised for mobile viewing. Some features may not display or function as intended.
The Best Models
Model Performance Over Time - Condensed
GPQA Scores Across Model Releases
- GPQA Growth
8.7%
Year-over-year SOTA improvement
- Innovation Cycle
4 months
Avg. time between SOTA records
- Progress Acceleration
-0.0024
Change in improvement rate (points/month²)
- Historical Progress
75.7x
Total GPQA improvement since 2019
All Model Information (144 models)
 | o3 Preview | 01 Dec 2023 | - | Proprietary | - | - | - | - | 87.7% | |
 | Claude 3.7 Sonnet | 01 Apr 2024 | 24 Feb 2025 | Proprietary | - | 200,000 | $3.00 | $15.00 | 84.8% | |
 | Gemini 2.5 Pro | 31 Jan 2025 | 28 Mar 2025 | Proprietary | - | 1,048,576 | - | - | 84.0% | |
 | Grok 3 Mini Beta (Think) | - | - | Proprietary | - | - | - | - | 84.0% | |
| Claude Sonnet 4 | 01 Mar 2025 | 21 May 2025 | Proprietary | - | 200,000 | $3.00 | $15.00 | 83.8% | |
| Claude Opus 4 | 01 Mar 2025 | 21 May 2025 | Proprietary | - | 200,000 | $15.00 | $75.00 | 83.3% | |
| o3 | 01 Jun 2024 | 16 Apr 2025 | Proprietary | - | 200,000 | $10.00 | $40.00 | 83.3% | |
| o4 Mini | 01 Jun 2024 | 16 Apr 2025 | Proprietary | - | 200,000 | $1.10 | $4.40 | 81.4% | |
| o4 Mini High | 01 Jun 2024 | 16 Apr 2025 | Proprietary | - | 200,000 | $1.10 | $4.40 | 81.4% | |
| o3 Mini High | - | 12 Feb 2025 | Proprietary | - | 200,000 | $1.10 | $4.40 | 79.7% | |
| o1-pro | - | 19 Mar 2025 | Proprietary | - | 200,000 | $150.00 | $600.00 | 79.0% | |
| Gemini 2.5 Flash | 31 Jan 2025 | 17 Apr 2025 | Proprietary | - | 1,048,576 | - | - | 78.3% | |
| Claude 3.7 Sonnet (thinking) | - | 24 Feb 2025 | Proprietary | - | 200,000 | $3.00 | $15.00 | 78.2% | |
| o1 | - | 17 Dec 2024 | Proprietary | - | 200,000 | $15.00 | $60.00 | 78.0% | |
| o3-mini | 30 Sept 2023 | 30 Jan 2025 | Proprietary | - | 200,000 | - | - | 77.2% | |
| o3 Mini Medium | - | 31 Jan 2025 | Proprietary | - | 200,000 | $1.10 | $4.40 | 76.8% | |
 | Llama 3.1 Nemotron Ultra 253B v1 | 01 Dec 2023 | 07 Apr 2025 | Open | 253.0B | 131,072 | - | - | 76.0% | |
| Grok 3 Beta | 17 Nov 2024 | 17 Feb 2025 | Proprietary | - | 128,000 | - | - | 75.4% | |
| Grok 3 Beta (Think) | 17 Nov 2024 | - | Proprietary | - | 128,000 | - | - | 75.4% | |
| Gemini 2.0 Flash Thinking | 01 Aug 2024 | 21 Jan 2025 | Proprietary | - | 1,000,000 | - | - | 74.2% | |
| o1-preview | - | 12 Sept 2024 | Proprietary | - | 128,000 | $15.00 | $60.00 | 73.3% | |
 | R1 | - | 20 Jan 2025 | Open | 671.0B | 128,000 | $0.50 | $3.00 | 71.5% | |
| GPT-4.5 (Preview) | - | 27 Feb 2025 | Proprietary | - | 128,000 | $75.00 | $150.00 | 71.4% | |
| o3 Mini Low | - | 12 Feb 2025 | Proprietary | - | 200,000 | $1.10 | $4.40 | 70.6% | |
 | Llama 4 Maverick | - | 05 Apr 2025 | - | - | 1,048,576 | $0.17 | $0.85 | 69.8% |
GPQA Score vs Cost
Claude 3 Opus
Claude 3 Sonnet
Claude 3.5 Haiku
Claude 3.5 Sonnet
Claude 3.5 Sonnet
Claude 3.7 Sonnet
Claude 3.7 Sonnet (thinking)
Claude Opus 4
Claude Sonnet 4
GPT-4 Turbo
GPT-4.1
GPT-4.1 Mini
GPT-4.1 Nano
GPT-4.5 (Preview)
GPT-4o
GPT-4o-mini
Llama 3.1 405B Instruct
Llama 3.1 70B Instruct
Llama 3.3 70B Instruct
Llama 4 Maverick
Llama 4 Scout
Nova Lite 1.0
Nova Premier
Nova Pro 1.0
o1
o1-mini
o1-preview
o1-pro
o3
o3 Mini High
o3 Mini Low
o3 Mini Medium
o4 Mini
o4 Mini High
R1
R1
GPQA Score vs Context Length
Claude 3.5 Sonnet
Claude 3.5 Sonnet
Claude 3.7 Sonnet
Claude 3.7 Sonnet (thinking)
Claude Opus 4
Claude Sonnet 4
DeepSeek-V3 0324
Gemini 2.0 Flash Thinking
Gemini 2.5 Flash
Gemini 2.5 Pro
GPT-4.1
GPT-4.5
GPT-4.5 (Preview)
Grok 3 Beta
Grok 3 Beta (Think)
Grok 3 Mini Beta
Llama 3.1 Nemotron Ultra 253B v1
Llama 4 Maverick
Llama-3.3 Nemotron Super 49B v1
o1
o1-preview
o1-pro
o3
o3 Mini High
o3 Mini Low
o3 Mini Medium
o3-mini
o4 Mini
o4 Mini High
Phi 4 Reasoning
Phi 4 Reasoning Plus
Qwen3 30B A3B
QwQ-32B
QwQ-32B-Preview
R1
R1
Parameters vs GPQA Score
DeepSeek-V3
DeepSeek-V3 0324
Gemini 1.5 Flash 8B
Gemini 1.5 Flash 8B
Gemma 3 12B
Gemma 3 27B
Gemma 3 4B
Jamba 1.5 Large
Jamba 1.5 Mini
Llama 3.1 Nemotron Nano 8B V1
Llama 3.1 Nemotron Ultra 253B v1
Llama 3.2 11B Instruct
Llama 3.2 90B Instruct
Llama-3.3 Nemotron Super 49B v1
Mistral Small 3 24B Base
Mistral Small 3 24B Instruct
Mistral Small 3.1 24B Base
Mistral Small 3.1 24B Instruct
Phi 4
Phi 4 Mini Reasoning
Phi 4 Reasoning
Phi 4 Reasoning Plus
Phi-3.5-mini-instruct
Phi-3.5-MoE-instruct
Qwen2 72B Instruct
Qwen2.5 14B Instruct
Qwen2.5 32B Instruct
Qwen2.5 72B Instruct
Qwen2.5 7B Instruct
Qwen2.5 VL 32B Instruct
Qwen2.5-Omni-7B
Qwen3 235B A22B
Qwen3 30B A3B
QwQ-32B
QwQ-32B-Preview
R1
R1
Context Length vs Cost
Claude 2.0
Claude 2.1
Claude 3 Haiku
Claude 3 Opus
Claude 3 Sonnet
Claude 3.5 Haiku
Claude 3.5 Sonnet
Claude 3.5 Sonnet
Claude 3.7 Sonnet
Claude 3.7 Sonnet (thinking)
Claude Opus 4
Claude Sonnet 4
Gemini 1.5 Flash
Gemini 1.5 Flash
GPT-2
GPT-4 Turbo
GPT-4.1
GPT-4.1 Mini
Llama 2 13B Chat
Llama 2 70B Chat
Llama 3 70B Instruct
Llama 3 8B Instruct
Llama 3.1 405B (base)
Llama 3.1 405B Instruct
Llama 3.1 70B Instruct
Llama 3.1 8B Instruct
Llama 3.2 1B Instruct
Llama 3.2 3B Instruct
Llama 3.3 70B Instruct
Llama 4 Maverick
Llama 4 Scout
Nova Lite 1.0
Nova Micro 1.0
Nova Premier
Nova Pro 1.0
R1
R1
New Models
| Event | Model | Provider | Type | Announced Date | Release Date | |
|---|---|---|---|---|---|---|
Announced Released | R1 | | Text | 28 May 2025 | 28 May 2025 | 5 days ago |
Announced Released | Claude Opus 4 | | Multimodal | 21 May 2025 | 21 May 2025 | 12 days ago |
Announced Released | Claude Sonnet 4 | | Multimodal | 21 May 2025 | 21 May 2025 | 12 days ago |
Announced Released | Granite 4.0 Tiny Preview |  | Text | 02 May 2025 | 02 May 2025 | 1 mo ago |
Announced Released | Nova Premier |  | Multimodal | 30 Apr 2025 | 30 Apr 2025 | 1 mo ago |