o1
OpenAI
Highlights
Top benchmark results for openai/o1-2024-12-17.
6117#1
0.62#12
0.74#23
0.31#15
0.01#14
11.74#4
5.02#14
0.78#25
338#2
1397#11
1045#18
0.71#6
0.40#12
1.80#5
Benchmark table
Detailed scores across tracked benchmarks.
| Benchmark | Category | Top Score | Info | Self Reported | Source |
|---|---|---|---|---|---|
| AidanBench | - | 6117 | - | No | Source |
| Aider-Polyglot | code | 0.62 | - | No | Source |
| AIME 2024 | math | 0.74 | - | Yes | Source |
| ARC-AGI-1 | - | 0.31 | Medium Reasoning Effort | No | Source |
| ARC-AGI-2 | - | 0.01 | Medium Reasoning Effort | No | Source |
| Confabulations | - | 11.74 | Medium Reasoning Effort | No | Source |
| Elimation Game | - | 5.02 | Medium Reasoning Effort | No | Source |
| GPQA Diamond | general-knowledge | 0.78 | - | Yes | Source |
| LisanBench | - | 338 | - | No | Source |
| LMArena Text | - | 1397 | - | No | Source |
| LMArena WebDev | - | 1045 | 16th June 2025 | No | Source |
| NYT Connections | - | 0.71 | Medium Reasoning Effort | No | Source |
| SimpleBench | - | 0.40 | - | No | Source |
| Thematic Generalisation | - | 1.80 | Medium Reasoning Effort | No | Source |
Benchmark comparisons
Use the selector to switch benchmarks and see how this model stacks up against its closest competitors.
Confabulations
Compare this model with the leading peers for the selected benchmark.
Benchmark
11.74
Rank #4/43
43 models
Lower is better
Lower scores indicate stronger performance.
Showing 11 models around the selected model (out of 43 total).