GPT 4o Mini (2024-07-18)
OpenAI
Highlights
Top benchmark results for openai/gpt-4o-mini-2024-07-18.
37.21#42
4.60#17
0.40#72
1312#36
0.10#36
0.11#34
0.09#21
2.30#24
Benchmark table
Detailed scores across tracked benchmarks.
| Benchmark | Category | Top Score | Info | Self Reported | Source |
|---|---|---|---|---|---|
| Confabulations | - | 37.21 | - | No | Source |
| Elimation Game | - | 4.60 | - | No | Source |
| GPQA Diamond | general-knowledge | 0.40 | - | Yes | Source |
| LMArena Text | - | 1312 | - | No | Source |
| NYT Connections | - | 0.10 | - | No | Source |
| SimpleBench | - | 0.11 | - | No | Source |
| SWE-Bench | code | 0.09 | - | Yes | Source |
| Thematic Generalisation | - | 2.30 | - | No | Source |
Benchmark comparisons
Use the selector to switch benchmarks and see how this model stacks up against its closest competitors.
SWE-Bench
Compare this model with the leading peers for the selected benchmark.
Benchmark
0.09
Rank #21/21
21 models
Showing 11 models around the selected model (out of 21 total).