
Which Benchmarks will OpenAI show results from GPT-5 on, when it is announced?
Plus
15
Ṁ33022026
1D
1W
1M
ALL
90%
GPQA
87%
SWE-Bench
82%
SimpleQA
67%
ARC-AGI-2
58%
HumanEval
48%
MMLU
38%
MATH
35%
Big-Bench-Hard
31%
MGSM
19%
DROP
8%
GSM8K
Some flexibility on variations of specific benchmarks. eg SWE-Bench-Hard would resolve SWE-Bench YES.
Update 2025-05-11 (PST) (AI summary of creator comment): The benchmarks must be those that GPT-5 is benchmarked against by OpenAI.
Must be on roughly the same day / during / around the time of the announcement. If there are several announcements over multiple days, all those times are acceptable for the purpose of this market.
Get Ṁ1,000 play money
Sort by:
@bbb Idk if i was actually able to change the settings back then but since then ive learned how to do it, so added arc agi 2
Related questions
Related questions
Will GPT-5 be released before Sep 2025?
90% chance
When will GPT 5 be released? (exact month)
When will GPT5 be announced?
When will GPT 5 be released
Will GPT-5 be released before Nov 2025?
96% chance
Will GPT-5 be released before Oct 2025?
97% chance
Will GPT-5 be released before Jan 2026?
96% chance
Will GPT-5 be released before Dec 2025?
96% chance
When will GPT-6 be first released?
When will GPT-5 be released? (2025)
82% chance