Will GPT-5 perform better than o1 (not preview) at AIME 2024, Codeforces elo, GPQA, or the 2024 ioi?
Basic
13
Ṁ607resolved Aug 7
Resolved
YES1D
1W
1M
ALL
o1's scores are the ones mentioned here. https://openai.com/index/learning-to-reason-with-llms/
Resolves yes if OpenAI or a third party tester is able to get GPT-5 to achieve higher scores on any of these benchmarks without any kind of prompt engineering or agent scaffolding
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
I had a previous question that asked whether I would judge GPT-5 smarter than 01 that is sitting at 85% yes.
Personally I am unsure why people think this since it is heavily implied GPT-5 won't utilize the scaled test-time compute paradigm which was so key to o1's success. I would bet that GPT-5 will be unable to do this and that the goal is more so achieving near o1 performance more quickly and economically
Related questions
Related questions
Will GPT-5 score Bronze or better on IMO 2025?
9% chance
Will GPT-5 reach a 1000 rating on Codeforces?
99% chance
Will GPT-5 exceed 70% on WebArena?
76% chance
Will GPT-5 ace exams?
77% chance
Will GPT-5 be able to get gold on the International Mathematical Olympiad?
10% chance
Will GPT-5 be more competent than me in my area of expertise?
31% chance
Will I be impressed by GPT-5?
17% chance
Will GPT-5 qualify for the USAMO?
93% chance
Will GPT-5 score higher than 1350 on the Lmsys Arena Leaderboard
99% chance
Will GPT-5 be capable of achieving superhuman performance in at least one exam that is typically taken by humans?
91% chance