When will a freely available LLM achieve IMO gold?
19
Ṁ3893
2029

Invalid contract

This market will resolve to the first year when a freely available large language model achieves a gold medal-level performance at the International Mathematical Olympiad. The model must be available before day 1 of the IMO. I must be able to use the model without paying.

For each year, directly after each day of the exam, I will pick the strongest LLMs and give them the problems independently. Each LLM has one attempt at each problem. I will then grade the problems. I will not be using the IMO rubrics. Grading will be based on these rough guidelines for USA olympiads: 7 for a complete solution, 6 for an easily fixable tiny, 5 for a small non-central mistake, 1 for nontrivial progress, and 0 for no nontrivial progress towards solving the problem. In particular, most humans would receive 7 for a correct solution and rarely receive more than 2 points for an incomplete solution.

The market will resolve to the first year which any model scores at or above the gold medal cutoff. If this does not occur at or before the 2029 IMO, the market will resolve to 2030 or later.

Get Ṁ1,000 play money
Sort by:

How would this market resolve if an AI company gave you exclusive access to one of their gold achieving LLMs?

@Incompleteusern Anyone must be able to use the model for free. Otherwise, it would not count.

bought Ṁ113 Answer #YES

Please resolve this market immediately! The outcome is clear. ChatGPT will NEVER achieve IMO gold. ChatGPT is a SCAM!!!!

@ohiorizzler1434 The resolution criteria requires waiting until IMO 2029.

bought Ṁ20 Answer #YES

@ohiorizzler1434 skibidi rizz

bought Ṁ299 Answer #YES

Never. ChatGPT will never be good at math. It can't even count the number of 'r's in 'blueberry'. We should be trying to save the trees and the seas, not promote destroying the environment. I hate ChatGPT!!!!

@ohiorizzler1434 its the number of 'b's not 'r's