When will humanity's last exam be saturated? (>80%)
➕
Plus
42
Ṁ8060
2030
9%
2025
45%
2026
24%
2027
5%
2028
3%
2029
2%
2030
11%
later / never

Resolves to the year in which an AI first achieves an accuracy of at least 80%.

Text-only models are allowed. o3-mini (high) is currently in the lead with an accuracy of 13.0%

https://lastexam.ai/

#️ Technology
#AI
#Technical AI Timelines
#Math
#AI Benchmarks
Get Ṁ1,000 play money
4 Comments
Sort by:

Huh, I checked a random question in there out of curiosity and the given answer is just wrong.

Related market: https://manifold.markets/Bayesian/what-will-be-the-best-ai-performanc

What does this resolve to if it never gets >80%, e.g. if more than 20% of the questions are broken? I'm guessing "later"

@Nikola fixed ty

Related questions