MMLU 99% #2: Will SOTA for MMLU (average) pass 99% by the start of 2025?
Mini
8
Ṁ447Jan 1
12%
chance
1D
1W
1M
ALL
Get Ṁ1,000 play money
Related questions
Related questions
MMLU 99% #5: Will SOTA for MMLU (average) pass 99% by the start of 2028?
44% chance
MMLU 99% #3: Will SOTA for MMLU (average) pass 99% by the start of 2026?
16% chance
MMLU 99% #4: Will SOTA for MMLU (average) pass 99% by the start of 2027?
12% chance
When will SOTA on MMLU STEM be >= 90%?
BIG-bench accuracy 75% #2: Will SOTA for a single model on BIG-bench pass 75% by the start of 2025?
65% chance
Will a open source pure Mamaba LLM surpass 82 MMLU on MMLU (5-shot) before end of year 2024?
25% chance
Will the transformer architecture be replaced in SOTA LLMs by 2028?
61% chance
By 2026, will it be standard practice to sandbox SOTA LLMs?
29% chance
Will a text model achieve 100% performance on the MMLU in five years?
28% chance
BIG-bench accuracy 75% #4: Will SOTA for a single model on BIG-bench pass 75% by the start of 2027?
86% chance