Will Scale AI Evaluate Gemini-1.5-Pro-Exp-0801 by October 1, 2024
Mini
3
Ṁ40Oct 1
66%
chance
1D
1W
1M
ALL
Context:
Gemini-1.5-Pro-Exp-0801 is currently the leading model on the LMYS Arena leaderboard (https://arena.lmsys.org/).
This market is about whether Scale AI will evaluate this model on their leaderboard (https://scale.com/leaderboard).
Resolution Criteria:
The market resolves as "Yes" if Scale AI evaluates Gemini-1.5-Pro-Exp-0801 and adds it to their leaderboard before October 1, 2024.
The market resolves as "No" if Scale AI does not evaluate Gemini-1.5-Pro-Exp-0801 or add it to their leaderboard before October 1, 2024.
Get Ṁ1,000 play money
Related questions
Related questions
Will Gemini-1.5-Pro-Exp-0801 Score Above 1165 in Scale AI's Math Evaluation
48% chance
Will Gemini-1.5-Pro-Exp-0801 Score Above 1165 in Scale AI's Coding Evaluation
28% chance
Will Gemini-1.5-Pro-Exp-0801 Score Above 90.35 (current #1) in Scale AI's Instruction Following Evaluation
53% chance
Will Google release a new Gemini model before March 2025?
92% chance
Will Gemini-1.5-Pro-Exp-0801 Score Lower Than 8 (current best) in Scale AI's
Adversarial Robustness
56% chance
Will Gemini 2 ship before GPT-5?
74% chance
Will something named Gemini 1.5 Ultra be announced before the end of 2024?
18% chance
Will Gemini Ultra outperform GPT-4V on visual reasoning by the end of 2024?
65% chance
What will be true of Gemini 2?
Will Gemini exceed the performance of GPT-4 on the 2022 AMC 10 and AMC 12 exams?
72% chance