Gpt-5 >=91% on MMLU?
41
Ṁ2615
Dec 31
88%
chance

#GPT-5 Speculation
Get Ṁ1,000 play money
8 Comments
Sort by:

This tells us that MMLU is too easy. Someone make a Ph.D. version of it

@Sss19971997 it already exists: https://arxiv.org/abs/2311.12022

predicts YES

Market's closing in a month with no sign of Gpt-5. @firstuserhere can you extend?

bunch of mmlu questions

gemini gets 90% on MMLU, so...

@TheBayesian wait what? share the link? i've not yet looked at it

GPT-4 can probably beat 91% with proper prompt engineering.

I have heard someone already did it using a combination of GPT-4 and some other model

Related questions