Will an open-source LLM beat or match GPT-4 by the end of 2024?
Will an open-source LLM beat or match GPT-4 by the end of 2024?
➕
Plus
36
Ṁ3700
Jan 1
83%
chance

If any open-source model eclipses or achieves GPT-4 quality within a 1% win rate on AlpacaEval using any evaluator (https://tatsu-lab.github.io/alpaca_eval/) by January 1st, 2025, this question resolves to "YES." Otherwise, it resolves to "NO." If GPT-4 is open-sourced by January 1st, 2025, the question resolves to "YES."

#AI
#️ Technology
#Technical AI Timelines
Get Ṁ1,000 play money
6 Comments
36 Holders
65 Trades


Sort by:
5mo

Will the newest definition of open source AI (https://opensource.org/ai/open-source-ai-definition) be used to judge whether a model is, in fact, open source?

5mo

@Primer > I think that has always been the prevailing definition, actually: by any sensible measure, weighths and training data are as much part of an LLM model as its computer code. It was "Open"AI and its ilk that had introduced their twisted explanations on why their semi-closed models should be considered open.

5mo

@Zozo001CoN But some models, including everything from Meta, won't be considered open source under this definition. How will "being open source" be judged for this market?

bought Ṁ500 YES10mo

Should resolve on nemotron, assuming this means original GPT-4

11mo

Does this include 4o?

predicts NO 1y

Which GPT-4?

What is this?

What is Manifold?
Manifold is a social prediction market with real-time odds on wide ranging news such as politics, tech, sports and more!
Participate for free in sweepstakes markets to win sweepcash which can be withdrawn for real money!
Are our predictions accurate?
Yes! Manifold is very well calibrated, with forecasts on average within 4 percentage points of the true probability. Our probabilities are created by users buying and selling shares of a market.
In the 2022 US midterm elections, we outperformed all other prediction market platforms and were in line with FiveThirtyEight’s performance. Many people who don't like trading still use Manifold to get reliable news.
Why should I trade?
Trading contributes to accurate answers of important, real-world questions and helps you stay more accountable as you make predictions.
Trade with S Sweepcash (𝕊) for a chance to win withdrawable cash prizes.
Get started for free! No credit card required.
What are sweepstakes markets?
There are two types of markets on Manifold: play money and sweepstakes.
By default all markets are play money and use mana. These markets allow you to win more mana but do not award any prizes which can be cashed out.
Selected markets will have a sweepstakes toggle. These require sweepcash to participate and allow winners to withdraw any sweepcash won to real money.
As play money and sweepstakes markets are independent of each other, they may have different odds even though they share the same question and comments.
Learn more.

Related questions