Will the next LLM released by OpenAI be worse than GPT-4 at MMLU? | Manifold

Will the next LLM released by OpenAI be worse than GPT-4 at MMLU?

Plus

23

Ṁ1163

Jan 1

16%

chance

1D

1W

1M

ALL

The next LLM = the next family of LLM in cases of doubt - an updated version of a previous model doesn't count as a new model for this market

This question is managed and resolved by Manifold.

#New Year's Resolutions 2024

#— LLM & AI Capabilities—

Get

1,000

and

3.00

Sort by:

bought Ṁ250 NO

No https://openai.com/index/learning-to-reason-with-llms/

@Manifold please resolve

How big a bump up counts as the next one @firstuserhere? 4.5? 5? A new variant of 4?

Afaik OpenAI has not made a model worse than their previous model before. (gpt-3.5-turbo & text-davinci-003 perform about the same overall so i'm not counting that) and I'm pretty sure ada/babbage/curie/davinci were all released at the same time, and the best of those, davinci, was better than early gpt-3, so that wouldn't count either

Related questions

Will OpenAI's next major LLM (after GPT-4) solve more than 2 of the first 5 new Project Euler problems?

+32% 1d45% chance

Will there be a OpenAI LLM known as GPT-4.5? by 2033

Will there be an open source LLM as good as GPT4 by June 2024?

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Will a 15 billion parameter LLM match or outperform GPT4 in 2024?

Will any open source LLM with <20 billion parameters outperform GPT-4 on most language benchmarks by the end of 2024?

-6% 1d9% chance

Will there be an open source LLM as good as GPT4 by the end of 2024?

When will OpenAI release a more capable LLM?

Will OpenAI have the best LLM in 2024?

Will xAI develop a more capable LLM than GPT-5 by 2026

Related questions

Will OpenAI's next major LLM (after GPT-4) solve more than 2 of the first 5 new Project Euler problems?

Will any open source LLM with <20 billion parameters outperform GPT-4 on most language benchmarks by the end of 2024?

Will there be a OpenAI LLM known as GPT-4.5? by 2033

Will there be an open source LLM as good as GPT4 by the end of 2024?

Will there be an open source LLM as good as GPT4 by June 2024?

When will OpenAI release a more capable LLM?

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Will OpenAI have the best LLM in 2024?

Will a 15 billion parameter LLM match or outperform GPT4 in 2024?

Will xAI develop a more capable LLM than GPT-5 by 2026

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules