an LLM as capable as GPT-4 runs on one 3090 by March 2025 | Manifold

an LLM as capable as GPT-4 runs on one 3090 by March 2025

Plus

26

Ṁ1720

Mar 2

33%

chance

1D

1W

1M

ALL

e.g. Winograde >= 87.5%

This question is managed and resolved by Manifold.

Get

1,000

and

3.00

Sort by:

I imagine the weights need to fit in VRAM; does that sound right? Or can the solution involve moving weights on/off the GPU

@NoaNabeshima weights have to fit in vram

@sylv ram and not necessarily vram?

*vram sorry

predictedYES

new market for 4090: https://manifold.markets/sylv/an-llm-as-capable-as-gpt4-runs-on-o-8da33ccbe4b1

bought Ṁ80 NO

@sylv The difference between the 3090 market and the 4090 market is because.. the 4090 supports fp8??

@NoaNabeshima I mean it has better specs in general but fp8 is pretty cool

@NoaNabeshima Oh it's different dates

Related questions

an LLM as capable as GPT-4 runs on one 4090 by March 2025

Will it be possible to run an LLM of GPT-4 (or higher) capability on a portable device by 2027?

Will there be an LLM (as good as GPT-4) that was trained with 1/100th the energy consumed to train GPT-4, by 2026?

Which next-gen frontier LLMs will be released before GPT-5? (2025)

Will any open source LLM with <20 billion parameters outperform GPT-4 on most language benchmarks by the end of 2024?

China will make a LLM approximately as good or better than GPT4 before 2025

Will there be an open source LLM as good as GPT4 by June 2024?

Will xAI develop a more capable LLM than GPT-5 by 2026

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Will an open-source fully functional Auto-GPT like LLM exist by the end of 2025?

Related questions

an LLM as capable as GPT-4 runs on one 4090 by March 2025

China will make a LLM approximately as good or better than GPT4 before 2025

Will it be possible to run an LLM of GPT-4 (or higher) capability on a portable device by 2027?

Will there be an open source LLM as good as GPT4 by June 2024?

Will there be an LLM (as good as GPT-4) that was trained with 1/100th the energy consumed to train GPT-4, by 2026?

Will xAI develop a more capable LLM than GPT-5 by 2026

Which next-gen frontier LLMs will be released before GPT-5? (2025)

Will an open-source LLM beat or match GPT-4 by the end of 2024?

Will any open source LLM with <20 billion parameters outperform GPT-4 on most language benchmarks by the end of 2024?

Will an open-source fully functional Auto-GPT like LLM exist by the end of 2025?

© Manifold Markets, Inc.•Terms + Mana-only Terms•Privacy•Rules