Will there be another benchmark/test after "Humanity's Last Exam"?
Plus
15
Ṁ22922027
89%
chance
1D
1W
1M
ALL
SafeAI is developing a benchmark that "aims to be the world’s most difficult AI test" For a question to qualify, all current models must fail at it. Is this truly "Humanity's Last Exam," or will there be another one after this?
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Related questions
Related questions
Will the first AI model that saturates Humanity's Last Exam be employable as a software engineer?
28% chance
Will OpenAI's o4 get above 50% on humanity's last exam?
27% chance
Humanity's Last Exam score in 2025?
-
What will be o3's score on Humanity's Last Exam?
What will be the best AI performance on Humanity's Last Exam by December 31st 2025?
Will there be an LLM which scores above what a human can do in 2 hours on METR's eval suite before 2026?
82% chance
When will humanity's last exam be saturated? (>80%)
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2027?
39% chance
Will Al achieve 85% or higher on the Humanity's Last Exam benchmark before 2027?
76% chance
Will Al achieve 95% or higher on the Humanity's Last Exam benchmark before 2028?
40% chance