Will any model pass an "undergrad proofs exam" Turing test by 2027?
Plus
20
Ṁ8712027
77%
chance
1D
1W
1M
ALL
The model receives each question as text (or text + images), outputs an answer as text + images, and is graded as part of a pool with human students who also took the test.
"Pass" means >=70%
Has to be a proofs-based exam, e.g. abstract algebra, topology, linear algebra if it's proofs heavy.
There are probably undergrad math exams *somewhere* that are very easy, so I will be exercising my judgment on whether the exam "counts". Unfortunately I do not have examples to hand of what I consider reasonable, but something like "would be a medium difficulty 200-level proofs exam at a top-tier university".
This question is managed and resolved by Manifold.
Get
1,000and
3.00
1,0003.00Sort by:
Ultra-likely.
Topology was almost trivial, especially comparable to IMO questions. I recall “prove at least 3 of 12 theorems” being the final exam, pretty sure an AI could blow past that even today.
The handwriting and telling the AI not to be too giga-brained (make a few mistakes and don’t solve them all) would be harder than the solving.
Related questions
Related questions
Before 2030, will an AI complete the Turing Test in the Kurzweil/Kapor Longbet?
61% chance
Will a smart agent pass our Turing test by the end of 2025?
59% chance
Will the Twitter Turing Test be passed by 2028?
62% chance
Will AI pass Video Turing Test by 2030?
69% chance
Will the Twitter Turing Test be passed by 2030?
87% chance
Will the Twitter Turing Test be passed by 2025?
68% chance
In what year will there be an AI capable of passing a high-quality Turing test?
Will a robot capable of passing both the Coffee Test and a strong, adversarial Turing test be created before 2100?
94% chance
Will AI pass the Longbets version of the Turing test by the end of 2029?
64% chance
Will AI pass the Bob Ross Turing Test by 2035?
74% chance