Once a model achieves superhuman performance on a competitive programming benchmark, will it be less than 5 years before there are "entry level" AI programmers in industry use?
Plus
11
Ṁ4372050
92%
chance
1D
1W
1M
ALL
"Entry level" is deliberately fuzzy: in 2022 terms this would look like an AI (or AIs) that is assigned an issue, checks out code, makes edits, and submits a PR (that is accepted).
Rough criteria: the AI acts with little oversight, performs similar (coding) work to entry-level coders at the time, the issue/task assignment is not *significantly* specialized for an AI (e.g. no full technical specs if the same wouldn't be given to a human coder)
AI being used in this way in significant open source projects counts as "industry use".
If there are technical demos of such AIs but none of them are actually being used question resolves as no.
No requirement that it be a single model. A group of specialized models working together counts.
If superhuman performance is not achieved by market end, resolves N/A.
This question is managed and resolved by Manifold.
Get
1,000
and3.00
Sort by:
Related questions
Related questions
Will an AI achieve >85% performance on the FrontierMath benchmark before 2028?
61% chance
Benchmark Gap #3: Once a model achieves superhuman performance on a competitive programming benchmark, will it be less than 2 years before there are "entry level" AI programmers in industry use?
73% chance
Will an AI win a gold medal on the IOI (competitive programming contest) before 2025?
3% chance
Will there be entry-level AI coders by 2026?
61% chance
When will an AI model be better than me at competitive programming?
Will AI outcompete best humans in competitive programming before the end of 2024?
10% chance
Will models be able to do the work of an AI researcher/engineer before 2027?
40% chance
Will AI beat the best humans in competitive programming before the end of 2024?
7% chance
AI for AI 1: By when will there be an AI that can do "intern-level" ML engineering?
Will an AI achieve >85% performance on the FrontierMath benchmark before 2027?
31% chance