Will GPT-5 be able to solve simple substitution ciphers?

Basic

Ṁ368

Mar 7

35%

chance

ALL

GPT-4 can't do this at all.

The ciphers will be between 15-20 characters, GPT-5 must solve 5/10 of the tests to resolve YES.

This question is managed and resolved by Manifold.

Get

1,000

and

3.00

Sort by:

sold Ṁ27 YES

Tried this with o1 and it thought for about 3 minutes then crashed:

SIAA ZQ LKBA. VA ZOA RFPBLUAOAR!

It can do it if you give it a big hint though:

Am very curious to see if o3 can do this

Does the model get to use CoT or other scaffolding? Does it have access to the python interpreter like current chatgpt4?

@singer i'll use whatever simple chat window OpenAI gives to end consumers to test this

@SemioticRivalry Can you give some examples of the ciphers that you'll try?

@singer Reasonably common phrases

"always be closing"

"strive for greatness"

etc

@SemioticRivalry It can solve Caesar ciphers pretty easily if you let it run python code. Is your substitution alphabet randomized?

Related questions