Rewrite, never answer
The rewrite step must not answer the question. A rewrite that guesses an answer and searches for it retrieves evidence for a wrong claim, which is the failure mode that makes a system agree with itself.
Keep the original too
Search the original question as well as the rewrites. A rewrite that changes meaning is then still answered by the original query, and the merge keeps both in the candidate set.