That doesn't make any sense.
It doesn't explain why the other woman suddenly feel better with just her being around.
If he could see generic woman he meet for the first time who looks like a woman and act like a woman, not as a woman. Surely after so many years there are dozens of other woman he won't see as woman which in turn should also be immune.
Even putting "it's magic" is more logically acceptable instead of this sudden reveal.