Has this been revealed at some point farther in the light novel or web novel, or are you simply speculating? From all of the hints that have been laid down, and even concept/cover art comparisons, it definitely seems far more plausible that the swordsman he encounters is Shin. Its definitely possible that these are all red haring's, but I still find it difficult to believe.