Well, this is a fun take on the isekai genre.  I wouldn't mind them spending time in both worlds, there's plenty more material you can write with.  Elf waifu supporting husband in Tokyo slice-of-life meets adventurer epic  in a fantasy world.  Best of both worlds.  Literally.