I was just about to say I was going to give up on this since the plot seems to have forgotten the brother and the other world.
I didn't think I'd be getting frustrated reading a reverse-isekai like this, but I am sick of the slice of life farm manga this book obviously wants to be.