@Siikalahna is no that easy, at least put you in his shoes, if you sense that horrible strength, a force that you don't know if you are capable of take down you will go and face it? plus that guy can conseal so well so you probably will be fucked up in no time if you go because you can sense him...
I think now the authors have a thing to select the heroine who didn't have the most romantic time with the MC (in this case Yotsuba had WAY less interactions with MC than the other sisters) but well, looks like its not ending soon, probably he visit all the room after this and he select someone...