...No yeah, I'm with the MC here.
The girls are, firstly, acting like bitches towards him for not knowing something he has no reason to know and they kept talking around without explaining when he asked.
And secondly, even if he can win, he just doesn't wanna go around crushing, blackmailing, or killing people. He just wants a peaceful life, though he could probably do to say that to these two idiots with no common sense.
In general, he should snap back at them more because the power dynamic is only as it is because he allows it.