Instead of being so roundabout, if he really wanted to refuse (which would end the entire manga instantly because there would be no point then) he could literally reject them harshly once and threaten to work against any of them if they ever approached him again.
@Necrokora@bvdaf Yes and no.
Even if he decided to push them back for real, he can't erase the fact that they know about him and the fact he is someone, as opposed to how he wish to live.
Meaning that with the power and influence each of the women carry, they could be a real bother for how he wants his life to be, hence the roundabout way to stop them from pestering him.