I don't see the point in restricting his movements. He lived just fine on his own in the middle of the forest before he met the girls. He can live on his own in the middle of the forest again. He doesn't need them for anything. He can just go off on his own and live well, as he did before the girls barged in on his peaceful life.