If it follows the novel, it depends on your definition of what he deserves, if i remember right the mc's brother hates him and never forgives the father and the mc herself it's left somewhat ambiguous, but at the parts of the novel that people have been able to spoil, she goes on a trip at the end of the story without the father and returns at the end, though no mention of forgiveness.
Some say abandonment is worse than death itself, though there's also the possibility that the father is the contractor for the time reversal(it's either him or the brother, never outright said who).
He is at least left in despair, the manhwa seems to be humanizing him more so more likely they will try to give him some redemption, but again in the novel at best it's ambiguous, if his entire family abandons him and leaves him alone, but he doesn't die.