I assume his crime is that he did nothing to stop the abuse of female lead? I mean, him being the young master, he could have easily given her some job like his personal coachmen or maid, etc. which would allow her to be safe at his side. Instead, he left her for extended periods of time due to...