There is nothing that indicate that the charm is the thing that make him have a conscience. Even the time after the charm is dispelled and before he is charmed again by the FL, he can sympathize with the plight of the victim of mystic garden that he meet in hospital, and recognize the ideal of the old man that help his father in researching gold body that martial art is not only a tool for violence. He bring out aggressive/violent behavior only for the female lead that he is the victim of love charm of for years, i think that can be considered normal.