You could easily smell cologne on bed sheets guys. especially if you are frequently smelling the guy. Also he has already overstepped any boundaries a teacher shouldn't go over, no reason to stop now while trying to help traumatized girls. I could see him getting arrested at the end of the manga though (like a 30% chance). At the end of the day he is a good person but I don't believe he has/could forgive himself.