I dunno man I have a tiny little bit of a hunch that maybe who knows having the looming threat of a rape accusation followed by prison, might make a guy a stay little bit on edge. Also basically being blackmailed into hanging around that same girl, doesn't really scream 'I'love you'.
Might be...
Man I liked this manga, but the author just had to pull a "somebody I don't want you to like is a cartoon" and worse yet the guy is all like "but I didn't do anything wrong tho". At this point I just wanna give up on this one.