At this point in the story, the Duke doesn't understand his feelings because the emotion of love has never been modeled for him. He won't have the epiphany connecting the dots for him until he gets his mother's diary.
Also, Chloe is not his sister. They have met his sister already, but they don't realize who she is yet.