In this specific premise, it's their fault of gossiping in the open loud enough that people can still hear it with a wall in between. To be frank, kings having lovers on the side, whom are not even promoted to official concubines etc, is nothing strange, maybe because she is a woman that it is different? Idk but seriously that kind of gossip about your rulers pretty much mean death if found out :v