Every other faction in the world hates the Soul Clan, so why is the Soul Clan still around and thriving? It's the biggest weakness of this arc that the ghoul was allowed to do as he pleases. We got some bullshit about not being able to do anything about it due to the contest rules, but if every single other contestant hadn't given a shit about the ghoul getting eliminated by the organisers directly, what would have it mattered? There's no honour lost in not allowing your sworn enemy to participate in your contests. It's not a Pill Tower, it's a Fool Tower.