actually its the opposite bel, ever since the abandoned mine gamble numbers have meaning now. Those who are closer to 0 are assumed to be more powerful. Only those who have had 0 as their exclusive referee can now surpass the leader
Heres a rundown based on what we see so far. In the past Baku played a game (unknown if it was like yukii's labyrinth game) and lost, meaning he lost his alibi for a day, got convicted of something he didnt do and served hard labor for a period of time. The murderer of said case was karusuyama...