Heres a rundown based on what we see so far. In the past Baku played a game (unknown if it was like yukii's labyrinth game) and lost, meaning he lost his alibi for a day, got convicted of something he didnt do and served hard labor for a period of time. The murderer of said case was karusuyama...