Remember, when he says his master its to refer to his father. His view of the world is also skewed by his father being a sovereign (probably). The old man sweeping may have also been a sovereign and is giving Noh a nostalgia of sorts.
Tbh, and this is something specific to this author, they always deliver where it counts. I really like this chapter even after the rushed melon chapters.