Didn't the others get anything done while Xiao Yan was freeing his teacher? I guess as soon as Xiao Yan left, both sides just ceased fighting and relaxed. When Xiao Yan came back, they suddenly resumed the fight, as if they had been fighting all the time.