That's one of the dangers of being outnumbered. They can fight more leisurely and drain your energy, because they have friends to back them up and give them breathing room. A bunch of enemies who refuse to commit to a proper attack are a nightmare, because it basically forces you to go on the offensive yourself, which leaves you open to the rest of the group.