For them to rummaging the houses from earlier chapters, not taking the batteries now just seem awfully absurd. Not to mention they're living a post apocalyptic era, they should just take whatever useful things they could get.
Though if I have to guess, I think the reason was the batteries kinda like offering for the deceased lady. Still weird thing to do tho, the dead doesn't need it anymore.