I kinda see both points, while I did thought it was kinda annoying how he freaked out, it's also pretty expectable and realistic from an ex-salary man who was thrown into a world with vicious monsters.
But he spent how many weeks (months?) already and still freaks out this much? give us a break, or better yet, chara development
Tldr; spineless mc, still here for the food