Yes. That is the problem. I noticed that too, in my scenario. My solution was to make a player that had the guys that didn't move, and then another player that had the guys that were controled by triggers. Also, if its just a town and you don't want the guards to move ever (or attack anything) just use a looping trigger that tasks them to the place u want them to stand.
'If theres anything more important than my ego around, I want it caught and shot now.'