There are some survivors that will attack you. They're the ones wearing orange prison jumpsuits and you get a bounty for killing them. That's not a bug, that's part of the game.
I use a fire tower near the entrance to deal with Ninjas. It makes them use their invisibility early, and as soon as one goes invisible it will switch to the next one, without having to wait for the reload time the other towers have.