try to keep a constant speed on the troller. Most fish don't mind constant vibration but changing speeds or stomping feet arrows on metal the definitely get the hint and try to get out of the way. Open water like mud flats fish tend to be more spooky compared to weed beds, rock beds, or fallen timber. Some water bodies have fish that spook very easily, some water bodies fish almost never spook and then water bodies it just depends on thr night.
so recap, constant speed, can try slower or faster as garp mentioned, look for some kind of structure and if all else fails take longer shots and shoot quicker.
Any more I tend to have more fun shooting spookier fish as they are running away. Might not put as many fish in thr boat but teaches you to snap shoot at moving targets making the fish laying in front of the boat feel like gimme shots