I think you will be fine, deer get spooked all the time for unknown reasons, its why there always on edge
they might be more alert coming in to your set up for a few times, buts to me odds are they...