Yeah it's hard to say one way or the other. The buck that likely spotted or at least heard you will be the one who will be more wary in that spot. If he saw you then you can expect his eyes to be searching that tree the next few times he goes by. The more days that go past where he doesn't see or hear something odd the more likely he will slowly begin to forget. The other buck, who knows, he likely didn't have a clue what happened other than the other deer spooked from something. A couple days and give it a try again. Like mrbb said though, take extra precautions this time.