Well scents do go bad, but at the same time, its as possible as anything, he smelled you too
spray down or not, human scent can happen, and spook a deer thermals heat temp changes can send scent...