only way that can be an issue if you ask me, would be if you have very very low deer numbers
reason being if you have very few doe on your lands, and you kill one, that is one less to attract bucks later on
as in if you don't have any doe, the bucks might leave your lands looking for them later on
but its rare to have that problem
having fewer doe, can bring /make more bucks look harder to find one on your lands, making it maybe more likely to catch one in day time looking for love later on
I say if a good shot presents itself, and you want to fill a tag or freezer, go for it, no harm will be!