I don't think using the rifle scope will be an issue. I've been using an old Bushnell 3-9 on my SuperMag for eight or nine years. Never an issue and holds zero just fine.

As another physically...