Other things to check but questions only you can answer:
You indicated you're certain you're not flinching. So we'll leave that one behind. But are you lining up squarely behind the rifle with each shot?
Could you be canting the rifle?
Are you using a commercial rest, sand bags, bipod, or other support?
If using a bipod, are you preloading it before each shot?
If using a bipod, is it of good quality?
How do you hold the rifle? Tightly against the shoulder with a tight (perhaps too tight) grip. Is it possible you could be holding the rifle too tightly and placing torque on the grip?
Is your point of aim consistent and are you letting the rifle settle down on the target or "muscling" it into position on the target?
Is your scope holding "zero"?
Is your scope of good quality and properly mounted?
Obviously, there's no reason for you to respond to those questions. It's just a list of ideas that came to mind when I read your post and I thought you might want to consider those in finding a solution to your mystery.
Best of luck .....
