I can relate with much of what you say, as it kind of verifies my own experience with various sporters;
I'd use an H-S composite VSF/Sendero stock to test accuracy potential. My best 308 groups is also with IMR 4064, and shooting IMR4064 with BR2's. But 3/4" 5-shot groups is with a light 18.5" chrome lined barrel in an AR10. It's comparing apples to oranges with a bolt action.
Yes, doing 5-shot 1/2" groups with my 3 custom barreled 700's requires very intensive handloading that includes weighing bullets, annealing, concentricity measurement, etc. Wind flags, quality cradle, consistant hold, and letting the barrel cool between shots is all essential. 3-shots groups don't mean jack to me. To each his own.
"You didn't say what the rifle will be used for and that would influence my decision / advice."
I enjoy firing 1/2" 5-shot groups at the public 100yard range. But my goal this time is to build it in a lighter "sniper" style rifle. I will add a DM bottom metal to take AIC mags. I want to know it's powerful and capable of long range shots too. I kind of like the 280 cartridge without the belt, which is right below a 7mmMag in power. But I agree with Jackie, JoshB, and others that the 308 is maybe a better bet. (plus I have all the dies for it already)
I am not trying to make you mad but to give you some info to consider. Take it for what you will.
If you consider an occasional 5-shot 1/2" group at 100 yds the goal then you are fine. However police/sniper/sporter style rifles in the calibers you mention are not usually consistent 1/2" 100 yd 5-shot group guns. Years ago I remember arguing with a Sierra tech decades ago who told me the same thing but I didn't want to hear it.
Since then I have had dozens of those rifles, both in factory and custom guns, and nothing about how they are shot that makes them true on demand 1/2 MOA rifles, unless you get lucky. (Granted, you did say you were hoping to get lucky.) I became very frustrated because I would get one .2" group at 100 yds then a bunch of .7s. This was initially with Senderos in 7mm RM and 300 Win. I would make sure the barrel was cold, be steady and consistent, and thought I was being precise about loading.
So then I started building using custom barrels and trued actions carefully bedded in HS Precision and McMillan stocks built by accuracy gunsmiths. These guns didn't really shoot much better than the Senderos, but eventually, having rifles built using CRF M-70 actions, good stocks, and good barrels I was able to get consistent 3/4 MOA (3-shot groups) out of 7.5 - 8.5 (w/scope) hunting rifles. I was able to get long range hunting rifle there, but it had a Palma contour barrel, I bedded it stress free, and it weighed 12 lbs with the scope.
When I started competition shooting I learned how to load and shoot a rifle accurately. Only some of what you mentioned above is what allows consistent small groups. Why is that?
1. A VSF/Sendero stock is not an accuracy stock, it is a compromise stock that works okay in several shooting positions. If you really want to shoot small groups then you need a stock designed for that.
2. Weighing bullets has no effect on accuracy. What's important with bullets is consistency of bearing surface and shape. A base to ogive measurement is excellent for that, I personally measure them in two places for the competition guns.
3. Annealing doesn't really help accuracy, but it does extend brass life and is worth doing.
4. Concentricity might matter a little, but I don't worry about concentricity anymore and I have real sub 1/4 MOA at 200 yd 5-shot groups guns.
5. I don't know what a quality cradle is, but best groups usually come from high quality front and rear rests that are set up to allow the gun to track consistently, allowing the ability to shoot fast enough to keep the 5-shot group in the same micro condition.
6. Consistent gun handling is indeed critical, but it is hard to do that with a VSF/Sendero stock off the bench
7. Wind flags are always a good idea
8. A real target gun groups as well when the barrel is hot as it does when cold. A gun that only shoots 5-shot groups well when it's cold isn't worth much. Now a hunting rifle that shoots one or two to the aimpoint each time from a cold barrel is very useful. But it's pointless to have a rifle that can only shoot 5-shot groups from a cold barrel in perfect conditions.
Given all the above, I'd still recommend a heavy barreled rifle in 6.5 Creed or .308 or better yet, 6mm BR. That rifle will weigh 8-9 lbs without scope or rings and will shoot as well as any non-target rifle will.