I can't say I'm an expert either, but I'm with K22. My favorite, most accurate, best looking and highest quality varmint rifle is a Remington model 700 VSSF II in .223. Stainless action, fluted barrel with the flutes painted black, and a very nice factory H.S. Precsion alumimum bedded stock. With a tuned load of 55 grain Sierra Blitzkings, Lapua brass and 26 grains of Varget it will consistently shoot 1/2 MOA or better. It shoots this good even with the extra heavy X-mark trigger I have not replaced yet. Have to wonder how good it would shoot with a really good trigger.
I own a Savage LRPV in .223, and while accurate it isn't as accurate as my Remington. Plus it is so barrel heavy it is not a good field gun. I own a Wby Vanguard sub MOA .223 and it is my second favorite varmint rifle even though it isn't as accurate as either the Remington or Savage. Other varmint rifles I've tried include a Wby Vanguard sporter in .22-250 and a Sako .222. Both were nice rifles but for various reasons I sold or gave away to a relative.
If I was looking for a varmint rifle today, which I kind of am, I would consider a Cooper .20 VarTarg. Not exactly an off the shelf rifle, but close enough.