.17 Hornet for groundhogs? Nah...been there, done that. Sounds like I’m in the same area as the OP, and once thought that round would be perfect for the same reasons. Now IME, for ‘hog hunting small farms near development and people (including my own which backs up to a now-busy rail trail), the only centerfire rifle to consider would be a good ol’ .22 Hornet.
I drank the .17 HH kool-aid when it first came out; not only had trouble putting down our big Eastern ‘chucks it blew around in the wind, and to my (protected) ears had a sharper, more annoying report than a .22 Hornet. Basically a .17FB or .17 Rem. wannabe without the “kill-ability” or wind-beating speed; might be good for rat-sized colony varmints on a still day. Unloaded mine for a nice CZ .22H and never looked back.
Actually, for safe close-in shooting you want a round with a trajectory that is fairly flat for a while then drops like a stone - which the .22 Hornet does, especially with the 45 grain Speer pointed soft points I use (good coyote bullet, also). Put a 100 yard zero on it, don’t try to shoot anything over 150 yards away, aim in a safe direction with a backstop and you’ll be okay.