Ran a box test on the scope, seems to be working fine.
Can a barrel zero well at 100 but yet give these kinds of results at greater range?
It may not be the barrel giving the results, it may be the shooter getting the results.
What are you doing differently between the two distances ? Same bench, same bipod / rest ?
If you get a four inch wind drift at 500 yards on the day, it would look like it's all over the place with a 8 inch movement between wind shifts. Ask your ballistic calculator how much wind it takes to move your bullet 4 inches at 500 yards, it's probably single digit mph .
If there was a problem, it would show at 100.