The light grinding that I had to do in order to expose the shaft of the ball stud makes perfect sense. While I tried to avoid grinding the actual arm, I can imagine that it does not take a whole lot to change where that castle nut should sit. I should have thought of that while installing the tie rod ends. I will be grabbing a couple of proper washers today. As always, problem solved thanks to the help I received here!