With the drag link removed is it very smooth turning the steering wheel lock to lock? Does the shaft the pitman arm is connected to move up and down slightly when the wheel is moved side to side? You may be fine with just adjustments and new lube. On the other hand, if all else is good inside new bearings and a new seal are pretty cheap insurance and the rebuild without replacing the balls is easy.