if you didn't feel it in the steering wheel, it's unlikely to do with the tie rod - did you spin the drum when you had the wheel off? or better, take the drum off and look at the bearings and brakes? and you might also check the spring shackles for wear that lets them shift side to side
Bill