So you don't get confused this picture shows a separate ball seat. That ball seat is only used with the hydra-matic & powerglide trans.
The manual trans. ball seat is machined right into the manual trans. tail housing.

Back to the task.
What I meant to say does the ball housing fit snugly or slide tight onto the torque tube?
Years of down pressure on the ball housing from the torque tube, when putting on the brakes tends to loosen the ball housing on the torque tube. Picture
Most of the time the ball housing is ok.

Sounds like your leak problem was a worn out ball collar cork oil seal and a torque tube retainer cap rubber oil seal. Picture
Do you have two O-ring washers in the retainer cap?

It is important to adjust the ball housing correctly before installing the ball collar cork oil seal.
Read under: Universal Joint Ball Adjustment
Page 1
Page 2

Put Graphite grease on the ball collar cork oil seal. read HERE