As long as the U-joint isn't scraping the housing, I wouldn't worry about it. A lot of old pickups were parked because the bushing got so bad that the U-joint scraped the housing and it sounded like the whole thing was going to come apart and the owners were afraid it would be expensive to fix.
