somebody mentioned the pilot bushing, back up there. I once had a similar vibration problem, in a big block firebird. Neglible vibration until I put a load on it. After a lot of searching, it turned out to be that pilot bushing. Worth a check.....02c.
