If you do decide to take the pilot bushing out, the easiest way I've found is to use a 5/8" coarse thread tap. Find an 8-point socket (3/8?) and run it in. It will take less than a minute to get it out. I've seen guys pack the cavity full of bearing grease and a rod or bolt to beat the snot out of it to remove one, but the tap works easy and quickly every time.
Thanks for the information, I have three on the tree and will be doing all this while on my back.