For anyone who is following this, I had the washers reamed out to 0.001" over and everything fits nicely now. Hopefully this was the way to go but I think for the short tow to the new house it will be OK. If anyone had experience, I would love to hear what the proper way to do this is.