the center hold on your wheels is what centers them on the axle. If it is not centered, or not round, you will fight wheel hop and maybe cause some other stresses on components. I am sure there are people that have done it with a die grinder or something, but I would find a shop to bore them out on a mill.