If correcting a non-centered-non-circular Hole, using a drill Press...

Sharpen the over size Drill bit to be a 'Brad Point' type, with peripheral "Ears".

That way it will not be trying to self-center into whatever it feels is the center of the improper pre-existing hole.