That divot appears to have been made while installing the wheel bearing. I can't imagine any reason you couldn't use a high speed drill motor or a Dremel tool and a small grinding wheel to smooth it out. I've also had some success with getting a seal to start in the bore by grinding a slight chamfer onto the leading edge of the seal. It won't cause any leakage because there's plenty more straight area to make a leakproof fit on the outside as the seal slides into place.
Jerry

"It is better to be silent and be thought a fool than to speak and eliminate all doubt!" - Abraham Lincoln
Cringe and wail in fear, Eloi- - - - -we Morlocks are on the hunt!
There is nothing noble in being superior to your fellow man; true nobility is being superior to your former self. - Ernest Hemingway
Love your enemies and drive 'em nuts!