I went ahead and put the shim between the wheel bearing and the seal. It will locate the end of the shaft at the same location at the block as it would if I put the shim inboard of the bearing. When the next guy uses a slide hammer to remove the bearing, he will be hammer against the bearing and not a shim. Of course I will be dead by the time that needs to be done hopefully.