If I want to drive it to the bottom of the bore, I just have to figure out how to do that. I will look around to see if I have a bearing race that would do as a driver.
Re the bearing retainer: I would think the thickness of the gasket becomes quite critical here. For instance, if I made a gasket and it was too thick, the bearing might be loose.