http://chevy.oldcarmanualproject.com/1929_57chevyparts/57cmpc0400.htmIf the gear inside is missing then it would definitely leak.
After removing the retainer, the gear holder can be removed (pulled out) but my memory is that the oil ring makes it a tight fit.
I don't recall an internal seal from gear shaft to holder ID but the shaft has a spiral groove.
The parts shown in the picture are examples only. Look up the parts you need.