The one I have fit just fine. Please be certain you have the oil pump drive engaged. Hate to ask this but you do know the shaft turns as you install it, yes? So the slot and the tab can look like they will align, but by the time that the pump is inserted it will have rotated. The o-ring? I recall a thin rubber washer but not an o-ring. Is this what you mean?
