I suspect that you have a defective starter drive. We used to change them routinely, instead of swapping the whole starter, but we also did a lot of in-house starter rebuilding. Did you source the rebuilt unit from a local supplier, or one online? If it's not too big a hassle, you might want to return the starter and try another one. If not, places like Rock Auto still have replacement drive units available, I believe. Good luck!
Jerry