Next time it happens I am going to press the contact from under the hood. I am beginning to think that the starter linkage may be worn to the point where it does not hit the contactor enough to make contact. Its about the only thing I haven't changed.
That's what I think, too. It is a common problem.
Use a long screwdriver as a pry bar and make the contact. If it works that way, it's most likely the linkage.