Just a wild shot here.... does it have an alternator now? And this may be way out in left field.
But if it now has an alternator perhaps it is wired in such a way that it is providing power to the S terminal of the starter once the engine starts.
Otherwise I would lean towards the starter solenoid itself sticking. I have had that happen on a couple of occasions and replaced the starter solenoid to fix the problem.
