It's probably your starter switch. I'd get a new one (about $10) and replace it. Make sure everything is tight and don't forget to use a little silicone lube on the shaft of the new switch. My new one had a tendency to stick closed (not good). Works great after a lube job.
Good Luck
George