You should be able to visually determine that the starter is not the problem if the lever in the top of the starter has returned to the proper position.
If you are not familiar with what has been done to this engine by the previous owner, I would stop right now and take off the valve cover, then the oil pan to make sure that someone didn't take something apart and did not tighten it back up.
Carl
