I'm pretty sure that as soon as the starter switch is pushed, the battery voltage will go to zero, or close to it, even if the engine won't turn. Doing a cranking test with the headlights on is another substitute for real test equipment. If the lights dim badly or go out altogether, the battery is discharged or dead. A quick bench test of the starter clamped in a vise with a 12V battery and jumper cables will tell if it's capable of cranking the engine, also.
Jerry