Nope - not normal!

Sounds like you may have a broken or missing snap ring on the drive housing end of the armature shaft (see the 2 pics below snapped from a 1954 Shop Manual which would be same as your 1955 1st Series starter).
I believe that snap ring is meant to keep the shaft from excessive end-to-end movement when the starter is all assembled.
Helpful???

Dan