I'm having the same issue (6v system and battery) ... turns out the starter needs a rebuild.

Once you clean everything up, consider running the proper battery. Mine came with an 8v and ran better when I went back to a 6v.

1951 Chevy 3100
In the Stovebolt Gallery
www.rustyfiftyone.com