I would borrow a friends 6V starter and see if that works a little better. I'm thinking that if it spins OK with the plugs out, that your bottom end is OK.
You could try spining it over (hot) by hand with the plugs out and see what kind of resistance you get.
If your connections and battery are all good, then I would bet on the starter.
Kurt