As long as the metal band is tight enough to stay on, I don't think the tape is needed. Mine has just the band around it.
The button on the starter doesn't look that bad to me. Just polish it up a bit. A new switch would probably help it work correctly. Some have put a soda bottle cap over the button to compensate for a worn switch. The extra thickness makes for more solid contact.
