"...spring loaded button is on the same side as all the connections..."
not - the button is a little mushroom top pin-like thing that's on the top of the switch w/ a tiny spring around it, while the wires are on bottom where ya can see'em if ya poke yer head under there - about center of switch body, and hurts the fingertip to push it hard - knob rod has a flat on one side that may have to line up, so try turning, and push pin w/ knob in off position, then yank knob out - sometimes a bit of corrosion or something - if yours is different it's non-original - no advice available here!!
Bill