It has to be in a certain position, which is different on different switches. There's a little button with spring tension behind the hole. If you don't feel it in one position, try another.
In the case of Dbone's '51, if I remember right, it only has off and on. It has to be turned on to remove the cylinder.