It doesn't matter which way you turn it to get it out. It is just a simple tongue and groove type deal. Nothing else to watch for.
When you get it out pull the cover off and file the contacts. Clean it with carb spray. Put it back together and try it.
Tips: The terminal screws must be removed to remove the cover. There is a drain hole in the cover. The solenoid can be installed with it up or down. Make sure you install it down.