Yes, closing the tank valve is a good idea.

It is just stuck. Give it a tap sideways with a block of wood or a plastic hammer