I found that rotating it gently counter clockwise against the stop, while pulling gently, did the trick for me. I practiced this on a couple of spare units and it worked every time. However, a lot of old needles are very brittle and they will break off in your hand. That is why they sell them along with the decals.