My pilot light was doing strange things too. I had wrapped the column with rubber before installing the switch - I didn't want the worm clamp chewing up the paint. However, the switch is supposed to ground to the column through the clamp. I ran a ground wire with a blade connector on the end up to the switch - slipped the blade connector under the clamp and tightened it up - problem solved.

Try grounding the switch to see if it helps.

Gord 🇨🇦
----
1954 1/2 ton 235 4 speed