Since the original post, I did notice that the spider pin had the slightest amount of movement in and out. I went back out and tried to drill the remaining part of the pin with a small new bit. I did get a slight amount of a hole started off-center of course. But with any pressure when drilling I did notice the bit started to go around in a small circle, meaning the pin was trying to rotate in its hole. So yes if I was to possibly find a small enough and strong enough magnet, maybe I could pull the remainder of the pin out.