I would try to find a rod that will fit snugly in the top of the tube. Then clamp a vise grip around the tube where the rod is and try to twist the tube gently. You can also tap on the bottom of the vise grip with a hammer to help jar in loose.

I would not use a punch on the bottom side. You may mushroom the bottom end and then really have a bad time getting it out.