You don't drill out the entire cylinder. Drill about a 3/8" hole in the center then dig the spring and pin pieces out of the hole. Once the pins are out of the way, the cylinder will turn for removal.
"It's just a phase. He'll grow out of it." Mama, 1964