When drilling the rivets(any rivet in general) try not drilling all the way through the rivet, maybe halfway or so. This will leave an indentation or pocket for your punch to fit in, while weakening the fit of the rivet. The punch will stay in the drilled hole when hitting!