Are you sure the punch is suppose to perforate the rivet?
I thought I saw in my trucks that the rivet bottom is usually still intact and the bottom is driven sorta flat and flush but not broken open to expand the rivet back side
These are fancy pants rivets with a special shape to make them expand when their bottoms are driven sorta flat.
-s