As Dads50 said a smaller drill or transfer punch works. Hold the drill press in the down position while you tighten the vice, then if you can raise the drill press with out it trying to lift the piece, it's good.
If I remember, the 11/32 is the clearance drill for the hinge body. on the 48 the knurl grabs into the hinge frame and that is a different size drill.