Start small, about 3/32" or smaller, as you can always enlarge the hole if you don't get enough vacuum. It's tough to drill it smaller! The "ported" vacuum should come in just above idle, so drill the hole to be exposed as the throttle plate opens a little. Vacuum on the distributor at idle makes it difficult to slow the engine down enough for a slow, smooth idle.
Jerry