Leave it plugged.

Some people do a "cob job" connection of an oil line from the other side of the block (from a by-pass oil filter port) over to that plugged hole. It feeds more oil to the rocker arm assembly.

Maybe someone (Pre '68 Dave?) knows the purpose of that hole on the distributor side of the head.