I recently bought a new thermostat for my '28 Canopy Express (same thermo as in a '53 Chevy) and it already had a small hole off to the side, but also had a tiny, brass valve going through it to prevent flow through the hole when the engine is running.
Dean