Originally Posted by Wally / Montana
.
.
Do I remember a small ~1/8" hole in the thermostat's plate?

Yes, I remember that hole (or, I drill it).

Consensus of opinion is to drill the hole, if a hole is not already in the plate.
Here are the results from another Internet search - on/in stovebolt engines.