Quote
Last time I did a compression check I only removed the spark plug on the cylinder I was testing. Is that correct or should I have them all removed ?

This procedure looks OK:
"Disconnect the main wire to the coil and spark plug wires; remove spark plugs."

Remove all spark plugs - 1954 Truck Shop Manual