You can run (at idle) the engine with valve cover off. It will sling a little oil. If you speed up the engine, it will make a mess. Cover your fenders. It will get some oil on your carburetor and manifolds. How do I know? On a seriously used Stovebolt, the rocker arm face may have an indention from wear. Almost impossible to get a good feeler gauge setting with either hot or cold engine. You can call it "shade tree" or "farm boy" but you can ** carefully ** adjust the valves with engine running at dead slow idle. It will leave marks in up your feeler gauge but on an old farm truck, you just want the truck to run. The proper solution is to pull the rockers and have them resurfaced at the machine shop.
If you look at the Master Parts List, the shaft part number is listed. Quantity is 2. So both halves of the RA assembly are the same.
RA orientation:
http://chevy.oldcarmanualproject.com/shop/1954truck/54ctsm0611.htmlhttp://chevy.oldcarmanualproject.com/shop/1954truck/54ctsm0612.html