No, unless there's a piece of the pushrod that has fallen down into the side cover, just pull it out the top. You can loosen up the adjusters and push the rocker arm(s) sideways against the spring on the shaft to remove/install the broken one. If you can't reach the broken piece, pull the side cover. No need to remove the head. New pushrods for stovebolts aren't made any more, to the best of my recollection. Get a length measurement of a good-condition pushrod from your engine and PM that dimension to me. I'll send you one.
Jerry