Before you get out the BFH, try loosening those 4 bolts and see if you can move the mechanism around a bit. That was all it took to line up the stomp starter on a friend's '51 when we changed the engine. If you replaced the rear mounts on the bellhousing, everything has moved a bit, anyway.
It may come down to the BFH and blue tipped wrench, but it may be more simple than that, too.
best wishes,
Les