I think the fuel pump is supposed to have a check valve in it. I had the same problem and replaced my Rochester B carb with a Carter, and bought a new fuel pump. That seemed to fix it.

Kurt