Sounds to me like a backfeed situation from another electrical component which shares the same power supply as your fuel pump. That other component may have a weak ground.

1952 5-window - return to "as built" condition | 1950 3100 with a 235 and a T-5 transmission