There are two valves in the pump. One of them should hold the fuel in the line so that it doesn't return to the tank.

Sounds like the fuel pump is bad.