The cold water on the pump is simply cooling the fuel coming out of the pump, just as you suspect. Fuel flow keeps the pump from overheating, if the flow is restricted, the pump runs hotter.

If the filter before the pump is clean, it will have little effect on the operation.