If the noise is a 'squeal' or high pitched sound, it could be a pressure relief that is set too low. If it is a growl or grinding noise it could be the pump itself.
Also, check the belt tension and mounting bolts, either of those can cause noises.
Does the steering work ok? Plenty of power, no jerks when turning quickly? If so, I doubt that the pump or relief is at fault.
