I'd leave it like it is and use it. Doesn't hurt to have the extra pressure and might come in handy years down the road when clearances get bigger and pressure goes down. Besides, if you accidently deform the body while trying to change out the spring ( say if you clamp it in a vise ), the whole pump will become worthless.

Actually, the pump doesn't create more pressure. It creates more flow ( which is a good thing.) Restrictions (resistence) upstream from the pump is what creates the pressure.