The caster will affect bump steer. For the suspension to feel rougher sounds more like decreased suspension travel. Is your suspension bottoming out at the bottom of the stroke?
If you add caster it will help the bump steer, but won't help your suspension travel. Your caster angle may have changed a bit. Experiment and see what works best.
