Caster is a non wearing adjustment. Truck tracks straight? Truck does not wander?

If answers are Yes and Yes then No to the shims. For it is not broke then no need to fix it.