It is a good point that circumstances vary for everyone. You requested opinions and they were given.
Did you keep track of the lifters so you know which cam lobe they are associated with? In my opinion I would just replace the 4 pitted lifters if your going to use the same camshaft. As long as the other lifters can be put back on the same lobe they wore into you only have a 4 out of 12 chance of eating up the cam with different lifters. When things change and you decide to do a complete rebuild then you can replace all the lifters along with either a replacement cam or having yours reground.
