If it is the manifold that bolts directly to the stock exhaust manifold, I would think you would want the insulators. Aluminium transfers heat better than cast iron. And I would think that OEM used them for good reason. Try it both ways and see if there is a significant difference in performance and heat soaking. An Infrared thermometer is your friend on this one.

SimS