I like the "if it ain't broke, don't fix it" approach to automobiles.
If they're brass, leave them alone.
If they're steel, knock them out and replace them. You can even use those expandable, solid rubber plugs with a wing nut on the end. I used one to replace the rusted out core plug on the driver side near the drain plug.
