I had the same issue (pin holes), with my oil bath air cleaner. If it was mine, I would clean it up, then braze the holes closed or have it brazed. It would be a permanent fix. If it is done from the inside, you could lightly grind the outside flush, give it a paint job and you would never know it was fixed.
