You will need to inspect the cam.
I have limited experiences with came (three rebuilds), but if there are no pits in the cam-lobes to lifters mating surfaces, I'd probably reuse the cam.
If you break down the engine (you posted that you hoped not to break it down), you'd get a better look all cam-wear surfaces.