If the weights aren't very large, you most likely won't notice a thing. Those are for balancing the drum, and at worst, you may get a vibration in the rear. I've taken weights like that off drums many times (usually due to the welds rusting away), and have never had any combacks from it.
