Whenever I change front brakes I just take the hub and drum off together. That gives me a chance to inspect, clean, re-grease and then adjust the front wheel bearings; as well as change the shoes. Don't see any reason to remove rivets except for comments above concerning after market wheels.
