I think you are trying to remove the hub, correct? There is no place for a big hammer in removing the hub. If you have the nut and waasher off, the inner bering race should slide off. normally a little push inward on the drum will cause the bearing to pop out.