PLEASE don't use a hammer and drift.

You will certainly maul the nuts, and quite possibly nick the threads on the axle tube - making it that much more difficult to remove the next time.
As stated above, those sockets are not overly expensive. I see them on our favorite auction site all the time for $25 - $30. The only difficulty might be getting the exact one for your specific application.
Can you post a pic of the nut with a ruler or tape measure in the pic? I may be able to determine the exact size and type.
Best Regards..