Do you know what grit is on the sponge??
If not, you may be in for a lot of resanding.
Typically these sponges are a 180 or 220 grit, which is much too coarse to apply your finish coat over without showing a lot of sand scratches.
For a urethane finish, the coarsest I would use is 400 wet or dry paper.