While scotchbrite might do an OK job, nothing beats a good old wetsand to smooth primer. Any roughness or texture in the primer will transfer to the topcoat.
Now that I think about it, sandpaper on a block would be best. Here I am preaching perfection and suggesting otherwise. Bad Czechman :mad: