Just sand it down till you see high spots showing through the primer. Add a second or third coat of primer, sand it till the high spots are smaller and just keep going till you have it all smooth or till you are tired of messing with it. A first coat of primer, of any type, will let filler show through. Filler has a lot of micro holes in it so it will take a fair amount of paint to fill and hide. Joe