Unless you want to sand the filler forever, I'd use something like 80 grit for that. For your final sanding, 400 grit should give you a decent result for final coating. If you have some imperfections that need to be sanded out, you could use a bit coarser grit, say 220 until those are gone, then finish up with the 400 grit.
