fill always on metal. Ive seen way to many cars with cracks that I had to fix because someone primers then put filler on top of that.
The only filler I have ever used over primer and ever been given the ok by the paint reps is finishing putty or premium filler with a high talc content ie yellow as can be.