It sounds to me like it is that first coat of primer. Either the quality, or the thickness applied with insufficient curing is causing excessive shrinking in scratches that may be too deep.
Normally those scratches would be filled with your successive coats, but with the shrinking you are fighting a losing battle.
Make that first coat much less heavy and extend the curing time before the second coat.
