Ok I am going to assume you are far from being an
everyday joe that does this for a living, as 99.3% of the population does not do also,(just guessing at those numbers! do no quote me on this).
#1 you are looking with your eyes and not with your hands.
#2 sand from the outer most edges inward to any low spots, trust your hands before your eyes.
#3 even if you think it is not close (by eye) spray it with primer, then mist with black primer and MIST, NOT PAINT.
It sounds to me like you are going by eye and not feel. The eye is the easiest thing too fool when it comes to body work, it can look straight with paint,only a magnet will tell.