Yes, this is a very tricky area. If the inner panel has ever been worked on then that part of the curve is probably not original. For strict 100 % restorations, you will notice that the notches in the inner to outer that fit over the groove contours of the inner, are much wider than the originals. This is to allow some slack for fitment.
I think that we are luck to have these panels available.