Your second image doesn't look too far out of the right range to me, however...some questions:
1 Are these new ring & pinion gears? If they are old gears getting them adjusted so they don't whine might not be possible. Sorry to be the bearer of bad news but that is the truth as I've learned it to be over the last 60 years. They get worn and they get happy. When you change them, they make noise.
2 How are you generating that pattern? By that I mean are you adding drag to imitate a load?
You want the pattern as centered in the ring gear teeth as possible. As you may know it is not easy to have this go perfectly your first (or even second or third) time. A tight pinion bearing can and will make noise. If it is too loose, it will make noise on deceleration. If it is too tight, usually it will cause it to get hot and there will be a constant whine...sort of like the distant whine of an older style fire engine siren. Deceleration puts a backwards load on things...reverses the load that is put on components during acceleration. Not always easy to track down in my experience but I've seen failing bearings in the differential cause this. You are putting on them a load they don't normally get and that will cause a weird howling.
Please tell us more.
