Another issue with leaving the exhaust pipe attached is dealing with the intake alignment sleeves. They are easy to deform even without the exhaust pipe attached.
I recommend that you take care of all possible causes for leaks, and take everything apart and put it all back together.
Trust me, you will feel better about it once you are done and have no leaks.
Carl