If you decide to take the door off, and you like the way the door fits currently, do yourself a huge favor and pin the hinges prior to removing the doors.
Use a new sharp high quality 3/16' or 1/4" drill bit to drill on hole for each hinge strap in the door. Drill through the inner door panel, hinge strap, and the sheet metal behind the hinge strap.
This will make it possible to put your doors in the exact same position.
Carl