If there is rust that means that there isn't any paint in that area. Buffing it won't help.
You will spend tons of time on that old paint that's bad anyway so you might as well just paint it. If you are concerned about new paint pealing you need to do a bit O homework beforehand. Auto body shop suppliers will give tons of free advice. That's how I began, by picking brains.....
