Every home builder thinks they need to metal-finish every panel. The fact is that even the top builders and restorers in the country use plenty of filler on their patch panels. I read a Street Rodder magazine article once the estimated that there were probably fewer than two dozen cars in the country that were totally metal finished.
Conclusion: knock the high spots down with a hammer, throw some bondo over it and don't sweat it.
