This is another case of guys warning against something they have never actually done themselves.
I have torn many rivnuts out of sheetmetal and lived to tell about it, thus why I am far more cautious now. That said, I have given my answer to the OP question. As with anything on the internet, your mileage may vary.