Powerglides are tough. I was driving my 62 Impala 283/powerglide at about 15mph and I reached to grab something on my dash. My forearm hit the shift lever and knocked it in reverse! It didn't seem to hurt the tranny.
I say drop that 350 in and forgetaboutit.