Had a buddy once who down shifted all the time....and from some pretty high speeds. I could just see the crankshaft torqueing up and down on the ends!.....while the engine begged for some relief. Engine puked and I just told him "told you so".
Yeah, for me no down shifting except in an emergency. Just my opinion.
