You're on the right track with your idea of how to correct the problem, but first try turning the mounting bracket 180 degrees and bolting it back on. If that solves the pulley alignment problem you might not have to drill new holes, but you'll obviously need to adjust the length of the bracket some way.
If you don't want to alter the original bracket, a piece if 1" wide, 1/4" thick flat stock can be heated and bent into an original-appearing part and then drilled to fit. I promise not to tell anybody if you do that!
LOL!
Jerry
Last edited by Rusty Rod; 04/02/2017 1:19 AM.