From your description I would certainly look at the roller bearings carefully and getting the correct adjustment on those is where to start when you put it back together. With the sector screw turned in all the way like you describe I think those bearings or the adjustment of them will make a big difference. If you get those right and replace that outer sector bushing it will probably feel like a new box.