Strongly suspect the issue is in the rear, since that is what changed when this symptom appears.
Good tip on the gravel road. I used new hardware on the rear, but perhaps something isn’t moving freely. Drums and pads were in excellent shape. Must have been nearly new when this axle got pulled for a 5 lug swap.
Shouldn’t the direction of “pull” lend a clue as to which side is the problem? On a drive axle, in the rear…would a left pull most often be associated with a left wheel? (Truck pivots left around the wheel that stops first). Again, this is subtle.