You described the classic symptom of a loose idler arm. Check for up-down play and if any is present, replace the bushings. The symptoms can be exacerbated by caster angle problems, loose tie rod or drag link ends, but it almost always starts with the idler arm. When it happens, a quick application of the brakes usually stops it.
