Check out the picture- - - -an original equipment bushing is bonded together- - -outer sleeve, rubber, and inner sleeve. So far you have removed 2/3 of the bushing and left the outer sleeve in place.
http://www.automedia.com/Content/Articles/Images/res/res20011101br/res20011101br00.jpg?The movement of the bushing is supposed to happen between the bonded parts with the rubber doing the flexing. With the polyurethane "bushings" the control arm is just sliding over the surface of the plastic, not flexing like a rubber bushing does.
Jerry