Do you hear any vacuum leak? I have a suspicion that it has a bad seal. Mine is basically doing the same thing and I plan to buy a 6V electric motor that fits the same location. They are spendy but I think worth it to eliminate the hassle of the vacuum motor.
LINK From what I understand there are only 1 or 2 people in the country that have the parts to rebuild the vacuum motors.
