You may also have a bad or worn synchro and double clutching, as mentioned above, will produce a smooth shift. Just make sure the clutch is all the way out when you hesitate in neutral when bringing up the RPM's before you downshift to a lower gear.
Bill
