I have had similar problems in a couple of vehicles. But it was also accompanied by a significant noise from the speedo. You didn't mention any noise. In my case it was the bushing where the cable connects to the speedo. The lube had dried out.

regards,
Leon