Something similar happened to me once. Turned out to be a vacuum leak. After I found the problem and fixed it everything was fine.

I don't know if that's your case, but its something to check into.