You don't really want to drive it like that. I would try disconnecting the field lead at the regulator and see if it still does it at higher RPMs. If it doesn't, you have a regulator problem. If it still does it, try disconnecting the field lead right at the generator.
