That's pretty small but I have had good luck with left handed drills and taps. A lot of times the left handed drill just grabs it enough to remove it.
I wouldn't try that without a few good soakings with penetrating oil, and possibly some mild heat. There's enough rust there that those stubs are securely in place, as evidenced by the fact that the head broke off.