I understand that you have removed the locking pin, correct? So normally you can drive the pin out from the inside of the frame. Maybe the pin is worn in such a way that a groove is hanging up in the hole. It probably would be good to have the spring free from all other attachments so that so can move it around.
If you go for a replacement hanger, look for bollts that are as close in in size as possible.
