I can't comment on the main problem you're having, but if you're having to back the shoe adjustment all the way off just to get the drum on, then it sounds to me like your drums are worn out (must be a sizable lip on them).
1950 4100 - unrestored and driven weekly for almost no reason at all.