I probably didn't make myself clear about what to check. It's OK if the rotor can turn back and forth a little- - - - -that's the centrifugal advance working, which is normal. If the shaft can shake side to side, more than just a little, it will allow the point gap to change. If that's happening, the only fix will be to change the shaft bushings, or swap for a better-condition distributor. Also check for the sloppy vacuium advance linkage connection, which would cause the same kind of problem.
Jerry