I have a 54 panel withe the same issue. Bought a spring that was supposed to help but nope.
Now I’ve decided to try to find a new latch/handle mechanism, any idea where I might find something like that? I suppose if you did you’d have done the same yourself. I’m stumped as to how to fix it.