Even with new remote and a new door handle, the inside handle was still loose an a booger to try tighten.
After looking at the new vs the old, then looking INSIDE the new door handle at the cut splines it was easy to see my biggest problem. It was the shallow cut splines...

At least it was my particular problem.
I'm going to switch back to my "slightly used" old ones. At least they work better.