I know what you’re describing. Similar situation I encountered.
It’s been a minute. But I ~think~ I gently tweaked the “inner ring” or the “outer ring” with some pliers to snug it up. Maybe it was both. Either way, it worked. It’s still not crazy tight but doesn’t wobble either.