I believe you will find there should be 2 set screws. First one tightens the handle to the regulator, then the second one goes in on top and locks the first one from backing out.