I believe to get the diaphragm off you'd have to remove the actuator lever, there'll be an "eye" on the end of the shaft behind the diaphragm that the lever arm hooks into so it can pump it up and down .... if it's not split or dried out brittle you shouldn't need to disturb it
Bill