Some are metal, some are bakelite/hard plastic. Some have a set screw and others were molded to the lever when they were made. Much variation exists. The metal ones can generally be pulled off carefully. The plastic/bakelite ones will often break because they can be pretty brittle and I've not had much luck separating those from the lever...good luck! As Kevin says it is best to remove the whole assembly.

~ Jon
1952 1/2 ton with 1959 235 | T5 with 3.07 rear end