Magnets don't work on Stainless Steel. What ya need is that Gnome from the Travelocity commercials. (He's got little fingers)
Try a nut driver with some spray on contact cement to help hold the washers in place while ya start em. If the nut driver is too deep, put 2 nuts in. Good luck.
