I've had some success over the years using " Killz " primer. It seems able to seal all sorts of markers - sharpie, metal markers, wood crayons, etc., but.....why chance it. As previous suggestions, I'd try a small pin stripping brush

1940 Chevy KC 1/2-Ton
In the Stovebolt Gallery