The safest, most accurate way to trim the sleeve would be with the crankshaft in a lathe, which is how I'd do it. Otherwise, try using a small angler grinder and a very light touch to nibble the excess length away, followed by a final touch-up with a file.
Jerry