Needing to drop the exhaust to pull the starter seems like it would not be ideal. Could the rear exhaust be shifted forward enough to allow the started to be removed as well as providing some much needed clearance for heat?
Doesn't look like it, but there is tons of room to get that starter out. I always look to serviceability when I fabricate things. I would suggest letting things cool before starting work though. But plenty of room to go towards the front of the engine, back, up, down, and any other direction that strikes your fancy.