It may be the solenoid. The small wire on the outside of the solenoid is to power the coil while in crank mode and then cut the connection once the starter is no longer in use. If that wire stays live, the solenoid is bad. I thought it was the yellow wire. If you have that on the big lug, that could be the reason the coil stays powered with the key off too.