The oil pressure regulator is the only thing thst comes to my mind. If it is sticking as the volume drops, as speed drops to idle, then it will drop the pressure as you described. Bearing clearances do NOT change for a restart.
So would that be the bypass valve in the filter canister housing? I cleaned it really well a while back but the parts are old, are replacement parts available?
