Just checked the harmonic balancer, it's a bolt on and it's tight, so that can't be the problem.

I'll pull the engine this weekend and put it on a stand. I'll start the teardown by dropping the pan and seeing what it can tell me.