It very well could be a clutch slippage issue. If you are taking it easy with it when loaded and not slipping the clutch that could explain the situation. If you are getting on the gas much more when empty and slipping the clutch, then yeah, I could see the inconsistency. I would address that clutch issue first, that's the primary issue to fix first and that will tell you if it's related.