Sounds like might be applying wrong procedure given the different bearing type.
First try to find instructions for wheel bearings like you have.
Jerry,
The stack up of tolerances isn’t an issue.
The adjustment procedure dreamed up long ago is based on thread pitch of the spindle nut and that pitch divided by 6, the six positions given by six slots in the nut.
I don’t know the pitch, but say for ease of math it’s 16 tpi, so one turn is 0.0625” and 1/6 of that is 0.0104” adjustment per slot.
If this was adequate then is still should be. Or perhaps there was a service bulletin put out with alternatives?
Wheel shaking when jacked up is a little different than play it may or may not have when on the ground, the tapered bearings with load tighten up.
Tapered bearings to tight and they heat, or heat in normal use and then get to tight if not left slack enough.
Probably more to understanding all the factors and variables involved than we may think of, “reengineering” without a full understanding might be asking for trouble.
In the end check how warm they are after an extended drive, slack off adjustment if necessary.