They should be snug, when clean you should have to push them in by hand, and they should not fall out on their own.
The shims are OK, that's to take up the slack and variation in the axle end and the thrust bearing.
You may have more than one oversize pin choice if needed.
Grigg
