A couple of things I think taller drivers notice that affect their driving experience:
a) The peddles require you to lift your legs (higher) unlike modern cars where you can often just pivot your ankle. Drivers with longer legs will notice how close their knees get to the steering wheel.
b) The condition of the seat (height and springy-ness) will also determine how high up you sit and how close your head really is to the headliner.
c) The size of the steering wheel often rubs against portly men (I haven't gotten there... yet). Fortunately taller drivers will keep the seat all the way back allowing room for their longer extremities.
Now the average height of an American male went from 5'8" in the 50s to 5'10" today. However, being over 6 foot, you're just a tall drink of water no matter what time period.