Either is good for me. My '49 Poncho which I drove as a daily driver, had a three speed column. Like Truckernix said, the only drag was having no synchro for 1st gear. But I found that when driving in traffic, as long as the wheels were turning, it was fine to start in second.
My Panel's got the 4 speed, and I like it too. My One Ton had the 4 speed too of course. I do find I use first gear all the time, for parking, and starting on steep hills, or to enrage pushy BMW drivers (no offence, I don't mean you). I do like how ridiculously low 1st is, you can just creep along. The huge throw of the 4 speed is great too, these modern shifters! My signal stat has more throw than that!
With either the 3, or 4 speeds, one of my favourite things is two lane road trips. I really like how you can slow down going through a town, right down to 10 or 15 mph without shifting, and then as you leave the town, just pull it back up to 50 without having to shift. You don't get to do that with a 4 cylinder car!
Someday I hope to have something with a straight-8, for even more torque at low rpm.
