Sounds like you either got the rumpy E-2 cam or your carbs/timing isn't set right.
I can get the 264 cam to idle somewhat smooth @ 600 rpm in my 235 with twin 32/34 Carter webers, course it's not pushing an automatic.
Whats your topend and at what rpm?