Well, with a mix of parts I’m not sure what “normal” would look like. My 63 and 65 columns have a brown (of memory serves me) wire inside the column horn mechanism which will cause the horn to sound if the brown wire connects to ground. So your horn button is connecting the ground but not releasing from ground somehow. That means your horn button sticks, or a spring mechanism under the button is binding.
My thoughts are written here, but I’d like to see pictures.