There is a small amount of pressure on drum brakes when the master cyl. is not depressed. It is called residual pressure & is built in to keep from drawing in air on release of the brakes. If it enough to cause drag , you probably have a poor adjustment in the rod between the booster & master cyl.