Do have free play between the brake pedal rod and the master cylinder? If not, maybe the piston isn't returning in the master cylinder all the way. It would be like driving with the brakes on and creating heat, and making everything expand and get worse with more heat. Then when it cools down, everything is normal again till it heats back up. Just a WAG.
