It does sound like it could be a heat issue.
If it doesn't happen after sitting or local driving (assuming you go 5 minutes without hitting the brakes)it doesn't sound like a leak or leakby.
Exhaust too close to a line or the master cylinder or a wheel cylinder heating up due to brake drag would be the common causes.
