If this tank was on the truck and working when you got it, my guess would be its possible the cap doesn't seal air tight. That being said if you drill a hole in the cap when the tank is full you might get a small amount of leakage from movement of the gas in the tank. Take a look at any lawn equipment that has a vented cap, they have a chambered area that doesn't allow gas to come out.
