Does the truck have a filter? If so, when you changed it, did you add about an extra quart for the filter?
Burning a quart in 50 miles, would be allot of smoke. I've done it!!
What grade oil did you put in the truck? Is there a puddle of oil under it?
Also, it could leak from the fittings on the block or filter only when it's running.