I don't think you can get the window out, or put it back in, without first removing the vent window. But removing the vent window isn't that difficult ... I think the most difficult thing is putting the vent window back in; getting the door window into the felts -- and even that isn't too bad; just takes a little patience.
