The screws were holding a sheet metal baffle that prevents splash oil from flooding the vent tube and dripping onto the ground. Yes, you'll need to drop the pan to retrieve it. The vent is a firm press fit, so just use a little more persuasion to dislodge it.
Jerry

"It is better to be silent and be thought a fool than to speak and eliminate all doubt!" - Abraham Lincoln
Cringe and wail in fear, Eloi- - - - -we Morlocks are on the hunt!
There is nothing noble in being superior to your fellow man; true nobility is being superior to your former self. - Ernest Hemingway
Love your enemies and drive 'em nuts!