There's probably a ring of rust on the stem. A new valve guide is $6 and new valve is $15. New head gasket maybe $30?

A little more work, take the head off, replace the valve and guide.

Shouldn't take more than an hour with the proper tools.