Yes, that definitely should have a cover on it. Without it, the shifter shaft is unsupported (bearings at top and bottom) and shifting may not even work correctly. You may have trouble finding just the cover, but might be able to come up with a complete shift box.
Try the swap meet here, or maybe try
Jim Carter. I believe they offer rebuilding service for the shifters and may have a cover available or a complete used one.
