Here is a Stovebolt.com Tech Tip on 6v to 12v conversion.

Yes, you should change all light bulbs to 12v.