Yes, measure the 6v battery (or the battery-space in the battery holder) and find a 12v battery to match the space (and, preferably, with a top dimension that fits inside the battery hold-down frame).

Years ago, I matched a 12v from Walmart and a 12v battery from Sam's Club.