I ended up just treating the dried rubber and lubing the heck out of the bearing. Once I got it all back together, the center bearing seemed fine. I'm not going to lose sleep over replacing this part, I won't be driving it much, so I think it's fine for now.